CN114900386B

CN114900386B - Terminal equipment and data relay method

Info

Publication number: CN114900386B
Application number: CN202210500738.9A
Authority: CN
Inventors: 卢可敬; 王莎莎; 李金昆
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-05-09
Filing date: 2022-05-09
Publication date: 2023-10-31
Anticipated expiration: 2042-05-09
Also published as: CN114900386A

Abstract

The application provides a terminal device and a data relay method, wherein the method can acquire a switching instruction input by a user based on an application page; responding to the switching instruction, detecting an application identifier, a page identifier and a target function identifier corresponding to the current application page, wherein the target function identifier is an identifier of an application function used by the terminal equipment when the switching instruction is acquired; then, relay information of the terminal equipment is called, and if the target function identification is inquired and recorded in the relay information, a target equipment list fed back by the server based on the target function identification is received; generating a relay command according to the voice command input by the user; and selecting receiving end equipment in a target equipment list according to the relay command, and sending data to be relayed to the receiving end equipment. Therefore, the real-time performance, the efficiency and the accuracy of the data relay are improved.

Description

Terminal equipment and data relay method

Technical Field

The application relates to the technical field of intelligent home furnishing, in particular to terminal equipment and a data relay method.

Background

With the popularization of terminal devices and networks, the number of terminal devices in a family is continuously increased, and linkage among multiple terminal devices is more and more. Therefore, the attention to linkage control between the multi-terminal devices is getting higher and higher.

Currently, coordinated control between multiple terminal devices generally refers to data relay between the multiple terminal devices, that is, a picture displayed by a certain terminal device (e.g., an originating terminal device) is relayed to another terminal device (e.g., a receiving terminal device), and the picture is displayed by the other terminal device.

However, in the conventional coordinated control between multiple terminal devices, the terminal devices supporting the data relay cannot be detected in real time, which results in poor real-time performance in the data relay and low accuracy and efficiency of the data relay.

Disclosure of Invention

The application provides a terminal device and a data relay method, which are used for solving the problems of poor real-time performance, low accuracy and low efficiency of data relay when a receiving end device is determined in the data relay process.

In a first aspect, the present application provides a terminal device, including:

a communicator configured to establish a communication connection with a server;

a controller coupled to the communicator, the controller configured to:

acquiring a switching instruction input by a user based on an application page;

responding to the switching instruction, detecting an application identifier, a page identifier and a target function identifier corresponding to a current application page, wherein the target function identifier is an identifier of an application function used by the terminal equipment when the terminal equipment acquires the switching instruction;

Invoking relay information of the terminal equipment, and if the target function identifier is queried to be recorded in the relay information, receiving a target equipment list fed back by the server based on the target function identifier;

generating a relay command according to a voice command input by a user;

and selecting receiving end equipment in the target equipment list according to the relay command, and sending data to be relayed to the receiving end equipment.

In a second aspect, the present application further provides a data relay method, where the method is applied to a terminal device;

the method comprises the following steps:

acquiring a switching instruction input by a user based on an application page;

invoking relay information of the terminal equipment, and if the target function identifier is queried to be recorded in the relay information, receiving a target equipment list fed back by a server based on the target function identifier;

generating a relay command according to a voice command input by a user;

According to the technical scheme, the terminal equipment serving as the initiating terminal equipment can determine the receiving terminal equipment according to the target equipment list, and the receiving terminal equipment is selected from the target equipment list according to the relay instruction; the target device list is received before the relay command is generated, that is, the target device list is generated in advance, so that the efficiency and the instantaneity of determining the receiving end device can be improved.

And the target equipment list is selected by the server based on the target function identifier corresponding to the current application page of the terminal equipment, so that the target equipment in the target equipment list can be ensured to support the application function corresponding to the target function identifier, the determined receiving end equipment can be ensured to support data relay, namely the receiving end equipment can be ensured to realize the data relay, and the accuracy of the data relay is further improved.

In addition, the application functions of different applications may be the same, i.e., the function identifiers of different applications may be the same; for example, the function identifier of the playing function of the application S1 is S11, and the function identifier of the playing function of the application S2 may also be S11, so, assuming that the data played on the application S1 in the initiator device may be relayed to the application S2 in the receiver for playing, so as to increase flexibility of data relay.

Drawings

In order to more clearly illustrate the technical solution of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

Fig. 1 is a schematic diagram of an application scenario of a terminal device in an embodiment of the present application;

FIG. 2 is a block diagram illustrating a configuration of a control device according to an embodiment of the present application;

fig. 3 is a hardware configuration block diagram of a terminal device in an embodiment of the present application;

fig. 4 is a software configuration block diagram of a terminal device in an embodiment of the present application;

fig. 5 is a flow chart of a data relay method according to an embodiment of the application;

FIG. 6 is a schematic diagram illustrating a page switch according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a data relay according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a hint instruction according to an embodiment of the present application;

FIG. 9 is a schematic diagram of generating a relay command according to an embodiment of the present application;

FIG. 10 is a schematic view of a relay result according to an embodiment of the present application;

fig. 11 is a flow chart of data relay according to an embodiment of the application.

Detailed Description

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

Fig. 1 is a schematic diagram of an application scenario according to some embodiments of the present application, which is intended to show a scenario in which a plurality of terminal devices, including but not limited to devices having data transceiving and processing functions and image display functions and/or sound output functions, exist, and a server that can communicate with the terminal devices.

In the scenario shown in fig. 1, the display device 200, the mobile terminal 300, the intelligent refrigerator 400, the sound box device 500, and the server 600 are included. The intelligent refrigerator 400 includes a data output device such as a display screen, an audio player, etc.

Based on the everything interconnection technology, communication connection can be established among a plurality of terminal devices in the scene; for example, communication is performed between the mobile terminal 300 and the display device 200, whereby an image displayed on the mobile terminal 300 is projected onto the display device 200.

For another example, a "dog image" is displayed on the display screen of the mobile terminal 300, and the "dog image" is projected to the refrigerator 400 so that the "dog image" is displayed on the display screen of the refrigerator 400.

For another example, the mobile terminal 300 plays the song "TX", and audio data corresponding to the song "TX" is sent to the speaker apparatus 500, so that the speaker apparatus 500 plays the song "TX".

Communication protocols that implement the above-described everything interconnection may include a local area network protocol, a wide area network protocol, and a short-range wireless communication protocol that is not limited by a network. Among them, the local area network protocol includes, but is not limited to, bluetooth Headset Profile (HSP) communication protocol; wide area networks include, but are not limited to, the artificial intelligence internet of things (Artificial Intelligence & Internet of Things, AIOT) protocol, and short range wireless communication protocols include, but are not limited to, bluetooth transmission protocol, infrared transmission protocol.

Based on the difference of the types of the communication protocols, the communication protocol channels of the terminal device can be divided into a local area network protocol channel based on a local area network, a wide area network protocol channel based on a wide area network and other protocol channels. Other protocol channels include bluetooth protocol channels, infrared protocol channels, etc. The terminal devices in the above scenario may support one or more of the aforementioned protocol channels.

The terminal device may establish a communication connection with the server to interact with the server, for example to provide various content and interaction information to the terminal device. The terminal device may be permitted to make communication connection through a local area network (Local Area Network, LAN), a wireless local area network (Wireless Local Area Network, WLAN) and other networks. The server 600 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

It should be noted that, in the same scene shown in fig. 1, other terminal devices may also be included, including but not limited to external terminal devices such as a touch integrated device, a projection device, a tablet computer, a notebook computer, and the like. The number of devices of the same type of terminal device is not limited herein.

In some embodiments, the control between different terminal devices may be implemented by the control apparatus 100. As shown in fig. 1, a user may control or operate a television 200 via a control device 100 to communicate data with a mobile device 300.

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the terminal device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the terminal device is controlled by a wireless or wired mode. The user can input user instructions through keys on a remote controller, voice input, control panel input and the like to control the terminal equipment.

In some embodiments, the terminal device may further perform control in a manner other than the control apparatus 100, for example, the terminal device may be configured to directly receive the voice command control of the user through a module for acquiring a voice command configured inside the terminal device, or may be configured to receive the voice command control of the user through a voice control device set outside the terminal device.

In some embodiments, the terminal device may receive the instruction not using the terminal device or the control device described above, but by touching or gesture or the like.

In some embodiments, the terminal device includes a controller, a memory, a communicator, and a display. In some embodiments, the terminal device further comprises at least one of a modem, a detector, an external device interface, an audio output interface, a power supply, a user interface. Among them, the controller includes, but is not limited to, a processor, a video processor, an audio processor, an image processor, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), and the like.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control device 100 may receive an input operation instruction from a user, and convert the operation instruction into an instruction that can be recognized and responded by the terminal device, so as to perform an interaction between the user and the terminal device.

Fig. 3 shows a hardware configuration block diagram of a terminal device in accordance with an exemplary embodiment.

In some embodiments, the terminal device includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving image signals from the controller output, for displaying video content, image content, and a menu manipulation interface, and for manipulating a UI interface by a user.

In some embodiments, the display 260 may be a liquid crystal display, an OLED display, a projection device, and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The terminal device may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

In some embodiments, the user interface may be configured to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the terminal device and responds to the user's operations by various software control programs stored on the memory. The controller 250 controls the overall operation of the terminal device. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments, the controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), a random access Memory (Random Access Memory, RAM), a Read-Only Memory (ROM), a first interface to an nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of an input signal, and obtain a signal that can be directly displayed or played on the terminal device.

In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the audio signal according to a standard codec protocol of an input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

Referring to FIG. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (referred to as an "application layer"), an application framework layer (Application Framework layer) (referred to as a "framework layer"), a An Zhuoyun row (Android run) and a system library layer (referred to as a "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on a display, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command. The user interface is an interface (such as a physical key on the terminal device body, or the like) which can be used for receiving control input.

In some embodiments, when presenting certain data (e.g., pictures, video, audio, etc.), the terminal device may push the data to a user-specified terminal device, i.e., a receiving end device, in response to user control. So that the receiving end device continues to play the data. In the above process, the process of pushing data to the receiving end device by the terminal device so that the receiving end device continues to play the data is called data relay.

For convenience of explanation, in the following embodiments, a terminal device that initiates a data relay will be referred to as an initiator device; the terminal equipment which receives the data and continues playing the data is called receiving terminal equipment; the data may be picture data, video data, audio data, etc., and is not limited herein.

Referring to fig. 1 for example, when a user views a movie (video data) on the display device 200, the user goes to a kitchen to cook, and the refrigerator 400 in the kitchen has a display screen, the user can push related data of the movie viewed on the display device 200 to the refrigerator 400 by operating the display device 200, thereby completing data relay, and the refrigerator 400 continues to play the movie. Furthermore, the user can cook in the kitchen and watch the film continuously.

For another example, when a user listens to a song (audio data) on the display device 200 in a bedroom, the user needs to go to a living room, and the living room has the speaker device 500. The user can push the related data of the song played on the display device 200 to the speaker device 500 by operating the display device 200, thereby completing the data relay and making the speaker device 500 continue playing the song.

In some embodiments, in the process of pushing data to the receiving end device by the originating end device, semantic analysis is required to be performed on a voice command input by a user by the originating end device, so that a relay identifier is further analyzed. And then the target equipment list sent by the relay identification receiving server 600 is used for inquiring the receiving end equipment from the target equipment list according to the relay identification, and finally the data to be relayed is sent to the receiving end equipment, so that the data relay is realized.

Because the target device list sent by the receiving server 600 is obtained after the voice command input by the user is obtained, the real-time performance of the receiving terminal device is poor and the efficiency is low; the real-time performance of the data relay is poor, and the efficiency is low.

In some embodiments, after the receiving end device identifier is parsed, it is required to determine whether the receiving end device corresponding to the receiving end device identifier has the data relay capability; if the receiving end equipment has the data relay capability, the data relay can be realized, otherwise, the data relay cannot be realized. For example, if the to-be-relayed data is video data, it needs to be determined whether the receiving end device has the capability of playing the video data, and if the receiving end device has the capability of playing the video data, after receiving the to-be-relayed data, the to-be-relayed data is played, so as to realize the data relay.

In some embodiments, the data generally includes two data types. One type of data is online data, and the other type is local data. Wherein, the online data refers to data stored in the server 600, and the local data refers to data stored in the initiator device. Assuming that there is no network transmission between the application installed on the initiator device and the server 600, the data running the application, i.e., the data residing in the initiator device, is local data.

For example, for content data of a certain video, the online data is content data of the video stored in the internet; the local data is content data of the video stored in a memory of the originating device.

In some embodiments, the receiving end device cannot play the data to be relayed due to the data type of the data to be relayed, so that the problem of data relay failure occurs. For example, if the data type of the data to be relayed is online data, the receiving end device is the speaker device 500, and it is assumed that the speaker device 500 cannot play the online data and only can play the local data, so that the speaker device 500 cannot play the data to be relayed, resulting in failure of data relay; the accuracy of realizing data relay is lower.

In order to improve the real-time performance, efficiency and accuracy of the data relay, a flow diagram of a data relay method is provided in some embodiments, as shown in fig. 5, and the method may be applied to a terminal device performing the data relay method.

The method comprises the following steps:

acquiring a switching instruction input by a user based on an application page; the switching instruction is triggered when a user switches the application page.

For example, a user installs an application R1 on the display device 200, the application R1 including an application page R1 (e.g., a video playback page), an application page R2 (e.g., an audio playback page), and an application page R3 (e.g., a picture playback page); the application function corresponding to the application page r1 is video playing, the application function corresponding to the application page r2 is audio playing, and the application function corresponding to the application page r3 is picture displaying.

FIG. 6 illustrates a schematic diagram of a page switch, as shown in FIG. 6, where at a first moment in time, the user views a video on application page r1, the video content being "X1"; at a second moment, switching the application page r1 to the application page r2, wherein the content displayed in the application page r2 is X2; at this time, a switching instruction of the application page is triggered. Wherein the first time is earlier than the second time.

After acquiring the switching instruction, the initiating terminal equipment responds to the switching instruction to detect an application identifier, a page identifier and a target function identifier corresponding to the current application page; the target function identifier is an identifier of an application function used by the terminal equipment when acquiring the switching instruction.

Based on the above description, when the user switches from the application page R1 to the application page R2, the switching instruction k1 is triggered, the current application page corresponding to the switching instruction k1 is R2, the application identifier corresponding to the application page R2 is R1, the "R2" is the page identifier of the application page R2, the target function identifier is "R21", and the playing audio function is indicated.

In some embodiments, the initiator device detects the data type of the current play data, where "current" refers to the time when the terminal device acquires the switching instruction; and then selecting a target function identifier with a target function for playing the data from the registration file according to the data type.

The registration file is recorded with application information of each application installed on the initiating terminal equipment; the application information comprises application identifications, page identifications corresponding to the application identifications and function identifications corresponding to the page identifications aiming at any application.

In some embodiments, any application has a corresponding registry file, e.g., the registry file is "android manifiext. Xml" in the folder to which the application belongs, and only the application information of the application is recorded.

For example, the following are recorded in the registration file of the terminal device B: the terminal equipment B is provided with an application B1, and the application B1 is an application identifier; the application B1 comprises a video playing page and an audio playing page, wherein the page identifier of the video playing page is "B11", and the page identifier of the audio playing page is "B12"; the video playing page "b11" includes two functions, namely an online video playing function and a local video playing function, wherein the function of the online video playing function is identified as "b11f1", and the function of the local video playing function is identified as "b11f2"; the music play page "b12" includes a play online music function, the function of which is identified as "b12f1".

Based on the above description, the selection target function identification is exemplified; for example, when the user switches from the application page b12 to the application page b11, if the data type of the video played by the application page b11 is detected to be online data, the target function identifier is selected to be "b11f1", that is, the target function is the online video playing function; if the data type of the video played by the application page b11 is detected to be local data, the target function identifier is selected to be "b11f2", namely the target function is the local video playing function.

After the target function identifier is obtained, relay information of the initiating terminal equipment is called, and whether the target function identifier is a function identifier with relay capability is determined.

In some embodiments, if the target function identifier is queried to be recorded in the relay information, the target function identifier is indicated to be a function identifier with data relay capability; namely, the application function corresponding to the target function identifier has data relay capability. If the target function identifier is inquired not to be recorded in the relay information, the target function identifier is a function identifier without data relay capability; i.e. the application function corresponding to the target function identification does not have data relay capability. The relay information of the initiating terminal equipment is generated by reading the registration file of the initiating terminal equipment after the initiating terminal equipment is started.

Based on the description of the registration file, the relay information is generated as follows:

after reading the registration files of each application, the terminal equipment acquires a registration instruction sent by a user; the registration instruction is used for registering the function identification mark with the identification; the registration identifier is used for indicating that the application function corresponding to the function identifier has relay capability; the function identifier is then marked according to the registration instruction.

In some embodiments, the registration instructions may also be used to tag the application page with a registration identifier; for indicating that each function in the application page has relay capability.

In some embodiments, the registration instructions may also be used to register the identification with the application tag; each function used for representing each application page in the application has relay capability.

For example, based on the above description, when the terminal device B receives that the registration instruction sent by the user includes the function identifier (e.g., "B11f 1"), the terminal device B marks the "B11f1" with the registration identifier (e.g., "meta-data") according to the registration instruction, that is, indicates that "B11f1" (play online video function) has the relay capability.

As shown in table 1 below.

TABLE 1

Wherein "B" represents a device identity, e.g. "B" represents a terminal device B; "B1" means an application identification, e.g. "B1" means an application B1; "B11", "B12" represent page identifications, e.g. "B11" represents a video play page of application B1; "B11f1", "B11f2", "B12f1" indicate function identifiers, e.g. "B11f1" indicates that the application function of the video playback page of the application B1 is to play online video.

After the registration file in the terminal equipment is read, detecting the equipment identification of the terminal equipment, and generating relay information of the terminal equipment according to the equipment identification, the application identification, the page identification and the function identification.

In some embodiments, the device identification may include a unique identification of the terminal device (e.g., ID:001 of the terminal device) and a media access control address (Media Access Control Address, MAC).

In some embodiments, before generating the relay information, the function identifier in the registration file is detected, and whether the registration file has the registration identifier is judged, so that the function identifier with the relay capability is queried. For example, based on the above description, detecting that "b11f1" has the registration flag "meta-data", and "b11f2" does not have the registration flag, it is determined that "b11f1" is the function flag having the relay capability.

And then generating relay information according to the equipment identifier, the application identifier, the page identifier and the function identifier with relay capability.

Based on the above table 1, the following table 2 exemplarily shows relay information of a terminal device B, as shown in the following table 2.

TABLE 2

The relay information of the terminal device B includes function identifiers "B11f1" and "B12f1", that is, the function of playing the online video and the online music of the application B has relay capability.

In some embodiments, when the registration instruction sent by the terminal device B to the user includes a page identifier (e.g., "B11"), the terminal device B marks "B11" with the registration identifier (e.g., "meta-data") according to the registration instruction, that is, indicates that each function in "B11" (video playing page) has relay capability.

Based on the above table 1, the following table 3 exemplarily shows relay information of a terminal device B, as shown in the following table 3.

TABLE 3 Table 3

The relay information of the terminal device B includes a page identifier "B11", that is, the online video playing function and the local video playing function in the video playing page B11 have relay capability.

After generating the relay information, the terminal device stores the relay information to the terminal device and/or uploads the relay information to the server 600.

In order to better describe the above relay information, table 4 below shows the relay information of a plurality of terminal apparatuses recorded in the server 600, as shown in table 4 below.

TABLE 4 Table 4

The description is given by way of example of terminal equipment "C"; wherein "C" represents a device identity, e.g. "C" represents a terminal device C; "C1", "C2" and "C3" represent application identifications, e.g. "C1" represents application C1; "C11", "C12", "C21", "C22" and "C31" represent page identifications, e.g. "C11" represents a video play page of application C1; "function-movie-online", "function-music-online", "function-movie-local", and "function-movie-local" indicate function identifiers, e.g. "function-movie-online" indicates that the application function of the video play page of application C1 is to play online video.

In some embodiments, the applications installed between any two terminal devices may be the same or different; for example, the application C3 installed on the terminal device C is identical to the application E1 installed on the terminal device E; the application C3 installed on the terminal device C is different from the application 1 installed on the terminal device D.

In some embodiments, the functional identification of different applications may be the same; for example, application C3 is not the same application as application E1, but application C3 has the same function identification "function-movie-local" as application E1; i.e. it means that audio data played on application C3 can be played by application E1.

Fig. 7 is a schematic diagram schematically illustrating a data relay, where, as shown in fig. 7, the terminal device C plays data (the data content is M1) by applying C3; after the terminal equipment C pushes the data to the terminal equipment E, the terminal equipment E plays the data by using the application E1; the application C3 and the application E1 are different applications, but the application C3 and the application E1 have the same video online playing function.

In some embodiments, when the initiator device queries whether the target function identifier is recorded in the relay information, the query may be performed according to the following steps:

S1, inquiring whether an application identifier corresponding to a current application page is recorded in relay information, if so, executing a step S2; otherwise, a prompt instruction for prompting that relay is unavailable is initiated.

S2, inquiring whether page identifiers corresponding to the current application page are recorded in relay information, and if yes, executing a step S3; otherwise, a prompt instruction for prompting that relay is unavailable is initiated.

S3, inquiring whether a target function identifier corresponding to the current application page is recorded in relay information, if so, indicating that data relay can be performed at the current moment; otherwise, a prompt instruction for prompting that relay is unavailable is initiated.

FIG. 8 is a schematic diagram of an exemplary hint instruction, wherein the hint instruction includes: "relay is currently unavailable".

In some embodiments, if the registration flag only marks the application page, when the originating device queries that the page identifier corresponding to the current application page is recorded in the relay information, the target function identifier indicating the current moment is an identifier that can perform data relay.

In some embodiments, if the registration flag only marks the application, when the originating device queries that the application identifier corresponding to the current application page is recorded in the relay information, the target function identifier indicating the current moment is an identifier that can perform data relay.

After determining that the target function identifier is an identifier capable of performing data relay, the initiator device sends a query instruction to the server 600; the query instruction comprises user binding information and a target function identifier of the terminal equipment; the server 600 stores therein relay information of each external terminal device.

After acquiring the query instruction, the server 600 queries the target device having the same user binding information and the target function identifier, generates a target device list, and feeds back the target device list to the initiator device.

For example, the initiator device is a terminal device B, the user binding information of the terminal device B is "001", and the external terminal devices queried by the server 600 based on the "001" include a terminal device C, a terminal device D and a terminal device E; i.e. terminal device B, terminal device C, terminal device D and terminal device E are all "001".

Based on the descriptions of tables 1 to 4, if the target function identifier is "b11f1", and if "b11f1" and "function-movie-online" are the same function identifiers, the target devices selected by the server 600 are the terminal device C and the terminal device D, and thus the target device list is generated.

After receiving the target equipment list, the initiating terminal equipment acquires a voice command input by a user, and performs semantic analysis on the voice command to obtain a relay command.

In some embodiments, the user sends the voice command to the voice server 600 by sending the voice command to the originating device, and receives the relay command fed back by the voice server 600 based on the voice command, so as to obtain the relay command.

For example, the user sends a voice command to the originating device B, and after the originating device B acquires the voice command, the originating device B sends the voice command to the voice server 600, and the voice server 600 converts the voice command into text information, that is, the text information is a relay command. And feeds back the relay command to the initiator device B.

Fig. 9 schematically illustrates a method for generating a relay command, as shown in fig. 9, where a voice command is sent to a voice server 600, and a relay command fed back by the voice server 600 is received.

In some embodiments, a user sends a voice command to an initiating terminal device, and voice service in the initiating terminal device performs semantic analysis on the voice command to obtain text information; then extracting a relay identifier from the text information; and generating a relay command according to the relay identifier.

For example, the user sends a voice command to the initiator device B, where the voice command is: "refrigerator relay to kitchen". After the initiating terminal equipment B acquires the voice instruction, the voice instruction is subjected to semantic analysis by voice service of the initiating terminal equipment B to obtain text information. Then extracting a relay identifier from the text information, namely, the relay identifier is a refrigerator, and generating a relay instruction according to the refrigerator.

After generating the relay command, the initiator device makes a query in the target device list. That is, for any target device, if the identifier of the target device is the same as the relay identifier of the relay command, the target device is set as the receiving end device.

Based on the above description, for example, assume that terminal device C is a refrigerator and terminal device D is a television, because the relay identifier is "refrigerator", and terminal device C is determined as the receiving end device.

In some embodiments, if the receiving end device is not selected in the target device list, a prompting instruction for prompting that the relay is unavailable as shown in fig. 6 is initiated.

After the initiating terminal equipment determines the receiving terminal equipment, the initiating terminal equipment sends the data to be relayed to the receiving terminal equipment so that the receiving terminal equipment plays the data to be relayed.

If the receiving end equipment successfully receives the data to be relayed and successfully plays the data to be relayed, the receiving end equipment sends a relay result to the initiating end equipment and displays the relay result on a display screen of the receiving end equipment.

Fig. 10 schematically illustrates a relay result, as shown in fig. 10, where the relay result is "relay success".

In order to better illustrate the above technical solution, fig. 11 is a schematic flow diagram of data relay; as shown in fig. 11, the content includes:

s1110, triggering a switching instruction.

When a user switches an application page of an application on the initiating terminal device, a switching instruction is triggered.

For example, the initiator device B is provided with an application B1, where the application B1 includes an application page B1 (such as a video playing page) and an application page B2 (such as an audio playing page); when a user watches video on the application page b1 and switches the application page b1 to the application page b2, a switching instruction is triggered.

S1120, detecting the target function identification.

After acquiring the switching instruction, the initiating terminal equipment responds to the switching instruction to detect an application identifier, a page identifier and a target function identifier corresponding to the current application page.

Based on the above description, for example, it is detected that the application identifier corresponding to the current page (application page B2) is "B1", the page identifier is "B2", and then, according to the data type (such as online data) played on the current application page B2, it is determined that the function corresponding to the target function identifier is "B11f1" and the function corresponding to the B11f1 "is the online video playing function.

S1130, sending a query instruction.

After obtaining the target function identifier, the initiating terminal device inquires whether the relay information of the initiating terminal device has the target function identifier recorded therein, and if so, the initiating terminal device sends an inquiry instruction to the server. The query instruction comprises user binding information of the initiating terminal device and a target function identifier.

Otherwise, a prompt instruction for prompting that relay is unavailable is initiated.

S1140, feeding back a target device list.

After the server obtains the query instruction, the server queries the relay information of each external terminal device for the external terminal device with the user binding information and the target function identifier in the query instruction. And adding the external terminal equipment identifier with the user binding information and the target function identifier to the list to generate a target equipment list. The target device list is then sent to the originating device.

For example, the user binding information in the query instruction is Y1, and the external terminal device includes a terminal device C, a terminal device D, and a terminal device E, where the device identifiers are "C", "D", and "E", respectively; the user binding information of the terminal equipment C is Y1, the user binding information of the terminal equipment D is Y2, and the user binding information of the terminal equipment E is Y1; and determining that the user binding information of the terminal equipment C and the terminal equipment E is the same as the user binding information of the initiating terminal equipment.

Assuming that the functions of the terminal device C are identified as "b11f1" and "b11f2" (e.g., play a local video function), the functions of the terminal device E are identified as "b11f1" and "b12f1" (e.g., play an online music function); since both the terminal device C and the terminal device E have the target function identifier "b11f1", both the terminal device C and the terminal device E are selected as target devices.

The server adds the device identifiers of the terminal device C and the terminal device E to the list to generate a target device list. I.e. the target device list comprises "C" and "E".

S1150, generating a relay command.

The user sends a voice command to the initiating terminal equipment, and the initiating terminal equipment carries out semantic analysis on the voice command to obtain text information; then extracting a relay identifier from the text information; and generating a relay command according to the relay identifier.

For example, the user initiates a voice instruction to the initiator device B, where the voice instruction is: "relay to kitchen television". After the initiating terminal equipment B acquires the voice command, the voice command is subjected to semantic analysis to obtain text information. Then extracting a relay identifier from the text information, namely, the relay identifier is a television, and generating a relay instruction according to the television.

S1160, determining the receiving end equipment.

After generating the relay command, the initiator device determines the receiver device from the target device list.

For example, terminal equipment C and terminal equipment E are target equipment, wherein terminal equipment C is a "television", and terminal equipment E is a "refrigerator"; the relay instruction is that the relay identifier is "television", and thus the terminal device C is determined as the receiving end device.

S1170, sending data to be relayed.

After the initiating terminal equipment determines the receiving terminal equipment, transmitting data to be relayed to the receiving terminal equipment; so that the receiving end equipment plays the data to be relayed to realize the data relay.

According to the technical scheme, the target equipment list is received before the relay command is generated, namely, the server inquires the target equipment list which accords with the data relay capability before the voice command input by the user is acquired, so that the efficiency and the instantaneity of determining the receiving end equipment during the data relay are improved, namely, the instantaneity and the efficiency of the data relay are improved.

The target device list is selected by the server based on the target function identifier corresponding to the current application page of the terminal device, so that the target device in the target device list can be ensured to support the application function corresponding to the target function identifier, namely, the target device supports data relay. Therefore, the determined receiving end equipment can support data relay, namely, the accuracy that the receiving end equipment can realize the data relay is ensured. That is, the accuracy of the data relay is improved.

The above-provided detailed description is merely a few examples under the general inventive concept and does not limit the scope of the present application. Any other embodiments which are extended according to the solution of the application without inventive effort fall within the scope of protection of the application for a person skilled in the art.

Claims

1. A terminal device, comprising:

a controller coupled to the communicator, the controller configured to:

acquiring a switching instruction input by a user based on an application page;

invoking relay information of the terminal equipment, including: reading a registration file in the terminal equipment; the registration file records application information; the application information comprises an application identifier, a page identifier and a function identifier; detecting the equipment identifier of the terminal equipment, and generating relay information of the terminal equipment according to the equipment identifier, the application identifier, the page identifier and the function identifier; storing the relay information to the terminal equipment and/or uploading the relay information to the server;

If the target function identifier is inquired to be recorded in the relay information, the target function identifier is a function identifier with data relay capability, and a target equipment list fed back by the server based on the target function identifier is received;

if the target function identifier is inquired not to be recorded in the relay information, the target function identifier is a function identifier without data relay capability; the relay information is generated by reading a registration file of the terminal equipment after the terminal equipment is started;

generating a relay command according to a voice command input by a user;

2. The terminal device of claim 1, wherein the controller is further configured to:

detecting a registration identifier of the function identifier in the step of generating relay information of the terminal device according to the device identifier, the application identifier, the page identifier and the function identifier; the registration identifier is used for indicating that the application function corresponding to the function identifier has relay capability;

Inquiring a function identifier with relay capability according to the registration identifier;

and generating the relay information according to the equipment identifier, the application identifier, the page identifier and the function identifier with relay capability.

3. The terminal device of claim 2, wherein the controller is further configured to:

before detecting the registration identification of the function identification, acquiring a registration instruction sent by a user; the registration instruction is used for marking the registration identifier for the function identifier;

and marking the function identifier according to the registration instruction.

4. The terminal device of claim 1, wherein the controller is further configured to:

in the step of detecting the target function identifier corresponding to the current application page, detecting the data type of the play data of the terminal equipment when acquiring the switching instruction;

and selecting a target function identifier with a target function for playing the data according to the data type.

5. The terminal device of claim 1, wherein the controller is further configured to:

in the step of receiving a target equipment list fed back by the server based on the target function identifier, a query instruction is sent to the server; the query instruction comprises user binding information of the terminal equipment and the target function identifier;

Receiving a target equipment list fed back by the server based on the user binding information; and the target equipment list records target equipment identifiers with the user binding information and the target function identifiers.

6. The terminal device of claim 1, wherein the controller is further configured to:

in the step of generating a relay command based on a voice command input by a user, carrying out semantic analysis on the voice command to obtain text information;

extracting a relay identifier from the text information;

and generating a relay command according to the relay identifier.

7. The terminal device of claim 1, wherein the controller is further configured to:

according to the relay command, in the step of selecting the receiving end device from the target device list, if the identification of any target device is the same as the relay identification of the relay command, setting the target device as the receiving end device.

8. The terminal device of claim 7, wherein the controller is further configured to:

if the receiving end equipment is not selected from the target equipment list or the target function identification is inquired to be not recorded in the relay information, a prompt instruction for prompting that relay is not possible is initiated.

9. A data relay method, characterized in that the method is applied to a terminal device;

the method comprises the following steps:

acquiring a switching instruction input by a user based on an application page;

invoking relay information of the terminal equipment, including: reading a registration file in the terminal equipment; the registration file records application information; the application information comprises an application identifier, a page identifier and a function identifier; detecting the equipment identifier of the terminal equipment, and generating relay information of the terminal equipment according to the equipment identifier, the application identifier, the page identifier and the function identifier; storing the relay information to the terminal equipment and/or uploading the relay information to a server;

generating a relay command according to a voice command input by a user;