CN103997688B - intelligent interactive system, device and method - Google Patents

intelligent interactive system, device and method Download PDF

Info

Publication number
CN103997688B
CN103997688B CN201410174252.6A CN201410174252A CN103997688B CN 103997688 B CN103997688 B CN 103997688B CN 201410174252 A CN201410174252 A CN 201410174252A CN 103997688 B CN103997688 B CN 103997688B
Authority
CN
China
Prior art keywords
application
control signal
mobile terminal
display device
intelligent display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410174252.6A
Other languages
Chinese (zh)
Other versions
CN103997688A (en
Inventor
刘爽
何超
张超
李锋
李创奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiaomi Inc
Original Assignee
Xiaomi Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiaomi Inc filed Critical Xiaomi Inc
Priority to CN201410174252.6A priority Critical patent/CN103997688B/en
Publication of CN103997688A publication Critical patent/CN103997688A/en
Application granted granted Critical
Publication of CN103997688B publication Critical patent/CN103997688B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Mobile Radio Communication Systems (AREA)
  • Stored Programmes (AREA)

Abstract

The disclosure is directed to a kind of intelligent interactive system, device and method, belong to Internet technical field.The system comprises:Intelligent display device and the mobile terminal that there is communication connection with intelligent display device;Mobile terminal is configurable to generate the control signal corresponding to intelligent display device, and control signal is sent to intelligent display device;Intelligent display device is configured as executing corresponding control operation according to control signal;And/or intelligent display device, it is configured as obtaining at least one related information of present displayed content, and at least one related information is provided to mobile terminal by communication connection;Mobile terminal is configured to be shown according at least one related information;And/or mobile terminal, it is configured as receiving the interactive information that user is triggered for present displayed content in intelligent display device, interactive information is sent to intelligent display device;Intelligent display device is configured as executing corresponding interactive operation according to interactive information.

Description

Intelligent interaction system, device and method
Technical Field
The present disclosure relates to the field of internet technologies, and in particular, to an intelligent interactive system, an intelligent interactive device, and an intelligent interactive method.
Background
The intelligent television is an electronic device with a full-open platform, and as the intelligent operating system is carried, a user can install and uninstall various application programs by himself and can watch programs in a networking mode.
In the related art, a user may manipulate the smart tv through a remote controller or a mouse. For example, a user can realize basic operations such as channel tuning, volume adjustment, power on/off and the like through a remote controller; for another example, a user can open an application program installed in the smart television through a mouse, and perform operations such as information viewing, text input, information transceiving and the like; for another example, in the process of watching an online video, a user can control the smart television to display the video brief introduction, comment information, other video recommendation and other related information of the currently played video through a mouse or a remote controller.
In the process of implementing the present disclosure, the public finds that the above mode has at least the following defects: in the process of controlling the smart television through the remote controller or the mouse, the smart television is inevitably required to display a related control interface, and although the influence on the normal playing of the currently played content in the smart television can be avoided to a certain extent through a multi-screen display technology or a multi-region display technology, the normal display of the currently played content can still be influenced.
Disclosure of Invention
In order to solve the problem that in the related art, in the process of controlling the smart television through a remote controller or a mouse, a related control interface affects normal display of currently played content in the smart television, embodiments of the present disclosure provide an intelligent interaction system, an intelligent interaction device, and an intelligent interaction method. The technical scheme is as follows:
according to a first aspect of embodiments of the present disclosure, there is provided an intelligent interactive system, the system comprising: the mobile terminal comprises intelligent display equipment and a mobile terminal which is in communication connection with the intelligent display equipment;
the mobile terminal is configured to receive a physical trigger signal corresponding to any physical key in the mobile terminal, generate a control signal corresponding to the physical key according to the physical trigger signal, and send the control signal to the intelligent display device through the communication connection or in an infrared signal form, wherein the physical key is an existing entity key in the mobile terminal; the intelligent display device is configured to execute corresponding control operation according to the control signal; and/or the presence of a gas in the gas,
the mobile terminal is configured to acquire the installation state of any application in the intelligent display device, generating a control signal for application management according to the installation state, transmitting the control signal for application management to the smart display device through the communication connection or in the form of an infrared signal, wherein the signal for control management of application management includes any one of a control signal for application installation, a control signal for application update, and a control signal for application uninstallation, the control signal for application installation includes an application identification of the application or a download address of the application, the control signal for application update comprises an application identification of the application or an update package download address of the application, and the control signal for application uninstallation comprises an application identification of the application; the intelligent display device is configured to install the application according to the control signal for application installation when the control signal for application installation is received, or update the application according to the control signal for application update when the control signal for application update is received, or uninstall the application according to the control signal for application uninstall when the control signal for application uninstall is received;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback is sent in response to a broadcast inquiry sent by the intelligent display device to the mobile terminal in the same local area network.
In one embodiment, the mobile terminal is configured to display an installation control in a first predetermined area when the installation state is not installed, receive a first trigger signal acting on the installation control, generate a control signal for application installation according to the first trigger signal, and send the control signal for application installation to the smart display device; the intelligent display device is configured to download and install the application according to the control signal for application installation;
or,
the mobile terminal is configured to display an update control in a second predetermined area when the installation state is installed and needs to be updated, receive a second trigger signal acting on the update control, generate a control signal for application update according to the second trigger signal, and send the control signal for application update to the intelligent display device; the intelligent display device is configured to download and update the application according to the control signal for application update;
or,
the mobile terminal is configured to display an uninstalling control in a third predetermined area when the installation state is installed and needs to be updated or installed and does not need to be updated, receive a third trigger signal acting on the uninstalling control, generate a control signal for uninstalling an application according to the third trigger signal, and send the control signal for uninstalling the application to the intelligent display device; the intelligent display device is configured to uninstall the application according to the control signal for application uninstallation.
In one embodiment of the present invention,
the mobile terminal is further configured to acquire broadcast information sent outwards by the intelligent display devices in the same local area network at preset time intervals; sending a broadcast query to the intelligent display devices on the same local area network; receiving a feedback response sent by the intelligent display device for the broadcast query; after the intelligent display equipment which can be connected at present is determined according to the broadcast information and the feedback response, a connection request is sent to the intelligent display equipment; correspondingly, the intelligent display device is also configured to send broadcast information outwards at preset time intervals; acquiring a broadcast query sent by the mobile terminal in the same local area network, and sending a feedback response aiming at the broadcast query to the mobile terminal; receiving a connection request sent by the mobile terminal, wherein the connection request is sent after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; and establishing the communication connection with the mobile terminal according to the connection request.
According to a second aspect of the embodiments of the present disclosure, there is provided an intelligent interaction apparatus, for use in a mobile terminal having a communication connection with an intelligent display device, the apparatus including: a device control module;
the device control module is configured to receive a physical trigger signal corresponding to any physical key in the mobile terminal, generate a control signal corresponding to the physical key according to the physical trigger signal, and send the control signal to the intelligent display device through the communication connection or in the form of an infrared signal, wherein the intelligent display device is configured to execute corresponding control operation according to the control signal, and the physical key is an existing physical key in the mobile terminal; or,
the device control module is configured to acquire an installation state of any application in the smart display device, generate a control signal for application management according to the installation state, and send the control signal for application management to the smart display device through the communication connection or in the form of an infrared signal, wherein the signal for control management of application management includes any one of a control signal for application installation, a control signal for application update, and a control signal for application uninstallation, and the smart display device is configured to install the application according to the control signal for application installation when the control signal for application installation is received, or update the application according to the control signal for application update when the control signal for application update is received, or when the control signal for application uninstalling is received, uninstalling the application according to the control signal for application uninstalling, wherein the control signal for application installation includes an application identifier of the application or a download address of the application, the control signal for application update includes an application identifier of the application or an update package download address of the application, and the control signal for application uninstalling includes an application identifier of the application;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback is sent in response to a broadcast inquiry sent by the intelligent display device to the mobile terminal in the same local area network.
According to a third aspect of the embodiments of the present disclosure, there is provided an intelligent interaction apparatus, for use in an intelligent display device having a communication connection with a mobile terminal, the apparatus including: a control response module;
the control response module is configured to receive a control signal sent by the mobile terminal through the communication connection or in the form of an infrared signal, and execute corresponding control operation according to the control signal; the control signal is generated after the mobile terminal receives a physical trigger signal corresponding to any physical key, wherein the physical key is an existing entity key in the mobile terminal; or,
the control response module is configured to receive a control signal for application management sent by the mobile terminal through the communication connection or in the form of an infrared signal, install the application according to the control signal for application installation if the control signal for application management is a control signal for application installation, update the application according to the control signal for application update if the control signal for application management is a control signal for application update, and uninstall the application according to the control signal for application uninstall if the control signal for application management is a control signal for application uninstall, wherein the control signal for application installation includes an application identifier of the application or a download address of the application, and the control signal for application update includes an application identifier of the application or an update package download address of the application The control signal for application uninstallation comprises an application identifier of the application, and the control signal for application management is generated according to an installation state of any application in the intelligent display device after the control signal for application management is acquired by the mobile terminal;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback is sent in response to a broadcast inquiry sent by the intelligent display device to the mobile terminal in the same local area network.
According to a fourth aspect of the embodiments of the present disclosure, there is provided an intelligent interaction apparatus, for use in a mobile terminal having a communication connection with an intelligent display device, the apparatus including:
a processor;
a memory for storing executable instructions of the processor;
wherein the processor is configured to:
receiving a physical trigger signal corresponding to any physical key in the mobile terminal, generating a control signal corresponding to the physical key according to the physical trigger signal, and sending the control signal to the intelligent display device through the communication connection or in an infrared signal form, wherein the intelligent display device is configured to execute corresponding control operation according to the control signal, and the physical key is an existing entity key in the mobile terminal;
and/or the presence of a gas in the gas,
for any application, acquiring an installation state of the application in the smart display device, generating a control signal for application management according to the installation state, and transmitting the control signal for application management to the smart display device through the communication connection or in the form of an infrared signal, wherein the signal for control management for application management includes any one of a control signal for application installation, a control signal for application update, and a control signal for application uninstallation, the smart display device is configured to install the application according to the control signal for application installation when the control signal for application installation is received, or update the application according to the control signal for application update when the control signal for application update is received, or, when the control signal for application uninstalling is received, uninstalling the application according to the control signal for application uninstalling, where the control signal for application installation includes an application identifier of the application or a download address of the application, the control signal for application update includes an application identifier of the application or an update package download address of the application, and the control signal for application uninstalling includes an application identifier of the application;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback is sent in response to a broadcast inquiry sent by the intelligent display device to the mobile terminal in the same local area network.
According to a fifth aspect of the embodiments of the present disclosure, there is provided an intelligent interaction apparatus, for use in an intelligent display device having a communication connection with a mobile terminal, the apparatus including:
a processor;
a memory for storing executable instructions of the processor;
wherein the processor is configured to:
receiving a control signal sent by the mobile terminal through the communication connection or in an infrared signal form, and executing corresponding control operation according to the control signal; the control signal is generated after the mobile terminal receives a physical trigger signal corresponding to any physical key, wherein the physical key is an existing entity key in the mobile terminal;
and/or the presence of a gas in the gas,
receiving a control signal for application management sent by the mobile terminal through the communication connection or in the form of an infrared signal, if the control signal for application management is a control signal for application installation, installing the application according to the control signal for application installation, if the control signal for application management is a control signal for application update, updating the application according to the control signal for application update, if the control signal for application management is a control signal for application uninstallation, uninstalling the application according to the control signal for application uninstallation, wherein the control signal for application installation includes an application identifier of the application or a download address of the application, and the control signal for application update includes an application identifier of the application or an update package download address of the application, the control signal for application uninstalling comprises an application identifier of the application, and the control signal for application management is generated according to an installation state of the application in the intelligent display device after the control signal for application management is acquired by the mobile terminal;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback is sent in response to a broadcast inquiry sent by the intelligent display device to the mobile terminal in the same local area network.
According to a sixth aspect of the embodiments of the present disclosure, there is provided an intelligent interaction method, used in a mobile terminal having a communication connection with an intelligent display device, the method including:
receiving a physical trigger signal corresponding to any physical key in the mobile terminal, generating a control signal corresponding to the physical key, and sending the control signal to the intelligent display device through the communication connection or in an infrared signal form, wherein the intelligent display device is configured to execute corresponding control operation according to the control signal, and the physical key is an existing entity key in the mobile terminal;
and/or the presence of a gas in the gas,
for any application, acquiring an installation state of the application in the smart display device, generating a control signal for application management according to the installation state, and transmitting the control signal for application management to the smart display device through the communication connection or in the form of an infrared signal, wherein the signal for control management for application management includes any one of a control signal for application installation, a control signal for application update, and a control signal for application uninstallation, the smart display device is configured to install the application according to the control signal for application installation when the control signal for application installation is received, or update the application according to the control signal for application update when the control signal for application update is received, or, when the control signal for application uninstalling is received, uninstalling the application according to the control signal for application uninstalling, wherein the control signal for application installation includes an application identifier of the application or a download address of the application, the control signal for application update includes an application identifier of the application or an update package download address of the application, and the control signal for application uninstalling includes an application identifier of the application;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback is sent in response to a broadcast inquiry sent by the intelligent display device to the mobile terminal in the same local area network.
In one embodiment, the generating a control signal for application management according to the installation state includes:
when the installation state is not installed, displaying an installation control in a first preset area, receiving a first trigger signal acting on the installation control, and generating a control signal for application installation according to the first trigger signal, wherein the control signal for application installation is used for triggering the mobile terminal to download and install the application;
or,
when the installation state is installed and needs to be updated, displaying an update control in a second preset area, receiving a second trigger signal acting on the update control, and generating a control signal for updating an application according to the second trigger signal, wherein the control signal for updating the application is used for triggering the mobile terminal to download and update the application;
or,
when the installation state is installed and needs updating or installed and does not need updating, displaying an uninstalling control in a third preset area, receiving a third trigger signal acting on the uninstalling control, and generating a control signal for uninstalling an application according to the third trigger signal, wherein the control signal for uninstalling the application is used for triggering the mobile terminal to uninstall the application.
In one embodiment, the method further comprises:
acquiring broadcasting information sent outwards by the intelligent display equipment in the same local area network at preset time intervals; sending a broadcast query to the intelligent display devices in the same local area network; receiving a feedback response sent by the intelligent display device for the broadcast query; and after the intelligent display equipment which can be connected at present is determined according to the broadcast information and the feedback response, sending a connection request to the intelligent display equipment, wherein the intelligent display equipment is configured to establish the communication connection with the mobile terminal according to the connection request.
According to a seventh aspect of the embodiments of the present disclosure, there is provided an intelligent interaction method, used in an intelligent display device having a communication connection with a mobile terminal, the method including:
receiving a control signal sent by the mobile terminal through the communication connection or in the form of an infrared signal, and executing corresponding control operation according to the control signal, wherein the control signal is generated after the mobile terminal receives a physical trigger signal corresponding to any physical key, and the physical key is an existing entity key in the mobile terminal;
and/or the presence of a gas in the gas,
receiving a control signal for application management sent by the mobile terminal through the communication connection or in the form of an infrared signal, if the control signal for application management is a control signal for application installation, installing the application according to the control signal for application installation, if the control signal for application management is a control signal for application update, updating the application according to the control signal for application update, if the control signal for application management is a control signal for application uninstallation, uninstalling the application according to the control signal for application uninstallation, wherein the control signal for application installation includes an application identifier of the application or a download address of the application, and the control signal for application update includes an application identifier of the application or an update package download address of the application, the control signal for application uninstalling comprises an application identifier of the application, and the control signal for application management is generated according to an installation state of the application in the intelligent display device after the control signal for application management is acquired by the mobile terminal;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback is sent in response to a broadcast inquiry sent by the intelligent display device to the mobile terminal in the same local area network.
In one embodiment, the managing the application according to the control signal for application management includes:
when the control signal for application management is a control signal for application installation, downloading and installing the application according to the control signal for application installation; the control signal for application installation is generated by displaying an installation control in a first preset area, receiving a first trigger signal acting on the installation control and generating according to the first trigger signal when the mobile terminal acquires that the installation state is not installed;
or,
when the control signal for application management is a control signal for application update, downloading and updating the application according to the control signal for application update; when the mobile terminal acquires that the installation state is installed and needs to be updated, displaying an update control in a second preset area, receiving a second trigger signal acting on the update control, and generating the control signal for application update according to the second trigger signal;
or
When the control signal for application management is a control signal for application uninstallation, uninstalling the application according to the control signal for application uninstallation; when the mobile terminal acquires that the installation state is installed and needs updating or installed and does not need updating, the control signal for application uninstallation is generated by displaying an uninstalling control in a third preset area, receiving a third trigger signal acting on the uninstalling control and generating the third trigger signal according to the third trigger signal.
In one embodiment, the method further comprises:
sending broadcast information outwards at preset time intervals; acquiring a broadcast query sent by the mobile terminal in the same local area network, and sending a feedback response aiming at the broadcast query to the mobile terminal; receiving a connection request sent by the mobile terminal, wherein the connection request is sent after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; and establishing the communication connection with the mobile terminal according to the connection request.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
introducing a mobile terminal which is in communication connection with the intelligent display device; on the first aspect, a control signal is generated through a mobile terminal to control an intelligent display device to execute corresponding control operation; in the second aspect, at least one item of associated information of currently displayed content in the intelligent display equipment is obtained through the mobile terminal, and the associated information is displayed; in the third aspect, interactive information triggered by a user aiming at the current display content is sent to the intelligent display equipment through the mobile terminal, so that the intelligent display equipment executes corresponding interactive operation according to the interactive information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the intelligent display equipment is controlled through the mobile terminal, so that a related control interface can be displayed on the mobile terminal side, and the influence of the related control interface on the normal display of the current display content in the intelligent display equipment is avoided; in addition, the associated information in the intelligent display equipment is shared and displayed through the mobile terminal, so that the influence of the associated information on the normal display of the current display content in the intelligent display equipment is avoided, and the convenience for a user to check the associated information is improved; in addition, the mobile terminal is used as a medium, and the human-computer interaction experience between the user and the intelligent display equipment is enriched.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, are configured to explain the principles of the disclosure.
FIG. 1 is a schematic block diagram of an implementation environment to which various embodiments of the present disclosure relate;
FIG. 2 is a block diagram illustrating the architecture of an intelligent interactive system, according to an exemplary embodiment;
FIG. 3A is a block diagram illustrating the architecture of an intelligent interactive system, according to another exemplary embodiment;
FIG. 3B is a schematic diagram of a connection interface when the smart display device establishes a communication connection with the mobile terminal;
FIG. 3C is a diagram illustrating a mobile terminal in accordance with an exemplary embodiment;
FIG. 3D is a schematic view of an interface of the mobile terminal when the installed state is uninstalled;
FIG. 3E is a schematic view of the interface of the mobile terminal when the installation state is installed;
FIG. 4A is a block diagram illustrating the architecture of an intelligent interactive system, according to yet another illustrative embodiment;
FIG. 4B is a schematic diagram of the interface on the smart display device side;
fig. 4C is an interface diagram at the mobile terminal side;
FIG. 5 is a block diagram illustrating the architecture of an intelligent interactive system, according to yet another exemplary embodiment;
FIG. 6 is a block diagram illustrating an intelligent interaction device, according to an example embodiment;
FIG. 7 is a block diagram illustrating an intelligent interaction device, according to another example embodiment;
FIG. 8 is a block diagram illustrating an intelligent interactive system, according to an exemplary embodiment;
9A/9B/9C are flowcharts illustrating a method of intelligent interaction according to an exemplary embodiment;
FIG. 10 is a flow chart illustrating a method of intelligent interaction in accordance with another illustrative embodiment;
FIG. 11 is a flowchart illustrating a method of intelligent interaction in accordance with yet another illustrative embodiment;
FIG. 12 is a flowchart illustrating a method of intelligent interaction in accordance with yet another illustrative embodiment;
FIG. 13 is a block diagram illustrating an apparatus for intelligent interaction in accordance with an exemplary embodiment;
FIG. 14 is a block diagram illustrating an apparatus for intelligent interaction in accordance with another illustrative embodiment.
With the foregoing drawings in mind, certain embodiments of the disclosure have been shown and described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
Fig. 1 is a schematic diagram of an implementation environment according to various embodiments of the present disclosure. The implementation environment includes a smart display device 120 and a mobile terminal 140.
The smart display device 120 may be a smart television, a television box, or a combination of both.
The smart display device 120 and the mobile terminal 140 may be connected via a wireless network.
The mobile terminal 140 may be a mobile phone, a tablet computer, an e-book reader, an MP3 player (Moving picture Experts Group Audio Layer III, motion picture Experts Group Audio Layer 3), an MP4 player (Moving picture Experts Group Audio Layer IV, motion picture Experts Group Audio Layer 4), a laptop computer, or the like.
Fig. 2 is a block diagram illustrating an architecture of an intelligent interactive system according to an exemplary embodiment, the intelligent interactive system including: a smart display device 220, and a mobile terminal 240 in communicative connection with the smart display device 220.
A mobile terminal 240 configured to generate a control signal corresponding to the smart display device 220, and transmit the control signal to the smart display device 220; and a smart display device 220 configured to perform a corresponding control operation according to the control signal. And/or the presence of a gas in the gas,
the intelligent display device 220 is configured to acquire at least one item of associated information of the current display content and provide the at least one item of associated information to the mobile terminal 240 through the communication connection; and the mobile terminal 240 is configured to acquire at least one item of associated information of currently displayed content in the intelligent display device 220 through the communication connection, and display the associated information according to the at least one item of associated information. And/or the presence of a gas in the gas,
the mobile terminal 240 is configured to receive interaction information triggered by a user for current display content in the intelligent display device 220, and send the interaction information to the intelligent display device 220; and the intelligent display device 220 is configured to perform corresponding interactive operation according to the interactive information.
In summary, the intelligent interactive system provided in this embodiment introduces the mobile terminal in communication connection with the intelligent display device; on the first aspect, a control signal is generated through a mobile terminal to control an intelligent display device to execute corresponding control operation; in the second aspect, at least one item of associated information of currently displayed content in the intelligent display equipment is obtained through the mobile terminal, and the associated information is displayed; in the third aspect, interactive information triggered by a user aiming at the current display content is sent to the intelligent display equipment through the mobile terminal, so that the intelligent display equipment executes corresponding interactive operation according to the interactive information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the mobile terminal is used for controlling the intelligent display equipment, so that a related control interface can be displayed on the mobile terminal side, and the influence of the mobile terminal on the normal display of the current display content in the intelligent display equipment is avoided; in addition, the mobile terminal is used for sharing and displaying the associated information in the intelligent display equipment, so that the influence of the associated information on the normal display of the current display content in the intelligent display equipment is avoided, and the convenience for a user to check the associated information is improved; in addition, the mobile terminal is used as a medium, and the human-computer interaction experience between the user and the intelligent display equipment is enriched.
In the following, the three intelligent interaction schemes provided by the present disclosure will be described and explained in detail by the three embodiments shown in fig. 3A, fig. 4A and fig. 5, respectively. The embodiment shown in fig. 3A specifically describes an interaction scheme for a user to control an intelligent display device through a mobile terminal, including basic controls such as tuning, volume adjustment, and power on/off, and also including a control for managing applications in the intelligent display device. The embodiment shown in fig. 4A will specifically describe an interaction scheme for a user to view the associated information of the currently displayed content in the intelligent display device through the mobile terminal. Fig. 5 specifically introduces a scheme in which a user performs human-computer interaction with an intelligent display device through a mobile terminal, and the scheme is embodied in the aspects of real-time comment on currently displayed content in the intelligent display device, screen capture, social interaction with other users, and the like.
Fig. 3A is a block diagram illustrating a structure of an intelligent interactive system according to another exemplary embodiment, the intelligent interactive system including: a smart display device 320, and a mobile terminal 340 in communicative connection with the smart display device 320. In addition, the intelligent interactive system may further include a server 360 connected to the intelligent display device 320 and the mobile terminal 340 through a wireless network, respectively.
The intelligent display device 320 and the mobile terminal 340 may establish a communication connection through three possible implementation manners:
in a first possible implementation: the mobile terminal 340 is configured to acquire broadcast information sent out by the intelligent display devices 320 in the same local area network at preset time intervals; after determining the smart display device that can be currently connected according to the broadcast information, a connection request is sent to the smart display device 320. Correspondingly, the smart display device 320 is configured to send broadcast information outwards at predetermined time intervals; receiving a connection request sent by a mobile terminal 340 in the same local area network, wherein the connection request is sent after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information; a communication connection is established with the mobile terminal 340 according to the connection request.
After the intelligent display device 320 is started and accessed to the local area network, broadcast information is sent out at preset time intervals, which indicates that the intelligent display device can accept the connection of the mobile terminal 340 in the local area network. Wherein the predetermined time interval is preset by a technician, such as 1 minute, 30 seconds, or 5 seconds, etc. The broadcast information includes information such as a device name, an IP (internet protocol, protocol for interconnection between networks) address and/or a MAC (Medium/Media Access Control) address of the smart display device 320, and a port number. Meanwhile, the smart display device 320 also needs to monitor a TCP (transmission control Protocol) port to wait for the connection of the mobile terminal 340.
The mobile terminal 340 in the same lan as the smart display device 320 receives the broadcast information sent by the smart display device 320, and displays the device name of the corresponding smart display device to inform the user which smart display devices can be connected.
It should be noted that the mobile terminal 340 can obtain broadcast information sent by a plurality of intelligent display devices in the same local area network, display the device names according to the device names carried in the broadcast information, and select an intelligent display device to be connected from the device names. Please refer to fig. 3B, which is a schematic diagram of the connection interface 30 when the smart display device 320 establishes a communication connection with the mobile terminal 340. The mobile terminal 340 obtains the broadcast information sent by the device 1, the device 2, the device 3, and the device 4, and displays the names of the four devices. Assuming that the user needs the mobile terminal 340 to establish a communication connection with the device 1, the user clicks the "device 1".
Thereafter, the mobile terminal 340 transmits a connection request to "device 1". Wherein the connection request is used to establish a communication connection with the smart display device 320. After the user selects an intelligent display device to be connected, the mobile terminal 340 sends a connection request to the intelligent display device 320 according to the broadcast information, and requests to establish a TCP connection with the intelligent display device 320. Correspondingly, the smart display device 320 may receive the connection request sent by the mobile terminal 340 through the listening TCP port, and then establish a communication connection, that is, a TCP connection, with the mobile terminal 340.
In a second possible implementation: a mobile terminal 340 configured to transmit a broadcast query to the smart display devices 320 in the same local area network; receiving a feedback response sent by smart display device 320 for the broadcast query; and after determining that the intelligent display device can be connected currently according to the feedback response, sending a connection request to the intelligent display device 320. Correspondingly, the smart display device 320 is configured to obtain the broadcast query sent by the mobile terminal 340 in the same local area network, and send a feedback response to the broadcast query to the mobile terminal 340; receiving a connection request sent by the mobile terminal 340 after determining that the intelligent display device can be connected currently according to the feedback response; a communication connection is established with the mobile terminal 340 according to the connection request.
The mobile terminal 340 sends a broadcast query to at least one intelligent display device in the same local area network, where the broadcast query carries identification information, and after receiving the broadcast query sent by the mobile terminal 340, the intelligent display device 320 may determine whether to establish a communication connection with the mobile terminal 340 according to the identification information.
It should be noted that the smart display device 320 may obtain broadcast queries sent by multiple mobile terminals in the same local area network, and may determine one or more mobile terminals that can establish a communication connection according to the identification information carried in each broadcast query.
When the smart display device 320 determines to establish a communication connection with the mobile terminal 340, a feedback response is sent to the mobile terminal 340. After receiving the feedback response sent by the smart display device 320, the mobile terminal 340 may know that the smart display device 320 is connectable. The feedback response may include information such as a device name, an IP (internet protocol) address and/or a Media Access Control (MAC) address of the smart display device 320, and a port number.
Then, the mobile terminal 340 determines the currently connectable intelligent display device according to the feedback response, and displays a list of the currently connectable intelligent display devices, where the list includes a device name of at least one connectable intelligent display device. After the user selects the smart display device 320 that needs to be connected from the list, the mobile terminal 340 sends a connection request to the smart display device 320. Correspondingly, the smart display device 320 establishes a communication connection, i.e., a TCP connection, with the mobile terminal 340 according to the connection request.
In a third possible implementation: the mobile terminal 340 is configured to acquire broadcast information sent out by the intelligent display devices 320 in the same local area network at preset time intervals; sending a broadcast query to smart display devices 320 on the same local area network; receiving a feedback response sent by smart display device 320 for the broadcast query; and after determining that the intelligent display device can be connected currently according to the broadcast information and the feedback response, sending a connection request to the intelligent display device 320. Correspondingly, the smart display device 320 is configured to send broadcast information outwards at predetermined time intervals; acquiring a broadcast query sent by a mobile terminal 340 in the same local area network, and sending a feedback response aiming at the broadcast query to the mobile terminal 340; receiving a connection request sent by the mobile terminal 340, wherein the connection request is sent after the mobile terminal 340 determines the current connectable intelligent display device according to the broadcast information and the feedback response; a communication connection is established with the mobile terminal 340 according to the connection request.
Unlike the first two possible implementations: after acquiring broadcast information sent out by one or more intelligent display devices in the same local area network, the mobile terminal 340 obtains a list 1 of the intelligent display devices that can be currently connected; after receiving a feedback response sent by one or more intelligent display devices to the broadcast query, the mobile terminal 340 obtains an intelligent display device list 2 that can be currently connected; the mobile terminal 340 integrates the currently connectable intelligent display device list 1 and the currently connectable intelligent display device list 2 to obtain an intersection of the two, that is, the currently connectable intelligent display device list 3. Thereafter, the mobile terminal 340 displays the list 3 of the currently connectable smart display devices, and the user selects the smart display device 320 that needs to be connected from the list, and sends a connection request to the smart display device 320.
Compared with the first two possible implementation manners, the third possible implementation manner can reduce the phenomenon that the mobile terminal 340 cannot be connected to the intelligent display device due to the fact that the discovered connectable intelligent display device is disconnected or quitted due to other reasons in the process that the mobile terminal 340 finds the connectable intelligent display device, and improve the connection success rate.
In addition, in other possible embodiments, when the mobile terminal 340 only has one connectable smart display device obtained by any one of the three manners, the mobile terminal 340 may not need to inform the user of the connectable smart display device, and may directly establish a communication connection with the connectable smart display device, so as to simplify the user operation.
In the following, an interaction scheme for a user to control the smart display device 320 through the mobile terminal 340 is specifically described, which includes basic controls such as tuning, volume adjustment, power on/off, and also includes a control for managing applications in the smart display device 320.
And the mobile terminal 340 is configured to generate a control signal corresponding to the intelligent display device 320 and transmit the control signal to the intelligent display device 320.
The control signal is generated by the mobile terminal 340 after receiving a trigger signal corresponding to any physical key or virtual key of the user. When a user triggers any physical key, the mobile terminal 340 is configured to receive a physical trigger signal corresponding to any physical key in the mobile terminal 340, and generate a control signal corresponding to the physical key according to the physical trigger signal; when the user triggers any virtual key, the mobile terminal 340 is configured to receive a virtual trigger signal corresponding to any virtual key in the mobile terminal 340, and generate a control signal corresponding to the virtual key according to the virtual trigger signal.
The physical keys refer to existing physical keys in the mobile terminal 340, such as a physical keyboard, a volume adjustment key, a volume on/off key, a Home key, and the like. Please refer to fig. 3C in combination, which shows a schematic diagram of a mobile terminal 340 according to the present embodiment, where the physical keys disposed in the mobile terminal 340 include: volume adjustment keys 31 (including a volume up key and a volume down key), volume on/off keys 32 (including on/off), and Home key 33.
The user presses or adjusts any physical key in the mobile terminal 340 while listening to or viewing the content played in the smart display device 320. For example, pressing the volume adjustment key 31, adjusting the volume on key 32, pressing the Home key 33, and so on. Correspondingly, the mobile terminal 340 receives a physical trigger signal corresponding to a physical key. Then, the mobile terminal 340 generates a control signal corresponding to the physical key according to the physical trigger signal.
In one possible implementation manner, the mobile terminal 340 first obtains the key identifier of the physical key according to the physical trigger signal. Different physical keys correspond to different key identifiers, and different key identifiers correspond to different control instructions. For example, the above correspondence relationship may be as shown in the following table-1:
physical key Key label Control instruction
Volume adjusting key (volume up key) 1 Increase the volume
Volume adjusting key (volume reducing key) 2 Volume reduction
Volume switch key (on) 3 Volume turn-on
Volume switch key (off) 4 Mute
Home key 5 Power off/sleep
TABLE-1
After receiving a physical trigger signal corresponding to a physical key, the mobile terminal 340 obtains a key identifier of the physical key. And then, acquiring a control instruction corresponding to the key identification from the pre-stored corresponding relation according to the key identification. The pre-stored corresponding relation comprises corresponding relations between different key identifications and different control instructions.
And when the key identification corresponds to a control instruction, determining the control instruction as the control instruction corresponding to the key identification. For example, if the user presses the volume up key of the volume adjustment key 31, the mobile terminal 340 obtains that the key identifier corresponding to the key is 1, and the corresponding control instruction is the volume up.
And when the key identification corresponds to two or more control instructions, respectively displaying the control instructions, receiving a selection signal corresponding to any one control instruction, and determining the selected control instruction as the control instruction corresponding to the key identification. For example, if the user presses the Home key 33, the mobile terminal 340 obtains that the key identifier corresponding to the key is 5, and the corresponding control instruction is to turn off or sleep. Then, the mobile terminal 340 displays the two control commands of power-off/sleep in the local terminal and/or the smart display device 320, and the user selects one control command from the two control commands, for example, the user selects power-off. After receiving the selection signal of the user, the mobile terminal 340 determines the selected control instruction as the control instruction corresponding to the key identifier.
Finally, the mobile terminal 340 generates a control signal according to the control instruction, and the control signal is used for controlling the smart display device 320 to perform a corresponding operation according to the control signal.
In addition, the virtual key refers to a key implemented by software in the mobile terminal 340, such as a button, a slider bar, and a switch. The manner in which the mobile terminal 340 generates the control signal corresponding to the virtual key is the same as or similar to the manner in which the control signal corresponding to the physical key is generated, and thus, the description thereof is omitted.
After generating the control signal corresponding to the physical key or the virtual key, the mobile terminal 340 transmits the control signal to the intelligent display device 320. The mobile terminal 340 may send a control signal to the intelligent display device 320 in the following two ways:
first, the mobile terminal 340 is configured to send a control signal to the smart display device 320 through a communication connection. The communication connection refers to the TCP connection established by the mobile terminal 340 and the smart display device 320 in the three ways described above in the networking state.
Second, the mobile terminal 340 is configured to transmit a control signal to the smart display device 320 in the form of an infrared signal. If the mobile terminal 340 and/or the smart display device 320 are not connected to the network, that is, the mobile terminal 340 and/or the smart display device 320 cannot establish a communication connection, the mobile terminal 340 may send the control signal to the smart display device 320 in the form of an infrared signal through the infrared transmitting component. Correspondingly, the intelligent display device 320 receives the control signal sent by the mobile terminal 340 in the form of the infrared signal through the infrared receiving component, and decodes the received infrared signal to obtain the control signal.
And a smart display device 320 configured to perform a corresponding control operation according to the control signal.
After receiving the control signal sent by the mobile terminal 340 through the communication connection or the infrared connection, the smart display device 320 controls the corresponding component to execute the corresponding control operation according to the control signal. For example, controlling the volume of the speaker of the smart display device 320, controlling the speaker of the smart display device 320 to stop playing sound, controlling the smart display device 320 to turn off/sleep, etc.
The above describes that the user performs basic control such as tuning, volume adjustment, on/off of the smart display device 320 through the mobile terminal 340. Next, control of the user to manage the application in the smart display device 320 through the mobile terminal 340 will be described.
The mobile terminal 340 is configured to acquire an installation state of an application in the smart display device 320 for any application, generate a control signal for application management according to the installation state, and send the control signal for application management to the smart display device 320. Correspondingly, the smart display device 320 is configured to manage the application according to the control signal for application management.
In the present embodiment, the mounting state includes: any of uninstalled, installed and in need of update, and installed and not in need of update are exemplified. In other possible embodiments, the installation status may include only uninstalled and installed, and this embodiment is not limited in particular.
The mobile terminal 340 may obtain the installation status of any application in the smart display device 320 according to the following two possible implementation manners:
in a first possible implementation manner, the mobile terminal 340 is configured to obtain, for any application, an application identifier of the application; the application identification is sent to the smart display device 320. Each application has its unique corresponding application identification, also referred to as an application ID (Identity).
Correspondingly, the smart display device 320 is configured to receive the application identifier of any application sent by the mobile terminal 340; judging whether the application is installed in the smart display device 320 according to the application identifier; if the application is judged not to be installed, sending an uninstall instruction to the mobile terminal 340; if the application is determined to be installed, an installed indication is sent to the mobile terminal 340.
After receiving the application identifier sent by the mobile terminal 340, the smart display device 320 queries whether an application identifier identical to the received application identifier exists in the application identifiers of the installed applications. If so, it is said that the application is installed in the smart display device 320; if not, it indicates that the application is not installed in the smart display device 320.
If the application is determined to be installed, the smart display device 320 sends an uninstall instruction to the mobile terminal 340, where the uninstall instruction is used to indicate that the application is installed in the smart display device 320 in an uninstalled state; if the application is determined to be installed, the smart display device 320 sends an installed indication to the mobile terminal 340, where the installed indication is used to indicate that the installation state of the application in the smart display device 320 is installed. Correspondingly, the mobile terminal 340 receives an uninstalled indication or an installed indication sent by the smart display device 320.
Further, after determining that a certain application is installed, the intelligent display device 320 may further determine whether the application needs to be updated according to the device version number and the server version number of the application. The device version number refers to a version number of the application currently in the intelligent display device 320; the server version number refers to the version number of the application currently in the server 360, and usually, the latest version of the application is stored in the server 360.
The smart display device 320 may obtain the server version number of the application in two possible ways:
1, the smart display device 320 receives a server version number sent by the mobile terminal 340, where the server version number is obtained by the mobile terminal 340 from the server 360.
The mobile terminal 340 may obtain a server version number of a certain application from the server 360 by the following steps:
(1) and the mobile terminal 340 sends a version acquisition request carrying the application identifier to the server 360.
The server 360 is configured to obtain a server version number of the application corresponding to the application identifier according to the version obtaining request. After the server 360 receives the version obtaining request, the server 360 queries an application corresponding to the application identifier carried in the version obtaining request, and obtains a server version number of the application currently in the server 360.
(2) And the mobile terminal 340 receives the server version number sent by the server 360.
The server 360 sends the acquired server version number to the mobile terminal 340; correspondingly, the mobile terminal 340 receives the server version number sent by the server 360.
(3) And the mobile terminal 340 sends the server version number to the intelligent display device 320.
Correspondingly, the smart display device 320 receives the server version number sent by the mobile terminal 340.
2, the intelligent display device 320 sends a version obtaining request carrying the application identifier to the server 360, and the server 360 is configured to obtain the server version number of the application corresponding to the application identifier according to the version obtaining request; and receiving the server version number sent by the server 360.
The manner in which the intelligent display device 320 obtains the server version number of a certain application from the server 360 is the same as or similar to the manner in which the mobile terminal 340 obtains the server version number of a certain application from the server 360, and is not described again.
After acquiring the device version number and the server version number of the application, the smart display device 320 compares the server version number and the device version number to determine whether the application needs to be updated. If the version number of the equipment side is different from that of the server side, the application needs to be updated; if the device version number is the same as the server version number, it indicates that the application of the latest version is installed in the smart display device 320, and the application does not need to be updated.
If the application needs to be updated, the intelligent display device 320 sends an installed indication carrying an application update identifier to the mobile terminal 340. The installed indication carrying the application update identifier is used to indicate that the installation status of the application in the smart display device 320 is installed and needs to be updated. Correspondingly, the mobile terminal 340 receives the installed indication carrying the application update identifier sent by the smart display device 320.
If the application does not need to be updated, the smart display device 320 sends an installed indication carrying the updated identifier to the mobile terminal 340. Wherein the installed indication carrying the updated identifier is used to indicate that the installation status of the application in the smart display device 320 is installed and does not need to be updated. Correspondingly, the mobile terminal 340 receives the installed indication carrying the updated identifier sent by the smart display device 320.
In summary, the mobile terminal 340 may determine, through the received uninstall indication, the installed indication carrying the application update identifier, and the installed indication carrying the updated identifier, that the installation state of the application in the smart display device 320 corresponds to uninstalled, installed and needing to be updated, and installed and not needing to be updated, respectively.
In a second possible implementation manner, the mobile terminal 340 is configured to send a list acquisition request to the smart display device 320, where the list acquisition request is used to trigger the smart display device 320 to acquire an application identifier of an installed application of the smart display device 320 and generate an installed application list; receiving an installed application list sent by the smart display device 320; for any application, acquiring an application identifier of the application; judging whether the application identifier exists in the installed application list or not; if the application identifier is determined not to exist in the installed application list, determining that the application is not installed in the intelligent display device 320; if the application identifier is determined to exist in the installed application list, it is determined that the installation state of the application in the smart display device 320 is installed.
Correspondingly, the smart display device 320 is configured to receive the list acquisition request sent by the mobile terminal 340; generating an installed application list according to the list acquisition request; the list of installed applications is sent to the mobile terminal 340.
Wherein the list of installed applications includes application identifications of the installed applications in the smart display device 320.
In one possible embodiment, the installed application list may further include device side version numbers respectively corresponding to the respective application identifications. Therefore, the smart display device 320 is further configured to obtain the application identifier and the device side version number of the installed application in the smart display device 320 according to the list obtaining request; and generating an installed application list according to the application identification and the equipment terminal version number.
After receiving the installed application list, the mobile terminal 340 determines whether the application is installed in the smart display device 320 by determining whether the application identifier of the application searched by the user exists in the installed application list when the user queries any application in the application mall through the application search software.
Further, after determining that a certain application is installed in the smart display device 320, the mobile terminal 340 may further determine whether the application needs to be updated according to the device version number and the server version number of the application. The mobile terminal 340 obtains the device version number corresponding to the application identifier from the installed application list, and sends a version obtaining request carrying the application identifier to the server 360. The server 360 is configured to obtain a server version number of the application corresponding to the application identifier according to the version obtaining request, and send the server version number to the mobile terminal 340. Correspondingly, the mobile terminal 340 receives the server version number sent by the server 360. Then, the mobile terminal 340 determines whether the application needs to be updated according to the version number of the server side and the version number of the device side; if the application is determined to need updating, determining that the installation state of the application in the intelligent display device 320 is installed and needs updating; if the application does not need to be updated, the installation state of the application in the smart display device 320 is determined to be installed and not to need to be updated.
In summary, after obtaining the installed application list from the smart display device 320, the mobile terminal 340 determines the installation state of the application in the smart display device 320 according to the application identifier included in the installed application list and the device version number corresponding to each application identifier, where the installation state includes any one of uninstalled state, installed state and update-required state, and installed state and update-not-required state.
After determining the installation state of a certain application in the smart display device 320, the mobile terminal 340 generates a control signal for application management according to the installation state. Depending on the installation state, the mobile terminal 340 may be configured to generate different control signals for application management.
In the first case:
the mobile terminal 340 is configured to display an installation control in a first predetermined area when the installation state is not installed, receive a first trigger signal acting on the installation control, generate a control signal for application installation according to the first trigger signal, and send the control signal for application installation to the smart display device 320.
Please refer to fig. 3D in combination, which illustrates an interface schematic diagram of the mobile terminal 340 when the installation state is uninstalled. The mobile terminal 340 displays the installation control 34. The user may click the installation control 34 if the user installs the application in the smart display device 320; after receiving a trigger signal from the user acting on the installation control 34, the mobile terminal 340 generates a control signal for application installation, where the control signal for application installation includes an application identification or a download address of the application. The download address of the application is usually a URL (Uniform Resource Locator) link, and the URL link points to the download address of the installation package of the application.
Correspondingly, the smart display device 320 is configured to download and install the application according to the control signal for application installation.
When the control signal for application installation is a control signal including an application identifier, the smart display device 320 sends an application download request carrying the application identifier to the server 360; after receiving the application download request, the server 360 obtains a download address of the corresponding application according to the application identifier carried in the application download request, and sends the download address to the intelligent display device 320; correspondingly, the smart display device 320 receives the download address sent by the server 360, and then downloads and installs the application according to the download address. The download address of the application is usually a URL link, and the URL link points to the download address of the installation package of the application.
When the control signal for application installation is a control signal including a download address of an application, the smart display device 320 directly reads the download address from the control signal for application installation and then downloads and installs the application according to the download address.
In the second case:
the mobile terminal 340 is configured to display the update control in the second predetermined area when the installation state is installed and needs to be updated, receive a second trigger signal acting on the update control, generate a control signal for application update according to the second trigger signal, and send the control signal for application update to the smart display device 320.
Please refer to fig. 3E in combination, which shows an interface schematic diagram of the mobile terminal 340 when the installation state is installed. The mobile terminal 340 displays the update control 35. If the user needs to update the version of the application in the smart display device 320, the user can click the update control 35; after receiving the trigger signal acted by the user on the update control 35, the mobile terminal 340 generates a control signal for application update, where the control signal for application update includes an application identifier or an update package download address of the application. Wherein, the update package download address of the application is usually also a URL link.
Correspondingly, the smart display device 320 is configured to download and update the application according to the control signal for application update.
When the control signal for application update is a control signal including an application identifier, the smart display device 320 sends an application update request carrying the application identifier to the server 360; after receiving the application update request, the server 360 acquires an update package download address of the application according to the application identifier carried in the application update request, and sends the update package download address to the intelligent display device 320; correspondingly, the smart display device 320 receives the update package download address sent by the server 360, and then downloads and updates the application according to the update package download address.
When the control signal for application update is a control signal including an update package download address of an application, the smart display device 320 directly reads the update package download address from the control signal for application update and then downloads and updates the application according to the update package download address.
In a third case:
the mobile terminal 340 is configured to display the uninstall control in a third predetermined area when the installation state is installed and needs to be updated or installed and does not need to be updated, receive a third trigger signal acting on the uninstall control, generate a control signal for uninstalling the application according to the third trigger signal, and send the control signal for uninstalling the application to the smart display device 320.
Still referring to fig. 3E in conjunction, the mobile terminal 340 may display the uninstall control 36 when the installation status is installed and needs updating or installed and does not need updating. If the user needs to uninstall the application from the smart display device 320, the user can click the uninstall control 36; after receiving the trigger signal acted by the user on the uninstall control 36, the mobile terminal 340 generates a control signal for application uninstall, where the control signal for application uninstall includes an application identification.
Correspondingly, the smart display device 320 is configured to uninstall the application according to the control signal for application uninstallation.
When the control signal for application uninstallation is a control signal including an application identifier, the smart display device 320 reads the application identifier from the control signal for application uninstallation and then uninstalls an application corresponding to the application identifier.
In summary, in the intelligent interaction system provided in this embodiment, a mobile terminal in communication connection with the intelligent display device is introduced, and the mobile terminal generates a control signal to control the intelligent display device to execute a corresponding control operation; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the intelligent display equipment is controlled through the mobile terminal, so that a related control interface can be displayed on the mobile terminal side, and the influence of the related control interface on the normal display of the current display content in the intelligent display equipment is avoided.
In addition, the intelligent interaction system provided by the embodiment realizes that the intelligent display equipment is directly controlled through the existing physical keys in the mobile terminal, simplifies the operation and enables the control of the intelligent display equipment to be more convenient and faster. The embodiment also provides two control signal sending modes, including sending the control signals through communication connection and sending the control signals through infrared connection, so that the mobile terminal can quickly and conveniently control the intelligent display device under the condition of networking or non-networking.
In addition, the intelligent interactive system provided by this embodiment enables the user to check the installation state of the application in the intelligent display device at the mobile terminal side on the premise of ensuring normal playing and displaying of the currently played content in the intelligent display device, and controls the intelligent display device to manage the application at the background by the mobile terminal, thereby improving the convenience of the user in managing the application in the intelligent display device. The embodiment also provides a mode of controlling the intelligent display device to download and install the application, update the application and uninstall the application at the background through the mobile terminal, so that the application in the intelligent display device is managed in a diversified manner.
Fig. 4A is a block diagram illustrating a structure of an intelligent interactive system according to still another exemplary embodiment, the intelligent interactive system including: a smart display device 420, and a mobile terminal 440 in communicative connection with the smart display device 420. In addition, the intelligent interactive system may further include a server 460 connected to the intelligent display device 420 and the mobile terminal 440, respectively, through a wireless network.
The manner of establishing the communication connection between the intelligent display device 420 and the mobile terminal 440 is described in detail in the embodiment shown in fig. 3A and is not described herein again.
In this embodiment, an interaction scheme for a user to view associated information of currently displayed content in the smart display device 420 through the mobile terminal 440 will be specifically described.
And the intelligent display device 420 is configured to acquire at least one item of associated information of the currently displayed content and provide the at least one item of associated information to the mobile terminal 440 through the communication connection.
After the intelligent display device 420 establishes a communication connection with the mobile terminal 440, at least one item of associated information of the currently displayed content is acquired. The associated information may be a content identifier of the currently displayed content, or information such as a program poster, a program introduction, a program rating, a program review, a program recommendation, an electronic program guide, a program preview, audio associated information, electronic book associated information, and the like. The smart display device 420 then provides the at least one item of association information to the mobile terminal 440 via the communication connection.
And the mobile terminal 440 is configured to acquire at least one item of associated information of the currently displayed content in the intelligent display device 420 through the communication connection, and display the associated information according to the at least one item of associated information.
When the associated information is a content identifier of the currently displayed content, the mobile terminal 440 is configured to send the content identifier to the server 460; a server 460 configured to acquire other associated information corresponding to the content identifier and transmit the other associated information to the mobile terminal 440; and the mobile terminal 440 is configured to display according to other associated information.
Wherein different display contents correspond to different content identifications, and different content identifications correspond to different associated information. The server 460 stores therein the correspondence between different content identifications and different associated information. When the server 460 receives the content identifier transmitted by the mobile terminal 440, other association information corresponding to the received content identifier is acquired from the stored correspondence. According to the difference of the currently displayed content in the intelligent display device 420, the corresponding other related information is also different, for example, if the currently displayed content is a local video or an online video, the corresponding other related information may be information such as a program poster, a program introduction, a program score, a program comment, or a program recommendation; if the currently displayed content is a live program, the corresponding other associated information may be an electronic program list of the current live channel, an electronic program list of other live channels, or program preview and the like; if the currently displayed content is audio content, the corresponding other associated information can be information such as lyrics, album names or singers; if the currently displayed content is an electronic book, the corresponding other related information may be information such as a title, an author, a publisher, or other related bibliographic recommendations.
In addition, the embodiment is merely exemplified by the mobile terminal 440 obtaining other associated information of the content currently displayed in the intelligent display device 420 from the server 460 through the content identifier. In case that the network condition between the smart display device 420 and the mobile terminal 440 allows, the smart display device 420 may also obtain other related information of the currently displayed content from the server 460 through the content identifier after obtaining the content identifier of the currently displayed content, and then provide the other related information to the mobile terminal 440.
It should be noted that, since the display content in the smart display device 420 is very diverse, and the corresponding associated information is also very diverse, the description of the associated information in this embodiment is only exemplary and explanatory, and is not intended to limit the disclosure.
It should be noted that, after establishing a communication connection with the mobile terminal 440, the smart display device 420 may automatically obtain at least one item of associated information of the currently displayed content, and provide the at least one item of associated information to the mobile terminal 440; or after receiving the association information acquisition request sent by the mobile terminal 440 through the communication connection, acquiring at least one item of association information of the currently displayed content under the trigger of the association information acquisition request, and providing the at least one item of association information to the mobile terminal 440.
According to the difference of the acquired other related information, the mobile terminal 440 may be configured to display the other related information in the following manners:
in one possible implementation manner, the mobile terminal is configured to display the program poster when the other associated information includes the program poster and the other associated information further includes at least one of a program introduction, a program score, a program comment and a program recommendation; receiving a trigger signal acting on the program poster; and displaying at least one of the program brief description, the program score, the program comment and the program recommendation according to the trigger signal.
Referring to fig. 4B and 4C in combination, fig. 4B shows an interface diagram of the smart display device side; fig. 4C shows an interface diagram at the mobile terminal side. The movie "police story 2013" is playing in the smart display device. And after the intelligent display equipment acquires the content identification of the current display content, the content identification is sent to the mobile terminal. Then, the mobile terminal obtains the associated information of the currently displayed content according to the content identifier, wherein the associated information comprises a program poster 42, a program brief 43, a program score 44, a program comment 45 and a program recommendation 46. After acquiring the above-mentioned related information, the mobile terminal displays the program poster 42 first. The mobile terminal then receives a trigger signal to the program poster 42, which is triggered by the user clicking on the program poster 42. As shown in fig. 4C, the mobile terminal displays a program introduction 43, a program rating 44, a program comment 45, and a program recommendation 46 according to the trigger. The user can watch the program through the intelligent display equipment, and simultaneously look up the associated information of the program through the mobile terminal, and the two do not influence each other.
In other possible implementations, the mobile terminal 440 is configured to display the electronic program guide and/or the program preview when the other associated information includes the electronic program guide and/or the program preview; alternatively, the mobile terminal 440 is configured to display the audio associated information when the other associated information includes the audio associated information; alternatively, the mobile terminal 440 is configured to display the e-book associated information when the other associated information includes the e-book associated information.
The electronic program list may be an electronic program list of a current live channel in the intelligent display device 420, or an electronic program list of other live channels; the program preview may be a program preview of a current live channel in the intelligent display device 420, or a program preview of other live channels; the audio associated information may include information such as lyrics, album name, or singer; the e-book associated information may include information such as title, author, publisher, or other associated book recommendations.
In summary, in the intelligent interaction system provided in this embodiment, by introducing the mobile terminal in communication connection with the intelligent display device, at least one item of associated information of currently displayed content in the intelligent display device is obtained through the mobile terminal, and is displayed according to the at least one item of associated information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the associated information in the intelligent display equipment is shared and displayed through the mobile terminal, so that the influence of the associated information on the normal display of the current display content in the intelligent display equipment is avoided, and the convenience for a user to check the associated information is improved.
Fig. 5 is a block diagram illustrating a structure of an intelligent interactive system according to still another exemplary embodiment, the intelligent interactive system including: a smart display device 520, and a mobile terminal 540 in communication connection with the smart display device 520. In addition, the intelligent interactive system may further include a server 560 connected to the intelligent display device 520 and the mobile terminal 540 through wireless networks, respectively.
The manner of establishing the communication connection between the smart display device 520 and the mobile terminal 540 is described in detail in the embodiment shown in fig. 3A and is not described herein again.
In this embodiment, a scheme that a user realizes human-computer interaction with the intelligent display device 520 through the mobile terminal 540 will be specifically described, which is embodied in the aspects of real-time comment, screen capture, social interaction with other users, and the like of the currently displayed content in the intelligent display device 520.
The mobile terminal 540 is configured to receive interaction information triggered by a user for current display content in the intelligent display device 520, and send the interaction information to the intelligent display device 520; and the intelligent display device 520 is configured to perform corresponding interactive operation according to the interactive information.
The interactive information may be comment information edited by the user for the currently displayed content in the intelligent display device 520; or may be an interactive instruction triggered by the user for the currently displayed content in the smart display device 520, such as a picture capturing instruction, an image capturing instruction, a game manipulation instruction, and the like. Of course, the sending of the interaction information may refer to the sending manner of the control signal in the embodiment shown in fig. 3A.
When the interactive information is comment information, the mobile terminal 540 is configured to receive comment information edited by the user for the currently displayed content, and send the comment information to the smart display device 520. Correspondingly, the smart display device 520 is configured to display the comment information and send the comment information to the server 560. Server 560 is configured to send the comment information to at least one other smart display device configured to display the comment information.
When watching the program, the user can also make comments to exchange own watching feelings with other users. Referring to fig. 4C in conjunction, after the user clicks the "barrage" button 48, comments in the form of text, pictures, or voice may be input.
In practical applications, the mobile terminal 540 may be configured to receive text information and/or picture information edited by a user for the currently displayed content, and determine the text information and/or the picture information as comment information. A user may input text information and/or picture information such as words, emoticons, or pictures, etc. through the mobile terminal 540. The mobile terminal 540 determines text information and/or picture information input by the user as comment information. Referring to fig. 4C in conjunction, after the user inputs "good stimulus", clicking the "done" button 50 determines that the input is completed, the mobile terminal 47 determines the text information "good stimulus" input by the user as comment information 49.
Alternatively, the mobile terminal 540 may be further configured to receive voice information edited by the user for the currently displayed content, convert the voice information into corresponding text information, and determine the text information as comment information. The user may also input voice information through the mobile terminal 540, which is more convenient and faster than manually inputting text information and/or picture information. The mobile terminal 540 converts voice information input by the user into corresponding text information through voice recognition and then determines the text information as comment information.
Thereafter, the mobile terminal 540 transmits the comment information to the smart display device 520 through the communication connection. The intelligent display device 520 displays the comment information. Meanwhile, the intelligent display device 520 sends the comment information to at least one other intelligent display device through the server 560, and the at least one other intelligent display device displays the received comment information. In one embodiment. The smart display device 520 may be configured to display the comment information in a bullet screen form in a predetermined display area. Referring to fig. 4B in conjunction, the intelligent display device may display the comment information 49 in a bullet screen form in a predetermined area, so that other users watching the program can see the comments posted by the users instantly. Furthermore, other users can also make comments, so that instant, convenient and barrier-free communication is realized.
In summary, in the intelligent interaction system provided in this embodiment, by introducing the mobile terminal in communication connection with the intelligent display device, the mobile terminal sends interaction information triggered by the user for the currently displayed content to the intelligent display device, so that the intelligent display device executes corresponding interaction operation according to the interaction information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the mobile terminal is used as a medium, and the human-computer interaction experience between the user and the intelligent display equipment is enriched.
In addition, the comment information edited by the user for the currently displayed content in the intelligent display device is received through the mobile terminal, the comment information is sent to the intelligent display device, and the comment information is displayed in real time by the intelligent display device, so that the instant, convenient and barrier-free communication among users is realized, the interactive experience between the users and the equipment is improved, and the participation of the users in television programs is enhanced.
It should be noted that the three embodiments shown in fig. 3A, fig. 4A and fig. 5 are only exemplary and explanatory illustrations of the intelligent interaction scheme provided by the present disclosure from three different perspectives. In practical application, the three interactions can be realized independently or in combination with each other.
The following are embodiments of the disclosed apparatus, and please refer to the above embodiments of the disclosed system for details not disclosed in the embodiments of the disclosed apparatus.
Fig. 6 is a block diagram illustrating an intelligent interaction device 60, which may be implemented by software, hardware, or a combination thereof, as part or all of a mobile terminal in communication with an intelligent display device, according to an example embodiment. The intelligent interaction device 60 may include: at least one of a device control module 610, an auxiliary display module 620, and a device interaction module 630.
The device control module 610 is configured to generate a control signal corresponding to the smart display device, and transmit the control signal to the smart display device, and the smart display device is configured to perform a corresponding control operation according to the control signal.
The auxiliary display module 620 is configured to acquire at least one item of associated information of currently displayed content in the smart display device through the communication connection, and display according to the at least one item of associated information.
The device interaction module 630 is configured to receive interaction information triggered by a user for current display content in the intelligent display device, and send the interaction information to the intelligent display device, where the intelligent display device is configured to execute corresponding interaction operations according to the interaction information.
In summary, the intelligent interaction apparatus provided in this embodiment introduces the mobile terminal in communication connection with the intelligent display device; on the first aspect, a control signal is generated through a mobile terminal to control an intelligent display device to execute corresponding control operation; in the second aspect, at least one item of associated information of currently displayed content in the intelligent display equipment is obtained through the mobile terminal, and the associated information is displayed; in the third aspect, interactive information triggered by a user aiming at the current display content is sent to the intelligent display equipment through the mobile terminal, so that the intelligent display equipment executes corresponding interactive operation according to the interactive information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the mobile terminal is used for controlling the intelligent display equipment, so that a related control interface can be displayed on the mobile terminal side, and the influence of the mobile terminal on the normal display of the current display content in the intelligent display equipment is avoided; in addition, the mobile terminal is used for sharing and displaying the associated information in the intelligent display equipment, so that the influence of the associated information on the normal display of the current display content in the intelligent display equipment is avoided, and the convenience for a user to check the associated information is improved; in addition, the mobile terminal is used as a medium, and the human-computer interaction experience between the user and the intelligent display equipment is enriched.
Fig. 7 is a block diagram illustrating an intelligent interaction device 70 that may be implemented by software, hardware, or a combination thereof as part or all of an intelligent display device in communicative connection with a mobile terminal according to another exemplary embodiment. The intelligent interaction device 70 may include: at least one of the control response module 710, the information providing module 720, and the terminal interaction module 730.
The control response module 710 is configured to receive a control signal sent by the mobile terminal, and execute a corresponding control operation according to the control signal.
The information providing module 720 is configured to obtain at least one item of associated information of currently displayed content, and provide the at least one item of associated information to the mobile terminal through the communication connection, and the mobile terminal is configured to display according to the at least one item of associated information.
The terminal interaction module 730 is configured to receive interaction information, which is sent by the mobile terminal and is triggered by the user for the current display content, and execute corresponding interaction operation according to the interaction information.
In summary, the intelligent interaction apparatus provided in this embodiment introduces the mobile terminal in communication connection with the intelligent display device; on the first aspect, a control signal is generated through a mobile terminal to control an intelligent display device to execute corresponding control operation; in the second aspect, at least one item of associated information of currently displayed content in the intelligent display equipment is obtained through the mobile terminal, and the associated information is displayed; in the third aspect, interactive information triggered by a user aiming at the current display content is sent to the intelligent display equipment through the mobile terminal, so that the intelligent display equipment executes corresponding interactive operation according to the interactive information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the mobile terminal is used for controlling the intelligent display equipment, so that a related control interface can be displayed on the mobile terminal side, and the influence of the mobile terminal on the normal display of the current display content in the intelligent display equipment is avoided; in addition, the mobile terminal is used for sharing and displaying the associated information in the intelligent display equipment, so that the influence of the associated information on the normal display of the current display content in the intelligent display equipment is avoided, and the convenience for a user to check the associated information is improved; in addition, the mobile terminal is used as a medium, and the human-computer interaction experience between the user and the intelligent display equipment is enriched.
FIG. 8 is a block diagram illustrating an intelligent interactive system, according to an example embodiment. The intelligent interactive system comprises a mobile terminal 600 and an intelligent display device 700 which is in communication connection with the mobile terminal 600.
The mobile terminal 600 may include an intelligent interaction device, which may be implemented as part or all of the mobile terminal 600 through software, hardware, or a combination of both. The intelligent interaction device may include: at least one of a device control module 610, an auxiliary display module 620, and a device interaction module 630.
The device control module 610 is configured to generate a control signal corresponding to the smart display device, and transmit the control signal to the smart display device, and the smart display device is configured to perform a corresponding control operation according to the control signal.
In one embodiment, the device control module 610 includes: a physical control unit 610 a; and/or, a virtual control unit 610 b.
The physical control unit 610a is configured to receive a physical trigger signal corresponding to any physical key in the mobile terminal, and generate a control signal corresponding to the physical key according to the physical trigger signal.
The virtual control unit 610b is configured to receive a virtual trigger signal corresponding to any virtual key in the mobile terminal, and generate a control signal corresponding to the virtual key according to the virtual trigger signal.
In one embodiment, the device control module 610 further includes: a communication transmitting unit 610 c; and/or infrared transmitting unit 610 d.
The communication transmitting unit 610c is configured to transmit the control signal to the smart display device through the communication connection.
The infrared transmitting unit 610d is configured to transmit the control signal to the smart display device in the form of an infrared signal.
In one embodiment, the device control module 610 further includes: a state acquisition unit 610e, a signal generation unit 610f, and a signal transmission unit 610 g.
The status acquiring unit 610e is configured to acquire, for any application, an installation status of the application in the smart display device.
The signal generating unit 610f is configured to generate a control signal for application management according to the installation state.
In one embodiment, the signal generating unit 610f includes: installation generation subunit 610f 1; and/or, the update generation subunit 610f 2; and/or offload generation subunit 610f 3.
The installation generating subunit 610f1 is configured to, when the installation state is uninstalled, display an installation control in a first predetermined area, receive a first trigger signal acting on the installation control, and generate a control signal for application installation according to the first trigger signal, where the control signal for application installation is used to trigger the mobile terminal to download and install the application.
The update generating subunit 610f2 is configured to, when the installation state is that the mobile terminal is installed and needs to be updated, display an update control in a second predetermined area, receive a second trigger signal acting on the update control, and generate a control signal for updating an application according to the second trigger signal, where the control signal for updating an application is used to trigger the mobile terminal to download and update the application.
The uninstall generating subunit 610f3 is configured to, when the installation status is installed and needs to be updated or installed and does not need to be updated, display an uninstall control in a third predetermined area, receive a third trigger signal acting on the uninstall control, and generate a control signal for uninstalling an application according to the third trigger signal, where the control signal for uninstalling an application is used to trigger the mobile terminal to uninstall the application.
The signal transmitting unit 610g is configured to transmit the control signal for application management to the smart display device, and the smart display device is configured to manage the application according to the control signal for application management.
The auxiliary display module 620 is configured to acquire at least one item of associated information of currently displayed content in the smart display device through the communication connection, and display according to the at least one item of associated information.
In one embodiment, the auxiliary display module 620 includes: an identification transmitting unit 620a, an association receiving unit 620b, and an association display unit 620 c.
The identifier sending unit 620a is configured to send the content identifier to a server when the obtained at least one item of associated information is a content identifier of the currently displayed content, where the server is configured to obtain other associated information corresponding to the content identifier.
The association receiving unit 620b is configured to receive the other association information sent by the server.
The association display unit 620c is configured to display according to the other association information.
In one embodiment, the association display unit 620c includes: first display subunit 620c 1; and/or, second display subunit 620c 2; and/or, the third display subunit 620c 3; and/or, a fourth display subunit 620c 4.
The first display subunit 620c1, configured to display the program poster when the other associated information includes the program poster and the other associated information further includes at least one of a program introduction, a program rating, a program comment and a program recommendation; receiving a trigger signal acting on the program poster; and displaying at least one of the program brief description, the program score, the program comment and the program recommendation according to the trigger signal.
The second display subunit 620c2 is configured to display the electronic program guide and/or the program preview when the other associated information includes the electronic program guide and/or the program preview.
The third display subunit 620c3, configured to display the audio associated information when the other associated information includes the audio associated information.
The fourth display subunit 620c4 is configured to display the electronic book associated information when the other associated information includes the electronic book associated information.
The device interaction module 630 is configured to receive interaction information triggered by a user for current display content in the intelligent display device, and send the interaction information to the intelligent display device, where the intelligent display device is configured to execute corresponding interaction operations according to the interaction information.
In one embodiment, the device interaction module 630 includes: a comment receiving unit 630a and a comment transmitting unit 630 b.
The comment receiving unit 630a is configured to receive comment information edited by the user for the currently displayed content.
In one embodiment, the comment receiving unit 630a includes a text receiving subunit 630a 1; and/or the voice receiving subunit 630a 2.
The text receiving subunit 630a1 is configured to receive text information and/or picture information edited by the user for the currently displayed content, and determine the text information and/or the picture information as the evaluation information.
The voice receiving subunit 630a2 is configured to receive voice information edited by the user for the currently displayed content, convert the voice information into corresponding text information, and determine the text information as the comment information.
The comment sending unit 630b is configured to send the comment information to the intelligent display device, the intelligent display device is configured to display the comment information, and send the comment information to a server, and the server is configured to send the comment information to at least one other intelligent display device for display.
In one embodiment of the present invention,
the device further comprises: a broadcast inquiry module 601, a feedback receiving module 602 and a request connection module 603; wherein the broadcast query module 601 is configured to send a broadcast query to the smart display devices in the same local area network; the feedback receiving module 602 is configured to receive a feedback response sent by the smart display device for the broadcast query; the request connection module 603 is configured to send a connection request to the smart display device after determining that the smart display device can be currently connected according to the feedback response, and the smart display device is configured to establish the communication connection with the mobile terminal according to the connection request. Or,
the device further comprises: a broadcast acquisition module 604 and the request connection module 603; the broadcast acquiring module 604 is configured to acquire broadcast information sent by the smart display devices in the same local area network at predetermined time intervals; the request connection module 603 is configured to, after determining the smart display device that can be currently connected according to the broadcast information, send a connection request to the smart display device, where the smart display device is configured to establish the communication connection with the mobile terminal according to the connection request. Or,
the device further comprises: the broadcast acquiring module 604, the broadcast querying module 601, the feedback receiving module 602, and the request connecting module 603; the broadcast acquiring module 604 is configured to acquire broadcast information sent to the outside by the intelligent display devices in the same local area network at predetermined time intervals; the broadcast query module 601 is configured to send a broadcast query to the smart display devices in the same local area network; the feedback receiving module 602 is configured to receive a feedback response sent by the smart display device for the broadcast query; the request connection module 603 is configured to send a connection request to the smart display device after determining that the smart display device can be currently connected according to the broadcast information and the feedback response, where the smart display device is configured to establish the communication connection with the mobile terminal according to the connection request.
The smart display device 700 may include smart interaction means that may be implemented as part or all of the smart display device 700 through software, hardware, or a combination of both. The intelligent interaction device may include: at least one of the control response module 710, the information providing module 720, and the terminal interaction module 730.
The control response module 710 is configured to receive a control signal sent by the mobile terminal, and execute a corresponding control operation according to the control signal.
In one embodiment, the control response module 710 includes: a signal receiving unit 710a and an application management unit 710 b.
The signal receiving unit 710a is configured to receive a control signal for application management sent by the mobile terminal, where the control signal for application management is generated according to an installation state of any application in the smart display device after the mobile terminal acquires the installation state.
The application management unit 710b is configured to manage the application according to the control signal for application management.
In one embodiment, the application management unit 710b includes: application installation subunit 710b 1; and/or, apply update subunit 710b 2; and/or, the application of load relief sub-unit 710b 3.
The application installation subunit 710b1, configured to download and install the application according to the control signal for application installation when the control signal for application management is a control signal for application installation; the control signal for application installation is generated by displaying an installation control in a first preset area, receiving a first trigger signal acting on the installation control and generating according to the first trigger signal when the mobile terminal acquires that the installation state is not installed.
The application update subunit 710b2, configured to download and update the application according to the control signal for application update when the control signal for application management is the control signal for application update; and when the mobile terminal acquires that the installation state is installed and needs to be updated, displaying an update control in a second preset area, receiving a second trigger signal acting on the update control, and generating the control signal for application update according to the second trigger signal.
The application uninstalling subunit 710b3, configured to uninstall the application according to the control signal for application uninstallation when the control signal for application management is a control signal for application uninstallation; when the mobile terminal acquires that the installation state is installed and needs updating or installed and does not need updating, the control signal for application unloading displays an unloading control in a third preset area, receives a third trigger signal acting on the unloading control, and generates the control signal according to the third trigger signal.
The information providing module 720 is configured to obtain at least one item of associated information of currently displayed content, and provide the at least one item of associated information to the mobile terminal through the communication connection, and the mobile terminal is configured to display according to the at least one item of associated information.
The terminal interaction module 730 is configured to receive interaction information, which is sent by the mobile terminal and is triggered by the user for the current display content, and execute corresponding interaction operation according to the interaction information.
In one embodiment, the terminal interaction module 730 includes a comment receiving unit 730a, a comment displaying unit 730b, and a comment forwarding unit 730 c.
The comment receiving unit 730a is configured to receive comment information sent by the mobile terminal, the comment information being edited by the user for the currently displayed content.
The comment display unit 730b is configured to display the comment information.
In one embodiment, the comment display unit 730b is further configured to display the comment information in a bullet screen manner in a predetermined display area.
The comment forwarding unit 730c is configured to send the comment information to a server, and the server is configured to send the comment information to at least one other intelligent display device for display.
In one embodiment, the apparatus further comprises: a query feedback module 701, a request receiving module 702 and a connection establishing module 703; the query feedback module 701 is configured to obtain a broadcast query sent by the mobile terminal in the same local area network, and send a feedback response to the broadcast query to the mobile terminal; the request receiving module 702 is configured to receive a connection request sent by the mobile terminal after determining, according to the feedback response, that the smart display device can be currently connected; the connection establishing module 703 is configured to establish the communication connection with the mobile terminal according to the connection request. Or the like, or a combination thereof,
the device further comprises: a broadcast transmitting module 704, the request receiving module 702 and the connection establishing module 703; wherein, the broadcast sending module 704 is configured to send broadcast information outwards at predetermined time intervals; the request receiving module 702 is configured to receive a connection request sent by the mobile terminal in the same local area network, where the connection request is sent by the mobile terminal after determining, according to the broadcast information, that the smart display device can be currently connected to the mobile terminal; the connection establishing module 703 is configured to establish the communication connection with the mobile terminal according to the connection request. Or,
the device further comprises: the broadcast sending module 704, the query feedback module 701, the request receiving module 702, and the connection establishing module 703; the broadcast sending module 704 is configured to send broadcast information to the outside at predetermined time intervals; the query feedback module 701 is configured to obtain a broadcast query sent by the mobile terminal in the same local area network, and send a feedback response to the broadcast query to the mobile terminal; the request receiving module 702 is configured to receive a connection request sent by the mobile terminal, where the connection request is sent after the mobile terminal determines, according to the broadcast information and the feedback response, that the smart display device can be currently connected; the connection establishing module 703 is configured to establish the communication connection with the mobile terminal according to the connection request.
In summary, the intelligent interactive system provided in this embodiment introduces the mobile terminal in communication connection with the intelligent display device; on the first aspect, a control signal is generated through a mobile terminal to control an intelligent display device to execute corresponding control operation; in the second aspect, at least one item of associated information of currently displayed content in the intelligent display equipment is obtained through the mobile terminal, and the associated information is displayed; in the third aspect, interactive information triggered by a user aiming at the current display content is sent to the intelligent display equipment through the mobile terminal, so that the intelligent display equipment executes corresponding interactive operation according to the interactive information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the mobile terminal is used for controlling the intelligent display equipment, so that a related control interface can be displayed on the mobile terminal side, and the influence of the mobile terminal on the normal display of the current display content in the intelligent display equipment is avoided; in addition, the mobile terminal is used for sharing and displaying the associated information in the intelligent display equipment, so that the influence of the associated information on the normal display of the current display content in the intelligent display equipment is avoided, and the convenience for a user to check the associated information is improved; in addition, the mobile terminal is used as a medium, and the human-computer interaction experience between the user and the intelligent display equipment is enriched.
In addition, the intelligent interaction system provided by the embodiment realizes that the intelligent display equipment is directly controlled through the existing physical keys in the mobile terminal, simplifies the operation and enables the control of the intelligent display equipment to be more convenient and faster. The embodiment also provides two control signal sending modes, including sending the control signals through communication connection and sending the control signals through infrared connection, so that the mobile terminal can quickly and conveniently control the intelligent display device under the condition of networking or non-networking.
In addition, the intelligent interactive system provided by this embodiment enables the user to check the installation state of the application in the intelligent display device at the mobile terminal side on the premise of ensuring normal playing and displaying of the currently played content in the intelligent display device, and controls the intelligent display device to manage the application at the background by the mobile terminal, thereby improving the convenience of the user in managing the application in the intelligent display device. The embodiment also provides a mode of controlling the intelligent display device to download and install the application, update the application and uninstall the application at the background through the mobile terminal, so that the application in the intelligent display device is managed in a diversified manner.
In addition, the comment information edited by the user for the currently displayed content in the intelligent display device is received through the mobile terminal, the comment information is sent to the intelligent display device, and the comment information is displayed in real time by the intelligent display device, so that the instant, convenient and barrier-free communication among users is realized, the interactive experience between the users and the equipment is improved, and the participation of the users in television programs is enhanced.
With regard to the apparatus in the above embodiments, the specific manner in which the respective modules perform operations has been described in detail in the embodiments of the related system, and will not be described in detail here.
Fig. 9A/9B/9C are flowcharts illustrating an intelligent interaction method according to an exemplary embodiment, which is illustrated in the implementation environment shown in fig. 1. The intelligent interaction method can comprise the following steps:
referring to fig. 9A, a first possible interaction is shown:
in step 901, the mobile terminal generates a control signal corresponding to the smart display device.
In step 902, the mobile terminal sends a control signal to the smart display device.
Correspondingly, the intelligent display device receives the control signal sent by the mobile terminal.
In step 903, the smart display device performs a corresponding control operation according to the control signal.
It should be noted that, the above steps 901 and 902 can be implemented separately as an intelligent interaction method at the mobile terminal side; the steps 902 and 903 can be implemented separately as an intelligent interaction method on the intelligent display device side.
Referring to fig. 9B, a second possible interaction is shown:
in step 904, the smart display device obtains at least one item of associated information of the currently displayed content.
In step 905, the smart display device provides at least one item of association information to the mobile terminal via the communication connection.
Correspondingly, the mobile terminal acquires at least one item of associated information of the current display content in the intelligent display device through communication connection.
In step 906, the mobile terminal displays according to at least one item of association information.
It should be noted that, the above step 904 and step 905 can be implemented separately as an intelligent interaction method on the intelligent display device side; the above steps 905 and 906 can be implemented separately as an intelligent interaction method on the mobile terminal side.
Referring to fig. 9C, a third possible interaction is shown:
in step 907, the mobile terminal receives interaction information triggered by the user for the currently displayed content in the smart display device.
In step 908, the mobile terminal sends the interaction information to the smart display device.
Correspondingly, the intelligent display device receives interactive information which is sent by the mobile terminal and is triggered by the user aiming at the current display content.
In step 909, the smart display device performs a corresponding interactive operation according to the interactive information.
It should be noted that, the above step 907 and step 908 can be implemented separately as an intelligent interaction method on the mobile terminal side; the above-mentioned step 908 and step 909 can be implemented separately as an intelligent interactive method on the intelligent display device side.
In summary, the intelligent interaction method provided by this embodiment introduces the mobile terminal in communication connection with the intelligent display device; on the first aspect, a control signal is generated through a mobile terminal to control an intelligent display device to execute corresponding control operation; in the second aspect, at least one item of associated information of currently displayed content in the intelligent display equipment is obtained through the mobile terminal, and the associated information is displayed; in the third aspect, interactive information triggered by a user aiming at the current display content is sent to the intelligent display equipment through the mobile terminal, so that the intelligent display equipment executes corresponding interactive operation according to the interactive information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the mobile terminal is used for controlling the intelligent display equipment, so that a related control interface can be displayed on the mobile terminal side, and the influence of the mobile terminal on the normal display of the current display content in the intelligent display equipment is avoided; in addition, the mobile terminal is used for sharing and displaying the associated information in the intelligent display equipment, so that the influence of the associated information on the normal display of the current display content in the intelligent display equipment is avoided, and the convenience for a user to check the associated information is improved; in addition, the mobile terminal is used as a medium, and the human-computer interaction experience between the user and the intelligent display equipment is enriched.
In the following, three intelligent interaction schemes provided by the present disclosure will be introduced and explained by three embodiments shown in fig. 10, fig. 11 and fig. 12, respectively. The embodiment shown in fig. 10 will specifically describe an interaction scheme for a user to control an intelligent display device through a mobile terminal, including basic controls such as tuning, volume adjustment, power on/off, and further including a control for managing applications in the intelligent display device. The embodiment shown in fig. 11 will specifically describe an interaction scheme for a user to view the associated information of the currently displayed content in the intelligent display device through the mobile terminal. Fig. 12 specifically introduces a scheme in which a user performs human-computer interaction with an intelligent display device through a mobile terminal, and the scheme is embodied in the aspects of real-time comment on currently displayed content in the intelligent display device, screen capture, social interaction with other users, and the like. For the parts of the embodiments shown in fig. 10, 11 and 12 that are not described in detail, reference may be made to the system embodiments shown in fig. 3A, 4A and 5.
FIG. 10 is a flowchart illustrating an intelligent interaction method according to another exemplary embodiment, which is illustrated in the implementation environment shown in FIG. 1. The intelligent interaction method can comprise the following steps:
in step 1001, the mobile terminal establishes a communication connection with the smart display device.
The step may include three possible implementations as follows:
in a first possible implementation:
1. and the mobile terminal sends a broadcast inquiry to the intelligent display equipment in the same local area network.
2. The intelligent display equipment acquires a broadcast inquiry sent by the mobile terminal in the same local area network.
3. The smart display device sends a feedback response to the broadcast query to the mobile terminal.
Correspondingly, the mobile terminal receives a feedback response sent by the intelligent display device for the broadcast query.
4. And after determining the intelligent display equipment which can be connected at present according to the feedback response, the mobile terminal sends a connection request to the intelligent display equipment.
Correspondingly, the intelligent display device receives a connection request sent by the mobile terminal after the mobile terminal determines the intelligent display device which can be connected currently according to the feedback response.
5. And the intelligent display equipment establishes communication connection with the mobile terminal according to the connection request.
In a second possible implementation:
1. the intelligent display device sends broadcast information outwards at preset time intervals.
2. The mobile terminal acquires broadcast information sent outwards by intelligent display equipment in the same local area network at preset time intervals.
3. And after determining the intelligent display equipment which can be connected at present according to the broadcast information, the mobile terminal sends a connection request to the intelligent display equipment.
Correspondingly, the intelligent display equipment receives a connection request sent by the mobile terminal in the same local area network, wherein the connection request is sent after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information.
4. And the intelligent display equipment establishes communication connection with the mobile terminal according to the connection request.
In a third possible implementation:
1. the intelligent display device sends broadcast information outwards at preset time intervals.
2. The mobile terminal acquires broadcast information sent outwards by intelligent display equipment in the same local area network at preset time intervals.
3. And the mobile terminal sends a broadcast inquiry to the intelligent display equipment in the same local area network.
4. The intelligent display equipment acquires a broadcast inquiry sent by the mobile terminal in the same local area network.
5. The smart display device sends a feedback response to the broadcast query to the mobile terminal.
Correspondingly, the mobile terminal receives a feedback response sent by the intelligent display device for the broadcast query.
6. And after determining the intelligent display equipment which can be connected at present according to the broadcast information and the feedback response, the mobile terminal sends a connection request to the intelligent display equipment.
Correspondingly, the intelligent display device receives a connection request sent by the mobile terminal, wherein the connection request is sent after the mobile terminal determines the intelligent display device which can be connected currently according to the broadcast information and the feedback response.
7. And the intelligent display equipment establishes communication connection with the mobile terminal according to the connection request.
In step 1002, the mobile terminal generates a control signal corresponding to the smart display device.
This step may include two possible implementations as follows:
firstly, a physical trigger signal corresponding to any physical key in the mobile terminal is received, and a control signal corresponding to the physical key is generated according to the physical trigger signal.
Secondly, receiving a virtual trigger signal corresponding to any virtual key in the mobile terminal, and generating a control signal corresponding to the virtual key according to the virtual trigger signal.
In step 1003, the mobile terminal transmits a control signal to the smart display device.
This step may include two possible implementations as follows:
first, a control signal is sent to the smart display device through a communication connection.
Second, the control signal is transmitted to the smart display device in the form of an infrared signal.
Correspondingly, the intelligent display device receives the control signal sent by the mobile terminal.
In one embodiment, when the control signal is a control signal for application management, the above steps 1002 and 1003 may include the following sub-steps:
firstly, for any application, the installation state of the application in the intelligent display device is obtained.
Second, a control signal for application management is generated according to the installation state.
1. When the installation state is not installation, displaying an installation control in a first preset area, receiving a first trigger signal acting on the installation control, and generating a control signal for application installation according to the first trigger signal, wherein the control signal for application installation is used for triggering the mobile terminal to download and install the application.
2. And when the installation state is installed and needs to be updated, displaying the update control in a second preset area, receiving a second trigger signal acting on the update control, and generating a control signal for application update according to the second trigger signal, wherein the control signal for application update is used for triggering the mobile terminal to download and update the application.
3. And when the installation state is the installed state and needs updating or the installed state and does not need updating, displaying the uninstalling control in a third preset area, receiving a third trigger signal acting on the uninstalling control, and generating a control signal for uninstalling the application according to the third trigger signal, wherein the control signal for uninstalling the application is used for triggering the mobile terminal to uninstall the application.
Third, a control signal for application management is transmitted to the smart display device, and the smart display device is configured to manage the application according to the control signal for application management.
In step 1004, the smart display device performs a corresponding control operation according to the control signal.
In one embodiment, when the control signal is a control signal for application management, the step 1004 may include the following sub-steps:
firstly, receiving a control signal for application management sent by a mobile terminal, wherein the control signal for application management is generated according to an installation state after the mobile terminal acquires the installation state of any application in the intelligent display device.
Second, applications are managed according to control signals for application management.
1. And when the control signal for application management is a control signal for application installation, downloading and installing the application according to the control signal for application installation.
The control signal for application installation is generated by displaying an installation control in a first preset area, receiving a first trigger signal acting on the installation control and generating according to the first trigger signal when the mobile terminal acquires that the installation state is not installed.
2. And when the control signal for application management is a control signal for application update, downloading and updating the application according to the control signal for application update.
And when the mobile terminal acquires that the installation state is installed and needs to be updated, displaying the update control in a second preset area, receiving a second trigger signal acting on the update control, and generating the control signal for application update according to the second trigger signal.
3. And when the control signal for application management is the control signal for application uninstallation, uninstalling the application according to the control signal for application uninstallation.
When the mobile terminal acquires that the installation state is installed and needs updating or installed and does not need updating, the control signal for unloading the application is generated by displaying the unloading control in a third preset area, receiving a third trigger signal used for unloading the control and generating the third trigger signal according to the third trigger signal.
It should be noted that, the above steps 1001 to 1003 can be implemented separately as an intelligent interaction method at the mobile terminal side; the steps 1001, 1003 and 1004 may be implemented separately as an intelligent interactive method on the intelligent display device side.
In summary, in the intelligent interaction method provided by this embodiment, a mobile terminal in communication connection with an intelligent display device is introduced, and the mobile terminal generates a control signal to control the intelligent display device to execute a corresponding control operation; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the intelligent display equipment is controlled through the mobile terminal, so that a related control interface can be displayed on the mobile terminal side, and the influence of the related control interface on the normal display of the current display content in the intelligent display equipment is avoided.
In addition, the intelligent interaction method provided by the embodiment realizes that the intelligent display equipment is directly controlled through the existing physical keys in the mobile terminal, simplifies the operation and enables the control of the intelligent display equipment to be more convenient and faster. The embodiment also provides two control signal sending modes, including sending the control signals through communication connection and sending the control signals through infrared connection, so that the mobile terminal can quickly and conveniently control the intelligent display device under the condition of networking or non-networking.
In addition, according to the intelligent interaction method provided by this embodiment, on the premise of ensuring normal playing and displaying of currently played content in the intelligent display device, the user can view the installation state of the application in the intelligent display device at the mobile terminal side, and the mobile terminal controls the intelligent display device to manage the application at the background, so that convenience of the user in managing the application in the intelligent display device is improved. The embodiment also provides a mode of controlling the intelligent display device to download and install the application, update the application and uninstall the application at the background through the mobile terminal, so that the application in the intelligent display device is managed in a diversified manner.
FIG. 11 is a flowchart illustrating an intelligent interaction method according to yet another exemplary embodiment, which is illustrated in the implementation environment shown in FIG. 1. The intelligent interaction method can comprise the following steps:
in step 1101, the mobile terminal establishes a communication connection with the smart display device.
In step 1102, the smart display device obtains at least one item of associated information of the currently displayed content.
In step 1103, the smart display device provides at least one item of association information to the mobile terminal via the communication connection.
Correspondingly, the mobile terminal acquires at least one item of associated information of the current display content in the intelligent display device through communication connection.
In step 1104, the mobile terminal displays according to at least one item of association information.
In one embodiment, this step may include several substeps as follows:
firstly, when the obtained at least one item of associated information is a content identifier of the currently displayed content, the content identifier is sent to a server, and the server is configured to obtain other associated information corresponding to the content identifier.
And secondly, receiving other associated information sent by the server.
And thirdly, displaying according to other related information.
1. Displaying the program poster when the other associated information comprises the program poster and the other associated information further comprises at least one of program introduction, program rating, program comment and program recommendation; receiving a trigger signal for the program poster; and displaying at least one of the program brief description, the program score, the program comment and the program recommendation according to the trigger signal.
2. And when the other associated information comprises the electronic program list and/or the program preview, displaying the electronic program list and/or the program preview.
3. And when the other associated information comprises audio associated information, displaying the audio associated information.
4. And when the other associated information comprises the electronic book associated information, displaying the electronic book associated information.
It should be noted that, the above steps 1001 to 1003 can be implemented separately as an intelligent interaction method on the intelligent display device side; the steps 1001, 1003 and 1004 may be implemented separately as an intelligent interactive method on the mobile terminal side.
In summary, in the intelligent interaction method provided in this embodiment, a mobile terminal in communication connection with an intelligent display device is introduced, and at least one item of associated information of currently displayed content in the intelligent display device is obtained through the mobile terminal and is displayed according to the at least one item of associated information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the associated information in the intelligent display equipment is shared and displayed through the mobile terminal, so that the influence of the associated information on the normal display of the current display content in the intelligent display equipment is avoided, and the convenience for a user to check the associated information is improved.
FIG. 12 is a flowchart illustrating an intelligent interaction method according to yet another exemplary embodiment, which is illustrated in the implementation environment shown in FIG. 1. The intelligent interaction method can comprise the following steps:
in step 1201, the mobile terminal establishes a communication connection with the smart display device.
In step 1202, the mobile terminal receives interaction information triggered by a user for currently displayed content in the smart display device.
In step 1203, the mobile terminal sends the interaction information to the smart display device.
Correspondingly, the intelligent display device receives interactive information which is sent by the mobile terminal and is triggered by the user aiming at the current display content.
When the interactive information is comment information edited by the user for the currently displayed content in the intelligent display device, the above-mentioned steps 1202 and 1203 may include several sub-steps as follows:
first, comment information edited by a user for currently displayed content is received.
1. Receiving text information and/or picture information edited by a user aiming at the current display content, and determining the text information and/or the picture information as comment information.
2. And receiving voice information edited by a user aiming at the current display content, converting the voice information into corresponding text information, and determining the text information as comment information.
And secondly, sending the comment information to the intelligent display equipment.
In step 1204, the smart display device performs a corresponding interactive operation according to the interactive information.
When the interactive information is comment information edited by the user for the currently displayed content in the intelligent display device, the step 1204 may include the following sub-steps:
firstly, comment information which is sent by a mobile terminal and edited by a user aiming at the currently displayed content is received.
And secondly, displaying the comment information.
In one embodiment, the comment information is displayed in a bullet screen in a predetermined display area.
And thirdly, sending the comment information to a server, wherein the server is configured to send the comment information to at least one other intelligent display device for display.
It should be noted that, the above steps 1201 to 1203 may be implemented separately as an intelligent interaction method at the mobile terminal side; the steps 1201, 1203 and 1204 may be implemented separately as an intelligent interaction method on the intelligent display device side.
In summary, in the intelligent interaction method provided in this embodiment, by introducing the mobile terminal in communication connection with the intelligent display device, the mobile terminal sends interaction information triggered by the user for the currently displayed content to the intelligent display device, so that the intelligent display device executes corresponding interaction operation according to the interaction information; the problem that in the process of controlling the smart television through a remote controller or a mouse, the normal display of the current playing content in the smart television is influenced by a related control interface in the related technology is solved; the mobile terminal is used as a medium, and the human-computer interaction experience between the user and the intelligent display equipment is enriched.
In addition, the comment information edited by the user for the currently displayed content in the intelligent display device is received through the mobile terminal, the comment information is sent to the intelligent display device, and the comment information is displayed in real time by the intelligent display device, so that the instant, convenient and barrier-free communication among users is realized, the interactive experience between the users and the equipment is improved, and the participation of the users in television programs is enhanced.
Fig. 13 is a block diagram illustrating an apparatus 1300 for intelligent interaction, according to an example embodiment. For example, apparatus 1300 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a gaming console, a tablet device, a medical device, a fitness device, a personal digital assistant, and so forth.
Referring to fig. 13, the apparatus 1300 may include one or more of the following components: a processing component 1302, a memory 1304, a power component 1306, a multimedia component 1308, an audio component 1310, an input/output (I/O) interface 1312, a sensor component 1314, and a communications component 1316.
The processing component 1302 generally controls overall operation of the device 1300, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 1302 may include one or more processors 1320 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 1302 can include one or more modules that facilitate interaction between the processing component 1302 and other components. For example, the processing component 1302 may include a multimedia module to facilitate interaction between the multimedia component 1308 and the processing component 1302.
The memory 1304 is configured to store various types of data to support operations at the apparatus 1300. Examples of such data include instructions for any application or method configured to operate on the apparatus 1300, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1304 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
Power supply component 1306 provides power to the various components of device 1300. Power components 1306 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for device 1300.
The multimedia component 1308 includes a screen between the device 1300 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gesture on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1308 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the apparatus 1300 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 1310 is configured to output and/or input audio signals. For example, the audio component 1310 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 1300 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 1304 or transmitted via the communication component 1316. In some embodiments, audio component 1310 also includes a speaker configured to output audio signals.
The I/O interface 1312 provides an interface between the processing component 1302 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 1314 includes one or more sensors configured to provide various aspects of state assessment for the apparatus 1300. For example, the sensor assembly 1314 may detect an open/closed state of the device 1300, the relative positioning of components, such as a display and keypad of the device 1300, the sensor assembly 1314 may also detect a change in position of the device 1300 or a component of the device 1300, the presence or absence of user contact with the device 1300, orientation or acceleration/deceleration of the device 1300, and a change in temperature of the device 1300. The sensor assembly 1314 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1314 may also include a light sensor, such as a CMOS or CCD image sensor, configured for use in imaging applications. In some embodiments, the sensor assembly 1314 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 1316 is configured to facilitate communications between the apparatus 1300 and other devices in a wired or wireless manner. The apparatus 1300 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1316 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1316 also includes a Near Field Communications (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 1300 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components configured to perform the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 1304 comprising instructions, executable by the processor 1320 of the apparatus 1300 to perform the method described above is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium, wherein instructions of the storage medium, when executed by a processor of the apparatus 1300, enable the apparatus 1300 to perform the intelligent interaction method at the mobile terminal side in the embodiments shown in fig. 9A/9B/9C/10/11/12.
Fig. 14 is a block diagram illustrating an apparatus 1400 for intelligent interaction in accordance with another example embodiment. For example, the apparatus 1400 may be a smart television, a television box, or a combination of both.
Referring to fig. 14, apparatus 1400 may include one or more of the following components: a processing component 1402, a memory 1404, a power component 1406, a multimedia component 1408, an audio component 1410, an input/output (I/O) interface 1412, and a communications component 1416.
The processing component 1402 generally controls the overall operation of the device 1400, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing component 1402 may include one or more processors 1420 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 1402 can include one or more modules that facilitate interaction between processing component 1402 and other components. For example, the processing component 1402 can include a multimedia module to facilitate interaction between the multimedia component 1408 and the processing component 1402.
The memory 1404 is configured to store various types of data to support operations at the apparatus 1400. Examples of such data include instructions for any application or method operating on device 1400, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1404 may be implemented by any type of volatile or non-volatile storage device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power supply component 1406 provides power to the various components of the device 1400. The power components 1406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1400.
The multimedia component 1408 includes a screen that provides an output interface between the device 1400 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gesture on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1408 includes a front-facing camera and/or a rear-facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 1400 is in an operation mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 1410 is configured to output and/or input audio signals. For example, the audio component 1410 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 1400 is in operating modes, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 1404 or transmitted via the communication component 1416. In some embodiments, audio component 1410 further includes a speaker for outputting audio signals.
I/O interface 1412 provides an interface between processing component 1402 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The communication component 1416 is configured to facilitate wired or wireless communication between the apparatus 1400 and other devices. The device 1400 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1416 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1416 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 1400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as the memory 1404 that includes instructions executable by the processor 1420 of the apparatus 1400 to perform the above-described method. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium, wherein instructions of the storage medium, when executed by a processor of the apparatus 1400, enable the apparatus 1400 to perform the intelligent interaction method on the intelligent display device side in the embodiments shown in fig. 9A/9B/9C/10/11/12.
Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (13)

1. An intelligent interactive system, the system comprising: the mobile terminal comprises intelligent display equipment and a mobile terminal which is in communication connection with the intelligent display equipment;
the mobile terminal is configured to acquire the installation state of the application in the intelligent display device for any application, generating a control signal for application management according to the installation state, transmitting the control signal for application management to the smart display device through the communication connection or in the form of an infrared signal, wherein the signal for control management of application management includes any one of a control signal for application installation, a control signal for application update, and a control signal for application uninstallation, the control signal for application installation includes an application identification of the application or a download address of the application, the control signal for application update comprises an application identification of the application or an update package download address of the application, and the control signal for application uninstallation comprises an application identification of the application; the intelligent display device is configured to install the application according to the control signal for application installation when the control signal for application installation is received, or update the application according to the control signal for application update when the control signal for application update is received, or uninstall the application according to the control signal for application uninstall when the control signal for application uninstall is received;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback response is sent by the intelligent display device aiming at the broadcast inquiry sent by the mobile terminal in the same local area network.
2. The system of claim 1,
the mobile terminal is configured to display an installation control in a first preset area when the installation state is not installed, receive a first trigger signal acting on the installation control, generate a control signal for application installation according to the first trigger signal, and send the control signal for application installation to the intelligent display device; the intelligent display device is configured to download and install the application according to the control signal for application installation;
or,
the mobile terminal is configured to display an update control in a second predetermined area when the installation state is installed and needs to be updated, receive a second trigger signal acting on the update control, generate a control signal for application update according to the second trigger signal, and send the control signal for application update to the intelligent display device; the intelligent display device is configured to download and update the application according to the control signal for application update;
or,
the mobile terminal is configured to display an uninstalling control in a third predetermined area when the installation state is installed and needs to be updated or installed and does not need to be updated, receive a third trigger signal acting on the uninstalling control, generate a control signal for uninstalling an application according to the third trigger signal, and send the control signal for uninstalling the application to the intelligent display device; the intelligent display device is configured to uninstall the application according to the control signal for application uninstallation.
3. The system according to claim 1 or 2,
the mobile terminal is further configured to acquire broadcast information sent outwards by the intelligent display devices in the same local area network at preset time intervals; sending a broadcast query to the intelligent display devices in the same local area network; receiving a feedback response sent by the intelligent display device for the broadcast query; after the intelligent display equipment which can be connected at present is determined according to the broadcast information and the feedback response, a connection request is sent to the intelligent display equipment; correspondingly, the intelligent display device is also configured to send broadcast information outwards at preset time intervals; acquiring a broadcast query sent by the mobile terminal in the same local area network, and sending a feedback response aiming at the broadcast query to the mobile terminal; receiving a connection request sent by the mobile terminal, wherein the connection request is sent after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; and establishing the communication connection with the mobile terminal according to the connection request.
4. An intelligent interaction device, which is used in a mobile terminal with a communication connection with an intelligent display device, the device comprising: a device control module;
the device control module is configured to acquire an installation state of any application in the smart display device, generate a control signal for application management according to the installation state, and send the control signal for application management to the smart display device through the communication connection or in the form of an infrared signal, wherein the signal for control management of application management includes any one of a control signal for application installation, a control signal for application update, and a control signal for application uninstallation, and the smart display device is configured to install the application according to the control signal for application installation when the control signal for application installation is received, or update the application according to the control signal for application update when the control signal for application update is received, or, when the control signal for application uninstalling is received, uninstalling the application according to the control signal for application uninstalling; wherein the control signal for application installation comprises an application identifier of the application or a download address of the application, the control signal for application update comprises an application identifier of the application or an update package download address of the application, and the control signal for application uninstallation comprises an application identifier of the application;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback response is sent by the intelligent display device aiming at the broadcast inquiry sent by the mobile terminal in the same local area network.
5. An intelligent interaction device, which is used in an intelligent display device with a communication connection with a mobile terminal, the device comprising: a control response module;
the control response module is configured to receive a control signal for application management sent by the mobile terminal through the communication connection or in the form of an infrared signal, install the application according to the control signal for application installation if the control signal for application management is a control signal for application installation, update the application according to the control signal for application update if the control signal for application management is a control signal for application update, and uninstall the application according to the control signal for application uninstall if the control signal for application management is a control signal for application uninstall, wherein the control signal for application installation includes an application identifier of the application or a download address of the application, and the control signal for application update includes an application identifier of the application or an update package download address of the application, the control signal for application uninstalling comprises an application identifier of the application, and the control signal for application management is generated by the mobile terminal according to an installation state of the application in the intelligent display device after the installation state is acquired;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback response is sent by the intelligent display device aiming at the broadcast inquiry sent by the mobile terminal in the same local area network.
6. An intelligent interaction device, which is used in a mobile terminal with a communication connection with an intelligent display device, the device comprising:
a processor;
a memory for storing executable instructions of the processor;
wherein the processor is configured to:
for any application, obtaining an installation state of the application in the smart display device, generating a control signal for application management according to the installation state, and sending the control signal for application management to the smart display device through the communication connection or in the form of an infrared signal, wherein the signal for control management for application management includes any one of a control signal for application installation, a control signal for application update, and a control signal for application uninstallation, the smart display device is configured to install the application according to the control signal for application installation when the control signal for application installation is received, or update the application according to the control signal for application update when the control signal for application update is received, or, when the control signal for application uninstalling is received, uninstalling the application according to the control signal for application uninstalling; wherein the control signal for application installation comprises an application identifier of the application or a download address of the application, the control signal for application update comprises an application identifier of the application or an update package download address of the application, and the control signal for application uninstallation comprises an application identifier of the application;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback response is sent by the intelligent display device aiming at the broadcast inquiry sent by the mobile terminal in the same local area network.
7. An intelligent interaction device, which is used in an intelligent display device with a communication connection with a mobile terminal, the device comprising:
a processor;
a memory for storing executable instructions of the processor;
wherein the processor is configured to:
receiving a control signal for application management sent by the mobile terminal through the communication connection or in the form of an infrared signal, if the control signal for application management is a control signal for application installation, installing the application according to the control signal for application installation, if the control signal for application management is a control signal for application update, updating the application according to the control signal for application update, if the control signal for application management is a control signal for application uninstallation, uninstalling the application according to the control signal for application uninstallation, wherein the control signal for application management is generated according to an installation state of the application after the mobile terminal acquires the installation state of the application in the intelligent display device, and the control signal for application installation includes an application identifier of the application or a download address of the application, the control signal for application update comprises an application identification of the application or an update package download address of the application, and the control signal for application uninstallation comprises an application identification of the application;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback response is sent by the intelligent display device aiming at the broadcast inquiry sent by the mobile terminal in the same local area network.
8. An intelligent interaction method, which is used in a mobile terminal with a communication connection with an intelligent display device, the method comprising:
for any application, acquiring an installation state of the application in the intelligent display device, generating a control signal for application management according to the installation state, and sending the control signal for application management to the intelligent display device through the communication connection or in the form of an infrared signal, wherein the signal for control management for application management comprises any one of a control signal for application installation, a control signal for application update and a control signal for application uninstallation, and the intelligent display device is configured to install the application according to the control signal for application installation when receiving the control signal for application installation, or update the application according to the control signal for application update when receiving the control signal for application update, or, when receiving the control signal for application uninstallation, unloading the application according to the control signal for application unloading, wherein the control signal for application installation comprises an application identifier of the application or a download address of the application, the control signal for application update comprises an application identifier of the application or an update package download address of the application, and the control signal for application unloading comprises an application identifier of the application;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback response is sent by the intelligent display device aiming at the broadcast inquiry sent by the mobile terminal in the same local area network.
9. The method of claim 8, wherein generating control signals for application management based on the installation status comprises:
when the installation state is not installed, displaying an installation control in a first preset area, receiving a first trigger signal acting on the installation control, and generating a control signal for application installation according to the first trigger signal, wherein the control signal for application installation is used for triggering the mobile terminal to download and install the application;
or,
when the installation state is installed and needs to be updated, displaying an update control in a second preset area, receiving a second trigger signal acting on the update control, and generating a control signal for updating an application according to the second trigger signal, wherein the control signal for updating the application is used for triggering the mobile terminal to download and update the application;
or,
when the installation state is installed and needs updating or installed and does not need updating, displaying an unloading control in a third preset area, receiving a third trigger signal acting on the unloading control, and generating a control signal for application unloading according to the third trigger signal, wherein the control signal for application unloading is used for triggering the mobile terminal to unload the application.
10. The method according to claim 8 or 9, characterized in that the method further comprises:
acquiring broadcast information sent outwards by the intelligent display equipment in the same local area network at preset time intervals; sending a broadcast query to the intelligent display devices in the same local area network; receiving a feedback response sent by the intelligent display device for the broadcast query; and after the intelligent display equipment which can be connected at present is determined according to the broadcast information and the feedback response, sending a connection request to the intelligent display equipment, wherein the intelligent display equipment is configured to establish the communication connection with the mobile terminal according to the connection request.
11. An intelligent interaction method, which is used in an intelligent display device with a communication connection with a mobile terminal, the method comprises:
receiving a control signal for application management sent by the mobile terminal through the communication connection or in the form of an infrared signal, if the control signal for application management is a control signal for application installation, installing the application according to the control signal for application installation, if the control signal for application management is a control signal for application update, updating the application according to the control signal for application update, if the control signal for application management is a control signal for application uninstallation, uninstalling the application according to the control signal for application uninstallation, wherein the control signal for application installation includes an application identifier of the application or a download address of the application, and the control signal for application update includes an application identifier of the application or a download address of a package of the application update, the control signal for application unloading comprises an application identifier of the application, and the control signal for application management is generated according to an installation state of the application in the intelligent display equipment after the control signal for application management is acquired by the mobile terminal;
the communication connection is established by the mobile terminal sending a connection request to the intelligent display equipment after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; the broadcast information is sent out by the intelligent display device in the same local area network with the mobile terminal at preset time intervals, and the feedback response is sent by the intelligent display device aiming at the broadcast inquiry sent by the mobile terminal in the same local area network.
12. The method of claim 11, wherein managing the application according to the control signal for application management comprises:
when the control signal for application management is a control signal for application installation, downloading and installing the application according to the control signal for application installation; when the mobile terminal acquires that the installation state is not installed, displaying an installation control in a first preset area, receiving a first trigger signal acting on the installation control, and generating the control signal for application installation according to the first trigger signal;
or,
when the control signal for application management is a control signal for application update, downloading and updating the application according to the control signal for application update; when the mobile terminal acquires that the installation state is installed and needs to be updated, displaying an update control in a second preset area, receiving a second trigger signal acting on the update control, and generating the control signal for application update according to the second trigger signal;
or
When the control signal for application management is a control signal for application uninstallation, uninstalling the application according to the control signal for application uninstallation; when the mobile terminal acquires that the installation state is installed and needs updating or installed and does not need updating, the control signal for application unloading displays an unloading control in a third preset area, receives a third trigger signal acting on the unloading control, and generates the control signal according to the third trigger signal.
13. The method according to claim 11 or 12, characterized in that the method further comprises:
sending broadcast information outwards at preset time intervals; acquiring a broadcast query sent by the mobile terminal in the same local area network, and sending a feedback response aiming at the broadcast query to the mobile terminal; receiving a connection request sent by the mobile terminal, wherein the connection request is sent after the mobile terminal determines the intelligent display equipment which can be connected currently according to the broadcast information and the feedback response; and establishing the communication connection with the mobile terminal according to the connection request.
CN201410174252.6A 2014-04-28 2014-04-28 intelligent interactive system, device and method Active CN103997688B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410174252.6A CN103997688B (en) 2014-04-28 2014-04-28 intelligent interactive system, device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410174252.6A CN103997688B (en) 2014-04-28 2014-04-28 intelligent interactive system, device and method

Publications (2)

Publication Number Publication Date
CN103997688A CN103997688A (en) 2014-08-20
CN103997688B true CN103997688B (en) 2018-09-04

Family

ID=51311672

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410174252.6A Active CN103997688B (en) 2014-04-28 2014-04-28 intelligent interactive system, device and method

Country Status (1)

Country Link
CN (1) CN103997688B (en)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104159149A (en) * 2014-08-26 2014-11-19 吴松珀 Multi-user mouse based screen information interaction method, device and system
CN106797500B (en) * 2014-09-11 2020-08-14 索尼互动娱乐股份有限公司 Video transmission device, terminal, video transmission system, control method, program, and information storage medium
CN105491096A (en) * 2014-10-08 2016-04-13 宇龙计算机通信科技(深圳)有限公司 Method and device for controlling device states
CN105589852B (en) * 2014-10-20 2019-09-03 阿里巴巴集团控股有限公司 A kind of method and apparatus of information recommendation
CN105635845B (en) * 2014-10-31 2021-04-02 腾讯科技(上海)有限公司 Session content transmission method and device
CN105763948A (en) * 2014-12-17 2016-07-13 深圳市九洲电器有限公司 Set top box control method and system thereof
CN104602098A (en) * 2015-01-04 2015-05-06 深圳市同洲电子股份有限公司 Video barrage display method and equipment thereof
CN104618813B (en) * 2015-01-20 2018-02-13 腾讯科技(北京)有限公司 Barrage information processing method, client and service platform
CN104618797B (en) * 2015-02-06 2018-02-13 腾讯科技(北京)有限公司 Information processing method, device and client
CN105992046B (en) * 2015-02-26 2020-07-07 阿里巴巴集团控股有限公司 Business data pushing method, device and system
CN104780446B (en) * 2015-03-19 2018-07-27 四川长虹电器股份有限公司 A kind of method that striding equipment integrates application shop
CN104869437B (en) * 2015-03-20 2018-01-12 四川长虹电器股份有限公司 Bidirectional terminal barrage implementation method based on Conditional Access of Digital Television
CN104822093B (en) 2015-04-13 2017-12-19 腾讯科技(北京)有限公司 Barrage dissemination method and device
CN104869500B (en) * 2015-04-16 2018-01-19 广东欧珀移动通信有限公司 Comment barrage methods of exhibiting, the apparatus and system of intelligent radio audio amplifier
CN104767832A (en) * 2015-04-30 2015-07-08 西安电子科技大学 Interactive display method for display screens
CN104935980B (en) 2015-05-04 2019-03-15 腾讯科技(北京)有限公司 Interactive information processing method, client and service platform
CN105213192A (en) * 2015-06-23 2016-01-06 深圳市美贝壳科技有限公司 A kind of tcm health preserving clock system and method for work thereof
CN105159523A (en) * 2015-07-31 2015-12-16 小米科技有限责任公司 Target function enabling method, apparatus and system
CN105872646A (en) * 2015-12-10 2016-08-17 乐视网信息技术(北京)股份有限公司 Bullet screen comment input method and device, and bullet screen comment display method and device
CN105611345A (en) * 2015-12-20 2016-05-25 天脉聚源(北京)科技有限公司 User interactive information configuration method and device for interactive TV system
CN105592335A (en) * 2015-12-20 2016-05-18 天脉聚源(北京)科技有限公司 Method and device of interactive TV system for configuring interactive information
CN105611347A (en) * 2015-12-20 2016-05-25 天脉聚源(北京)科技有限公司 Method and device for configuring interactive information for users of interactive TV system
CN105959384A (en) * 2016-06-10 2016-09-21 北京行云时空科技有限公司 Intelligent interaction method and system
CN106528137A (en) * 2016-10-11 2017-03-22 深圳市天易联科技有限公司 Method and apparatus for conversation with virtual role
CN106534558B (en) * 2016-11-25 2019-11-12 重庆杰夫与友文化创意有限公司 Control the method and device of projector
CN106792072B (en) * 2016-12-28 2019-05-17 苏州商信宝信息科技有限公司 The method and its system of barrage and video are shown under a kind of separating medium
CN107071544A (en) * 2016-12-31 2017-08-18 天脉聚源(北京)科技有限公司 The method and apparatus that display user gives out information
CN106828101A (en) * 2017-01-22 2017-06-13 斑马信息科技有限公司 Automobile instrument and middle control interactive system and method
CN106993211A (en) * 2017-03-24 2017-07-28 百度在线网络技术(北京)有限公司 Web TV control method and device based on artificial intelligence
CN107690082A (en) * 2017-09-08 2018-02-13 北京百变悟空科技有限公司 A kind of information shows method and device across screen
WO2019051837A1 (en) * 2017-09-18 2019-03-21 Arris Enterprises Llc Multimedia bullet screen on tv via remote control input device and set top box
CN107743255A (en) * 2017-10-30 2018-02-27 四川长虹电器股份有限公司 The method and system of intelligent television and multiple mobile terminals synchronous interaction
CN107770612B (en) * 2017-11-03 2020-09-08 中广热点云科技有限公司 Hidden processing method of television program information and auxiliary glasses terminal
CN108762489B (en) * 2018-05-07 2021-09-21 武汉灏存科技有限公司 Control method based on data glove, system and storage medium
CN109189413A (en) * 2018-08-24 2019-01-11 广州优视网络科技有限公司 Using the monitor method, device and electronic equipment of unloading
CN109324531B (en) * 2018-10-17 2020-05-05 普联技术有限公司 Guest room control method, Guest room controller and Guest room control system
CN112351322B (en) * 2019-08-09 2022-08-23 荣耀终端有限公司 Terminal device, method and system for realizing touch screen projection through remote controller
CN112770152B (en) * 2020-12-21 2023-03-24 深圳创维-Rgb电子有限公司 Method, system and equipment for displaying intelligent television information and computer storage medium
CN115079876B (en) * 2021-03-12 2024-07-12 北京字节跳动网络技术有限公司 Interactive method, device, storage medium and computer program product
CN115052020B (en) * 2022-06-23 2024-02-02 阿波罗智联(北京)科技有限公司 Device interconnection system, method, device and connecting device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1429561A2 (en) * 2002-12-11 2004-06-16 Broadcom Corporation Personal inter-home media exchange network
CN103581706A (en) * 2013-10-11 2014-02-12 青岛海信传媒网络技术有限公司 Method and system for installing applications of smart television
CN103607659A (en) * 2013-11-25 2014-02-26 小米科技有限责任公司 Method, device and server for displaying program comments on intelligent display equipment
CN103648006A (en) * 2013-12-20 2014-03-19 深圳创维-Rgb电子有限公司 Interaction method and system of mobile device and television, and computer readable medium
CN103702144A (en) * 2013-12-13 2014-04-02 深圳市同洲电子股份有限公司 Method and system for intelligently associating information

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101815162B (en) * 2010-04-27 2012-12-05 四川长虹电器股份有限公司 System for remote control of programs
CN102291609A (en) * 2011-08-25 2011-12-21 北京天地云箱科技有限公司 Control method and system of set top box
CN103581725A (en) * 2013-09-27 2014-02-12 深圳市同洲电子股份有限公司 Method for controlling smart TV terminal through mobile terminal and relevant terminals
CN103618956A (en) * 2013-11-13 2014-03-05 深圳市同洲电子股份有限公司 Method for obtaining video associated information and mobile terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1429561A2 (en) * 2002-12-11 2004-06-16 Broadcom Corporation Personal inter-home media exchange network
CN103581706A (en) * 2013-10-11 2014-02-12 青岛海信传媒网络技术有限公司 Method and system for installing applications of smart television
CN103607659A (en) * 2013-11-25 2014-02-26 小米科技有限责任公司 Method, device and server for displaying program comments on intelligent display equipment
CN103702144A (en) * 2013-12-13 2014-04-02 深圳市同洲电子股份有限公司 Method and system for intelligently associating information
CN103648006A (en) * 2013-12-20 2014-03-19 深圳创维-Rgb电子有限公司 Interaction method and system of mobile device and television, and computer readable medium

Also Published As

Publication number Publication date
CN103997688A (en) 2014-08-20

Similar Documents

Publication Publication Date Title
CN103997688B (en) intelligent interactive system, device and method
CN111327769B (en) Multi-screen interaction method and device and storage medium
JP6423445B2 (en) Multimedia data reproduction method, apparatus and system
CN107391273B (en) Message display method, message pushing method and device
CN104010222A (en) Method, device and system for displaying comment information
CN101896949B (en) Remote control protocol for media systems controlled by portable devices
US10237901B2 (en) Method and apparatus for connecting with controlled smart device, and storage medium
CN103986969B (en) application management method, device and system
CN103997676A (en) Information display method, information display device and information display system
CN111357297A (en) Reverse projection from a first screen device to a second screen device
US20160366461A1 (en) Method and Device for Mobile Communication Terminal to Control Smart TV to Play Video File
CN107526591B (en) Method and device for switching types of live broadcast rooms
JP2020517206A (en) Communication method, device and system in live broadcast channel
CN103997669A (en) Equipment control method, equipment control device and equipment control system
CN109525966B (en) Intelligent device query method and device and storage medium
CN110737844B (en) Data recommendation method and device, terminal equipment and storage medium
US11523146B2 (en) Live broadcast method and apparatus, electronic device, and storage medium
CN113099262B (en) Information display method and device, electronic equipment and storage medium
CN104202561A (en) Method and device for playing stream media data
CN105872573A (en) Video playing method and apparatus
CN113988021A (en) Content interaction method and device, electronic equipment and storage medium
CN110913276B (en) Data processing method, device, server, terminal and storage medium
CN105376318A (en) File transmission method, device and system
CN106535000A (en) Method and device for sending social contact information
CN110430383A (en) Terminal, signal server, audio/video communication method and computer storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant