CN113407241A

CN113407241A - Interactive configuration method, device and system and electronic equipment

Info

Publication number: CN113407241A
Application number: CN202010182829.3A
Authority: CN
Inventors: 单瑛; 杨莉; 顾文杰; 郑浩; 张涛
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-03-16
Filing date: 2020-03-16
Publication date: 2021-09-17

Abstract

The embodiment of the specification relates to an interactive configuration method, an interactive configuration device, an interactive configuration system and electronic equipment, wherein the method comprises the following steps: acquiring equipment information of target equipment with interactive attribute, wherein the equipment information comprises at least one of equipment type and an interactive object of the target equipment; and matching the corresponding interactive end control for the target equipment according to the equipment information.

Description

Interactive configuration method, device and system and electronic equipment

Technical Field

The embodiment of the specification relates to the technical field of human-computer interaction, and more particularly, to an interaction configuration method of a device, an interaction configuration device of the device, an electronic device, an interaction configuration system, and a computer-readable storage medium.

Background

For a device with an interactive attribute (hereinafter, referred to as an interactive device), the control terminal may exchange information with the device through an internet of things technology, and a user may perform human-computer interaction with the interactive device through the control terminal for an interactive object of the interactive device. Since different kinds of interactable devices usually have different interaction objects, e.g., one kind of interactable device has an interaction object that is a switch of the device, another kind of interactable device has an interaction object that is a volume adjustment, yet another kind of interactable device has an interaction object that is a human-computer conversation, and so on. For these interactive devices with different interactive objects, in the prior art, dedicated interactive applications need to be developed for each type of interactive device, so as to implement the purpose of interacting with the adapted interactive device by installing the client of the interactive application on the control terminal, that is, in the prior art, any interactive application has fixed interactive content, and a user can interact with only one type of interactive device through any interactive application, and any interactive application does not have compatibility with different types of interactive devices. Therefore, if a user wants to perform interaction with a plurality of different interactive devices through the control terminal, a plurality of interactive applications need to be developed and installed, which inevitably causes problems of high development cost, complex operation and the like, and therefore, it is necessary to provide an interactive configuration scheme capable of dynamically adjusting interactive contents to adapt to the plurality of interactive devices.

Disclosure of Invention

The embodiment of the specification provides a new technical scheme for carrying out interactive configuration on interactive equipment.

According to a first aspect of the present invention, there is provided an embodiment of control matching for devices of different attributes, comprising:

acquiring equipment information of target equipment with interactive attribute, wherein the equipment information comprises at least one of equipment type and an interactive object of the target equipment;

and matching a corresponding interactive end control for the target equipment according to the equipment information.

Optionally, the interactive end control includes at least one control of an input control and an output control, where the input control is a control for controlling an interactive object possessed by the target device, and the output component is a control for displaying a state of the interactive object.

Optionally, the device information includes an interaction object that the target device has, and the interaction object includes at least one of a switch of the device, audio playing, man-machine conversation, and index adjustment.

Optionally, the matching, according to the device information, a corresponding interactive end control for the target device includes:

acquiring the interaction type of the target equipment according to the equipment information;

matching a corresponding interaction end control for the target equipment in a preset object model library according to the interaction category of the target equipment;

the object model library is defined with various object models, one object model represents one interaction category, different object models represent different interaction categories, and each object model reflects an interaction end control corresponding to the represented interaction category.

Optionally, the method further comprises the step of creating any of the object models, including:

according to the operation of defining any object model, obtaining defined object model information, wherein the object model information comprises matched interaction types and interaction end controls;

and creating the defined corresponding object model according to the object model information.

Optionally, the method further comprises:

establishing a communication connection with the target equipment;

after the communication connection is established, searching a matching record of the target device;

and under the condition that the matching record is not found, executing the operation of matching the corresponding interactive end control for the target equipment, and generating the matching record of the target equipment according to the matching result.

Optionally, the method further comprises:

searching a matching record of the target equipment according to the request for viewing the target equipment;

Optionally, the method further comprises:

and configuring the interactive end to provide the matched interactive end control according to the request for viewing the target equipment.

Optionally, the interactive end control includes an input control, and the method further includes:

and controlling the target equipment to execute corresponding operation according to a control command triggered by the provided input control.

Optionally, the interactive end control further includes an output control, and the method further includes:

acquiring the current state of an interactive object of the target equipment;

and configuring the provided output control to display corresponding to the current state.

According to a second aspect of the present invention, there is also provided another embodiment of an interactive configuration method, implemented by a control terminal, including:

acquiring target equipment to be checked;

and providing an interactive end control matched with the equipment information of the target equipment, wherein the equipment information comprises at least one item of equipment type and an interactive object which the target equipment has.

responding to a control command triggered by the input control, and identifying the content of the control command according to an interactive object corresponding to the input control;

and controlling the interactive object to execute corresponding operation according to the content of the control command.

Optionally, the interactive end control includes an output control, and the method further includes:

acquiring state information of the target equipment;

extracting the current state of the interactive object from the state information according to the interactive object corresponding to the output control;

and configuring the output control to display corresponding to the current state.

Optionally, the acquiring the target device to be viewed includes:

providing a selection interface in response to an operation of selecting a target device;

and acquiring the equipment selected by the selection interface as the target equipment.

Optionally, the providing a selection interface includes:

all devices currently connected or connected are provided in the selection interface for selection.

According to a third aspect of the present invention, there is provided an embodiment of an interaction configuration apparatus, comprising:

the information acquisition module is used for acquiring equipment information of target equipment with interactive attributes, wherein the equipment information comprises at least one of equipment type and interactive objects of the target equipment; and the number of the first and second groups,

and the matching module is used for matching the corresponding interactive end control for the target equipment according to the equipment information.

According to a fourth aspect of the present invention, there is provided yet another embodiment of an interactive configuration apparatus, comprising:

the device selection module is used for acquiring target devices to be checked; and the number of the first and second groups,

and the interaction processing module is used for providing an interaction end control matched with the equipment information of the target equipment, wherein the equipment information comprises at least one item of equipment type and an interaction object which the target equipment has.

According to a fifth aspect of the present invention, there is also provided an electronic device, which includes the interaction configuration apparatus according to the third aspect or the fourth aspect of the present invention.

According to a sixth aspect of the present invention, there is also provided an interaction matching system, comprising:

a server comprising a memory and a processor, the memory of the server for storing executable commands; the processor of the server is adapted to perform the method according to the first aspect of the invention under control of the executable command; and the number of the first and second groups,

the control terminal comprises a memory and a processor, wherein the memory of the control terminal is used for storing executable commands; the processor of the control terminal is adapted to perform the method according to the second aspect of the invention under control of the executable command.

According to a seventh aspect of the present description, there is also provided an embodiment of a computer-readable storage medium storing executable instructions that, when executed by a processor, perform the method according to the first or second aspect of the present description.

In an embodiment, the method of the embodiment can match corresponding interactive end controls for interactive devices with different interactive objects, so as to realize interaction with multiple interactive devices, and improve the capability of adapting to different interactive devices by interactive application.

Other features of the present description and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the specification and together with the description, serve to explain the principles of the specification.

FIG. 1 is a schematic diagram of a scenario in which an interaction configuration method of an embodiment may be implemented;

FIG. 2 is a hardware configuration block diagram of an interactive configuration system that may be used to implement the interactive configuration method of one embodiment;

FIG. 3 is a flow diagram of an interactive configuration method according to one embodiment;

FIG. 4 is a flowchart illustration of an interaction configuration method according to another embodiment;

FIG. 5 is a functional block diagram of an interaction configuration apparatus according to one embodiment;

FIG. 6 is a functional block diagram of an interaction configuration apparatus according to another embodiment;

FIG. 7 is a block diagram of an interaction configuration system, according to one embodiment;

FIG. 8 is a flow diagram illustrating an alternative embodiment of interaction with an interactable device via an example interaction configuration system.

Detailed Description

Various exemplary embodiments of the present specification will now be described in detail with reference to the accompanying drawings.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.

Fig. 1 is a schematic application scenario diagram of an interaction configuration method according to an embodiment.

In this embodiment, as shown in fig. 1, the control terminal 1200 is an electronic device that interacts with an interactive device according to an operation of a user, and the control terminal 1200 may be installed with an interactive application, where the interactive application may be a local application or a web application, and is not limited herein, and the interactive application supports the control terminal 1200 to interact with multiple types of interactive devices, where different types of interactive devices have different interactive objects.

The interactive device may be any device having an interactive attribute, the interactive object of the interactive device may include at least one of a switch of the device, an adjustment of an index, a selection of an operation mode, a man-machine conversation, an audio playing, and the like, and the plurality of interactive devices may include, for example, a lamp supporting switch control, a camera supporting switch control and gesture adjustment, a robot supporting man-machine conversation, a smart speaker supporting audio playing, and the like, which are not limited herein. An interactable device may have one interactive object, or may have at least two interactive objects, which is not limited herein.

In this embodiment, the interactive application may configure an interactive end control corresponding to each interactive application for each interactive device or each interactive object, where the interactive end control may include at least one of an input control and an output control, where the input control is a control for a user to control the corresponding interactive object, the output control is a control for showing a state of the corresponding interactive object, taking a switch of the device as the interactive object as an example, the corresponding input control may include a switch control for triggering a switch command, and the corresponding output control may include an indication control capable of changing a color according to a switch state, and the like.

As shown in fig. 1, when a user interacts with any of the interactable devices through the control terminal 1200, a device list interface provided by the interactive application may be entered through the control terminal 1200, the interactive application is, for example, in response to an operation to select a device to view, entering the device list interface, the device list interface may load list items that display all interactable devices that have established a connection or have established a connection, for user selection, e.g. including list items of device 1, device 2, ….. device n, etc., the user may enter the interactive interface of the selected interactable device by clicking on the list item of the interactable device to be viewed, the control terminal 1200 will configure the interactive interface according to the interaction with the interactable device, and providing a matched interactive end control on the interactive interface, so that the user can interact with the interactive equipment to be viewed through the interactive end control. For example, as shown in fig. 1, a user needs to view the device 1, and may enter the interactive interface of the device 1 by clicking a list item of the device 1, and the control terminal 1200 provides, according to the interactive configuration of the device 1, an interactive end control matched with an interactive object of the device 1 on the interactive interface of the device 1, so that the user interacts with the device 1 through the control terminal 1200. For another example, as shown in fig. 1, a user needs to view the device 2, and may enter the interactive interface of the device 2 by clicking a list item of the device 2, and the control terminal 1200 provides, according to the interactive configuration performed on the device 2, an interactive end control matched with an interactive object that the device 2 has on the interactive interface of the device 2, so that the user interacts with the device 2 through the control terminal 1200.

Therefore, according to the method of the embodiment, the interactive application can match the corresponding interactive end control for the interactive equipment with different interactive objects, so that interaction with various interactive equipment is realized, the capability of the interactive application for adapting to different interactive equipment is improved, and compared with the realization that only one interactive equipment can be adapted, the interactive application according to the embodiment can provide richer interactive contents, so that the customized research and development cost is reduced.

In another application scenario, a display terminal physically independent of the control terminal 1200 may be further configured to at least display an output control in the interactive end control, where the display terminal is, for example, a large display screen or an oversized display screen beneficial to product display, so that a user can conveniently perform product display facing more audiences related to the interactive device through the control terminal 1200 and the display terminal 1200.

< hardware Equipment >

Fig. 2 is a schematic structural diagram of an interactive configuration system to which the interactive configuration method according to an embodiment of the present specification can be applied.

As shown in fig. 2, the interactive configuration system 1000 of the present embodiment may include a server 1100, a control terminal 1200, a display terminal 1300, and a network 1400.

The control terminal 1200 and the display terminal 1300 may be separate physical entities. The control terminal 1200 and the display terminal 1300 may be the same physical entity, and are not limited herein.

The interactable device 2000 and at least one of the server 1100 and the control terminal 1200 may be communicatively coupled via the network 1400 to connect the interactable device 2000 to the interactive configuration system.

The control terminal 1200 and the server 1100 may be in communication connection through the network 1400, so that the control terminal 1200 can provide an interactive end control matched by the server 1100 for the controlled device 2000, or the server 1100 can provide an object model library for configuring the interactive end control to the control terminal 1200, so that the control terminal 1200 configures a corresponding interactive end control for the interactive device according to the object model library, and the like.

The display terminal 1300 and at least one of the server 1100 and the control terminal 1200 may be communicatively connected through a network 1400, so that the configured interactive end control can be displayed through the display terminal 1300.

The server 1100 may be, for example, a blade server, a rack server, or the like, and the server 1100 may also be a server cluster deployed in a cloud, which is not limited herein.

As shown in fig. 1, the server 1100 may include a processor 1110, a memory 1120, an interface device 1130, and a communication device 1140. Processor 1110 is configured to execute program instructions that may employ an instruction set of architectures such as x86, Arm, RISC, MIPS, SSE, and the like. The memory 1120 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1130 includes, for example, a USB interface, a serial interface, and the like. The communication device 1140 is capable of wired or wireless communication, for example.

In this embodiment, the memory 1120 of the server 1100 is configured to store instructions for controlling the processor 1110 to operate to implement or support the implementation of the interaction configuration method according to at least some embodiments. The skilled person can design the instructions according to the solution disclosed in the present specification. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.

Those skilled in the art will appreciate that although a plurality of devices of the server 1100 are shown in fig. 2, the server 1100 of the embodiments of the present specification may refer to only some of the devices, such as the processor 1110, the memory 1120, and the communication device 1140, and is not limited thereto.

As shown in fig. 2, the control terminal 1200 may include a processor 1210, a memory 1220, an interface device 1230, a communication device 1240, a display device 1250, an input device 1260, a speaker 1270, a microphone 1280, and the like. The processor 1210 may be a central processing unit CPU, a microprocessor MCU, or the like. The memory 1220 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1230 includes, for example, a USB interface, a headphone interface, and the like. The communication device 1240 can perform wired or wireless communication, for example. The display device 1250 is, for example, a liquid crystal display, a touch display, or the like. The input device 1260 may include, for example, a touch screen, a keyboard, and the like. Control terminal 1200 may output audio information through speaker 1270. The control terminal 1200 may pick up voice information input by the user through the microphone 1280.

The control terminal 1200 may be a smart phone, a laptop computer, a desktop computer, a tablet computer, etc., and is not limited herein.

In this embodiment, the memory 1220 of the control terminal 1200 is used for storing instructions for controlling the processor 1210 to operate to implement or support the implementation of the interaction configuration method according to at least some embodiments of the present description. The skilled person can design the instructions according to the solution disclosed in the present specification. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.

It should be understood by those skilled in the art that although a plurality of devices of the control terminal 1200 are shown in fig. 2, the control terminal 1200 of the embodiment of the present specification may refer to only some of the devices, and is not limited herein.

As shown in fig. 2, the display terminal 1300 may include a processor 1310, a memory 1320, an interface device 1330, a communication device 1340, and the like. The processor 1310 may be a central processing unit CPU, a microprocessor MCU, or the like. The memory 1320 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface 1330 includes, for example, a USB interface, a headphone interface, an RJ45 interface, and the like. The communication device 1340 is capable of wired or wireless communication, for example.

The display terminal 1300 may be a large screen or an ultra-large screen display, etc. to visually display at least the state of the interactive object.

As shown in fig. 2, the interactable apparatus 2000 may include a processor 2110, a memory 2120, an interface device 2130, a communication device 2140, and the like. The processor 2110 may be a central processing unit CPU, a microprocessor MCU, or the like. The memory 2120 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 2330 includes, for example, a USB interface, a headphone interface, an RJ45 interface, and the like. The communication device 2340 is capable of wired or wireless communication, for example.

The memory 2120 is configured to store instructions for controlling the processor 2110 to operate at least to: executing a corresponding action according to a control command, the control command being triggered by a user via the control terminal 1200; and reporting the real-time state of the interactive object to the server 1100 or the control terminal 1200, so that the display terminal 1300 performs visual display and the like.

The communication network 1400 may be a wireless network or a wired network, and may be a local area network or a wide area network.

The interactive configuration system 1000 shown in fig. 2 is illustrative only and is not intended to limit the present specification, its applications, or uses in any way. For example, although fig. 2 shows only one server 1100, one control terminal 1200, one display terminal 1300, and one interactable device 2000, it is not meant to limit the respective numbers, and the interaction configuration system 1000 may involve at least one of a plurality of servers 1100, a plurality of control terminals 1200, a plurality of display terminals 1300, and a plurality of interactable devices 2000.

< method embodiment I >

The embodiment provides an interactive configuration method, which may be implemented by any electronic device running an interactive application for implementing the interactive configuration method, where the interactive application may be a local application, a web application, or the like. The electronic device may be implemented by the server 1100 in fig. 2, or the control terminal 1200 in fig. 2, which is not limited herein.

Fig. 3 shows a flowchart of the interactive configuration method of the present embodiment. As shown in fig. 3, the interaction method of the present embodiment may include the following steps S3100 to S3200:

in step S3100, device information of a device having an interactable attribute is acquired.

The device with the interactive property is marked as an interactive device, namely a target device which needs to be controlled through the control terminal.

In one embodiment, the device information may include a device type.

The device type may be determined according to a device name, a device model, etc. provided by the interactable device after establishing a connection with the electronic device. For example, the device type of the interactable device is a light, a camera, a smart speaker, or a robot, among others.

In one embodiment, the device information may include interactive objects that the device has. The interactive object comprises at least one of a switch of the device, an adjustment of the index, a selection of an operation mode, a man-machine conversation, an audio playback, etc., for example. The index may be volume, position in a particular direction, brightness, etc. The man-machine conversation involves voice pickup and the like.

In this embodiment, the interactive object of the interactable device can be obtained according to the device type. Here, for example, a comparison table reflecting a mapping relationship between the device type and the interactive object may be prestored, so that after the device type of the interactive device is known, the interactive object corresponding to the device type may be searched according to the comparison table, and used as the interactive object possessed by the interactive device.

For example, interactive objects that a lamp-like interactable device has include switches of the device, and may also include adjustments of the brightness range, and the like. As another example, a camera-like interactable device has interaction objects that include adjustment of upward deflection, adjustment of downward deflection, adjustment of leftward deflection, adjustment of downward deflection, and so forth. As another example, the smart-speaker-like interactive device may have interactive objects including a switch of the device, volume adjustment, audio playback control, and the like.

In this embodiment, the interactable device may also provide the interactive object itself after establishing the connection, which is not limited herein.

In one embodiment, the device information may also include a device type and an interaction object that the device has.

Step S3200, matching a corresponding interactive end control for the interactive device according to the device information.

In this embodiment, the interactive end control may include at least one of an input control and an output control.

The input control is used for a user to operate to control a corresponding interactive object, which may also be referred to as a control end control, and the input control includes, for example, a switch control shown in fig. 1, an index adjustment control shown in fig. 1, an audio playing control, a dialog control (including a voice pickup control), and the like.

The output control is used for displaying the state of the corresponding interactive object, which may also be referred to as a display end control, and the display end control can reflect the implementation state of the interactive object, such as a switch state, an index state, an audio playing state, a voice output state, and the like.

After configuring the corresponding interactable control for the interactable device, if the user needs to view the interactable device, the control terminal 1200 may provide the interactable control; the interactable control can also be provided by the control terminal 1200 and displayed by the display terminal 1300; the input controls may also be provided by the control terminal 1200, and the output controls may be displayed by the display terminal 1300, without limitation.

In one embodiment, a mapping relationship between the device information and the interactive end control may be established, so as to match a corresponding interactive end control for the interactive device according to the mapping relationship and the device information of the target device, where the device information includes at least one of a device type and an interactive object possessed by the device.

In one embodiment, a plurality of object models for interactive configuration may be stored in an object model library, so as to match corresponding interactive end controls for the interactive device according to the object model library and the device information.

The object model library may be stored in the server 1100, or may be stored in a database server connected to the server 1100. In the case where the method of the present embodiment is implemented by the control terminal 1200, the control terminal 1200 may load the object model library from the server 1100, or may obtain the content of the object model library by accessing the server 1100, which is not limited herein.

In one embodiment, any object model in the object model library may represent an interaction category, and the object model reflects an interaction end control corresponding to the interaction category, that is, the object model reflects a correspondence between the interaction category and the interaction end control. The interaction category may be represented by at least one of a device type and an interaction object. In this embodiment, the step S3200, according to the device information, matching the corresponding interactive end control for the interactive device may include: obtaining the interaction type of the target equipment according to the equipment information; and matching a corresponding interaction end control for the target equipment in a preset object model library according to the interaction type of the target equipment.

For example, any object model in the object model library may represent a device type, and the object model reflects an interactive end control corresponding to the device type, that is, the object model reflects a correspondence between the device type and the interactive end control. In this example, the electronic device may match a corresponding object model in the object model library according to the device type of the interactive device, and perform interactive configuration of the interactive device according to an interactive end control corresponding to the matched object model, that is, take the interactive end control corresponding to the matched object model as the interactive end control corresponding to the interactive device, where each type of interactive end control may be identified by a corresponding interactive object, so as to configure the corresponding interactive end control for the interactive device according to the interactive object that the interactive device has, thereby forming the object model.

For another example, any object model in the object model library may represent an interactive object, and the object model reflects an interactive end control corresponding to the interactive object, that is, the object model reflects a corresponding relationship between the interactive object and the interactive end control. In this example, the electronic device may match a corresponding object model in the object model library according to an interaction object that the interactive device has, and perform interactive configuration of the interactive device according to an interactive end control corresponding to the matched object model, that is, take the interactive end control corresponding to the matched object model as an interactive end control corresponding to the interactive device. In this example, the object models are divided by dividing different interactive objects, where different object models correspond to different interactive objects, and this finer granularity division is beneficial to performing more flexible interactive configuration.

For another example, any object model in the object model library may also represent a device type and an interactive object, and different object models are different at least at one point of the represented device type and the represented interactive object.

In one embodiment, the method further comprises the step of creating an arbitrary object model, which may include: according to the operation of defining any object model, obtaining defined object model information, wherein the object model information comprises matched interaction types and interaction end controls; and creating the defined counterpart model according to the object model information.

In this embodiment, the creator may trigger the operation through a terminal device communicatively connected to the server 1100 and input the defined object model information through an interface provided by the terminal device. The terminal device may be another device different from the control terminal 1200, or may be the control terminal 1200, which is not limited herein.

As can be seen from the foregoing steps S3100 to S3200, in the interactive application executing the method according to this embodiment, a corresponding interactive end control may be matched to any interactive device according to device information of the interactive device, and then a user-oriented interactive end, such as a control terminal and/or a display terminal, may be configured to provide the interactive end control, so that a user may perform interaction with the interactive device through the interactive end control.

As can be seen from the foregoing steps S3100 to S3200, the interactive application executing the method of this embodiment can match respectively corresponding interactive end controls for the target devices when the interactive devices with different interaction types are accessed, so as to achieve the purpose of performing dynamic matching according to different interactive devices.

From the above steps S3100 to S3200, it can be seen that the interactive application executing the method of the present embodiment can be adapted to various different interactive devices, and the development cost is greatly reduced compared to the interactive application developed by customization.

In one embodiment, the electronic device may perform matching of the interaction end control when the electronic device establishes connection with the target device each time, and release a matching result corresponding to the connection after the connection is disconnected.

In another embodiment, the electronic device may also perform matching of the interactive end control only once for one target device, and record a matching result, so that when the target device is connected next time, the configuration of the interactive end can be directly performed according to the matching result, thereby improving the response speed. In this embodiment, the method may further include the following steps S3011 to S3013:

step S3011, a communication connection with the target device is established.

The electronic device may request establishment of a communication connection with the target device in accordance with an operation to view the target device. The target device may also actively establish a communication connection with the electronic device after completing the network configuration, which is not limited herein.

Step S3012, after the communication connection is established, the matching record of the target device is searched.

Step S3013, if the matching record is not found, execute the operation of matching the corresponding interactive end control for the target device in step S3200, and generate the matching record of the target device according to the matching result.

In this embodiment, when the matching record is found, the interactive end control corresponding to the target device may be directly determined according to the matching record.

In an embodiment, the target device may also be matched with a corresponding interactive end control according to an operation of viewing the target device, so as to ensure that a user can configure a user-oriented interactive end to provide the matched interactive end control when viewing the target device.

In this embodiment, the method may further include the following steps S3021 to S3023:

step S3021, according to the operation of viewing the target device, searching for a matching record of the target device.

Step S3022, when the matching record is not found, performing the operation of matching the corresponding interactive end control for the target device in step S3200, and generating the matching record of the target device according to the matching result.

In one embodiment, the method may further comprise: and configuring the interactive end to provide the matched interactive end control according to the request for viewing the target equipment.

The interactive terminal comprises at least one of a control terminal and a display terminal.

The electronic device can configure the interactive terminal to provide a corresponding interactive terminal control on the interactive interface of the target device according to the request, so that the user can interact with the target device.

For example, the configuration control terminal provides an input control matched with the target device, so that a user can input a control command for controlling the state of the corresponding interactive object through the input control.

For another example, the configuration display terminal provides an output control matched with the target device, so that the current state of the corresponding interactive object is displayed through the output control, and thus, a user can observe feedback of the interactive object on the control result through the output control.

According to the method of the embodiment, the user can interact with the target object through the interaction end control matched with the target device, and flexible docking of interactive devices with different interaction categories is achieved.

In one embodiment, the interactive end control may include an input control, and the method may further include: and controlling the target equipment to execute corresponding operation according to the control command triggered by the provided input control.

In this embodiment, the control terminal 1200 may control the target device to perform a corresponding operation according to the received control command.

In this embodiment, the control terminal 1200 may send the control command to the server 1100 after receiving the control command, and the server 1100 may control the target device to execute the corresponding operation according to the control command triggered by the input control, which is not limited herein.

According to the method of the embodiment, the user can establish contact with the target device through the input control so as to control the target device.

In one embodiment, the interactive end control can include an output control. The method may further comprise: acquiring the current state of an interactive object of the target equipment; and configuring the provided output control to display corresponding to the current state.

In this embodiment, the control terminal 1200 may be configured to perform a presentation corresponding to the current state through an output control provided by the interactive terminal, and the presentation may be performed at least one of the control terminal 1200 and the display terminal 1300.

In this embodiment, the server 1100 may also configure the display corresponding to the current state through an output control provided by the interactive terminal, and the display may be performed at least one of the control terminal 1200 and the display terminal 1300.

According to the method of the embodiment, the user can establish the contact with the target equipment through the output control so as to realize the control monitoring of the target equipment.

< method example two >

The embodiment provides an interactive configuration method, which may be implemented by a control terminal, where the control terminal runs an interactive application for implementing the interactive configuration method, and the interactive application may be a local application, a web application, or the like. The control terminal may be, for example, control terminal 1200 in fig. 2.

Fig. 4 shows a flow chart diagram of the interactive configuration method according to the embodiment. As shown in fig. 4, the method may include the following steps S4100 to S4200:

step S4100: and acquiring target equipment to be checked.

In step S4100, acquiring a target device to be viewed may include: providing a selection interface in response to an operation of selecting a target device; and acquiring the equipment selected by the selection interface as the target equipment.

The selection interface may be located on the device list interface as shown in fig. 1, for example, the selection interface may be located on a list item of each device, and the user may select the target device by clicking on the list item.

The selection interface may also include interfaces in the form of an input box, a check option, a drop-down list, and the like, which are not limited herein.

In one embodiment, the providing a selection interface may include: all devices currently connected or connected are provided in the selection interface for selection.

Step S4200, providing an interactive end control matched with the device information of the target device, where the device information includes at least one of a device type and an interactive object possessed by the target device.

In this embodiment, the interaction category of the target device may be determined according to the device information of the target device, and the interaction category may be represented by a device type and/or an interaction object, and further, an interaction end control matched with the interaction category of the target device may be provided. The matching operation may be performed by the control terminal 1200 or the server 1100, which is not limited herein.

As can be seen from the above steps S4100 to S4200, in the interactive application executing the method of this embodiment, according to the target device to be viewed by the user, an interactive end control matching the interaction category of the device, for example, an input control and/or an output control, is provided on the interactive interface of the device, so that the user can interact with the interactable device through the interactive end control.

In one embodiment, the interactive end control may comprise an input control, the method further comprising: responding to a control command triggered by the input control, and identifying the content of the control command according to an interactive object corresponding to the input control; and controlling the interactive object to execute corresponding operation according to the content of the control command.

In this embodiment, because the input control is matched with a specific interactive object, for example, the interactive object is a switch of a device, or volume adjustment, etc., when the interactive application receives a control command triggered by a user through the input control, the content of the control command may be analyzed according to the interactive object corresponding to the input control, for example, the content of the control command is that the control device is turned on or the control device is turned off, and for example, the content of the control command is that volume is turned up or volume is turned down, etc., so that a standard control command that can be analyzed by a target object can be generated based on a communication protocol of both parties according to the content of the control command, and the interactive object is controlled to perform a corresponding operation through the standard control command.

In this embodiment, the control terminal 1200 may generate the standard control command by itself and transmit the standard control command to the target device. The control terminal 1200 may send the content of the control command to the server 1100, so as to control the interactive object to perform a corresponding operation through the server 1100, which is not limited herein.

In one embodiment, the interactive end control may include an output control, and the method may further include the following steps S4011 to S4013:

step S4011, state information of the target device is acquired.

The status information may be acquired by the control terminal 1200 from the target device, or may be acquired by the control terminal 1200 from the server 1100, which is not limited herein.

The state information may include state information of an interactive object that the target device has, and may also include other state information.

And step S4012, extracting the current state of the interactive object from the state information according to the interactive object corresponding to the output control.

For example, if the interaction object of the target device includes a switch of the device, the information of the on/off state of the device may be extracted from the acquired state information.

For another example, if the interaction object included in the target device includes position adjustment, the position information of the device may be extracted from the acquired state information.

Step S4013, configuring the output control to perform a display corresponding to the current state.

For example, the interaction object possessed by the target device includes a switch of the device, and if the extracted switch state of the device is off, the output control may be configured to indicate that the device is in the off state, for example, the output control shows the switch state through different colors, and the like.

For another example, the interactive object possessed by the target device includes adjustment of the position, the extracted position information of the device includes a pitch angle of the device, and the like, and then the output control may be configured to perform a yaw presentation corresponding to the pitch angle.

< first embodiment of the apparatus >

The present embodiment provides an interactive configuration device, and fig. 5 shows a schematic block diagram of the device 5000. As shown in fig. 5, the apparatus 5000 may include an information obtaining module 5100 and a matching module 5200.

The information obtaining module 5100 is configured to obtain device information of a target device having an interactable attribute, where the device information includes at least one of a device type and an interactive object that the target device has.

The matching module 5200 is configured to match a corresponding interactive end control for the target device according to the device information.

In one embodiment, the interactive end control includes at least one of an input control and an output control, where the input control is a control for controlling an interactive object possessed by the target device, and the output component is a control for showing a state of the interactive object.

In one embodiment, the device information includes an interactive object possessed by the target device, and the interactive object includes at least one of switching on and off of the device, audio playing, man-machine conversation, and index adjustment.

In one embodiment, the matching module 5200, when matching the corresponding interactive end control for the target device according to the device information, may be configured to: acquiring the interaction type of the target equipment according to the equipment information; matching a corresponding interaction end control for the target equipment in a preset object model library according to the interaction category of the target equipment; the object model library is defined with various object models, one object model represents one interaction category, different object models represent different interaction categories, and each object model reflects an interaction end control corresponding to the represented interaction category.

In one embodiment, the interaction category includes at least one of a device type and an interaction object.

In one embodiment, the apparatus 5000 may further include a model creation module for creating an arbitrary object model. The model creation module, when creating the arbitrary object model, may be configured to: according to the operation of defining any object model, obtaining defined object model information, wherein the object model information comprises matched interaction types and interaction end controls; and creating the defined corresponding object model according to the object model information.

In one embodiment, the apparatus 5000 may further include a match detection module, which may be configured to: establishing a communication connection with the target device; after the communication connection is established, searching a matching record of the target device; when the matching record is not found, the matching module 5200 is notified to perform an operation of matching the corresponding interactive end control for the target device, and generates the matching record of the target device according to the matching result.

In one embodiment, the apparatus may further include a match detection module, which may be configured to: searching a matching record of the target equipment according to the request for checking the target equipment; and, in case that the matching record is not found, notifying the matching module 5200 to execute an operation of matching the corresponding interactive end control for the target device, and generating the matching record of the target device according to the matching result.

In one embodiment, the apparatus 5000 may further include an interaction processing module, which may be configured to: and configuring the interactive end to provide the matched interactive end control according to the request for viewing the target equipment.

In one embodiment, the interaction side control includes an input control, and the apparatus 5000 may further include an interaction processing module, and the interaction processing module may be configured to: and controlling the target equipment to execute corresponding operation according to the control command triggered by the provided input control.

In one embodiment, the interaction side control may include an output control, and the apparatus 5000 may further include an interaction processing module, which may be configured to: acquiring the current state of an interactive object of the target equipment; and configuring the provided output control to display corresponding to the current state.

The apparatus 5000 may be located on the side of the control terminal 1200 or on the side of the server 1100, and is not limited herein.

The models of the apparatus 5000 may be implemented by a processor of the control terminal 1200 or a processor of the server 1100, and are not limited herein.

< example II of the apparatus >

The embodiment provides an interactive configuration device, which is located at one side of a control terminal. Fig. 6 shows a schematic block diagram of the device 6000. As shown in fig. 6, the apparatus 6000 may include a device selection module 6100 and an interaction processing module 6200.

The device selection module 6100 may be used to obtain a target device to view.

The interaction processing module 6200 may be configured to provide an interaction side control matching device information of the target device, where the device information includes at least one of a device type and an interaction object that the target device has.

In one embodiment, the interaction-side control may comprise an input control, and the interaction processing module 6200 may be further configured to: responding to a control command triggered by the input control, and identifying the content of the control command according to an interactive object corresponding to the input control; and controlling the interactive object to execute corresponding operation according to the content of the control command.

In one embodiment, the interaction side control may include an output control, and the interaction processing module 6200 may be further configured to: acquiring state information of the target equipment; extracting the current state of the interactive object from the state information according to the interactive object corresponding to the output control; and configuring the output control to display corresponding to the current state.

In one embodiment, the device selection module 6100, when obtaining a target device to view, may be configured to: providing a selection interface in response to an operation of selecting a target device; and acquiring the equipment selected by the selection interface as the target equipment.

In one embodiment, the device selection module 6100, in providing the selection interface, may be to: all devices currently connected or connected are provided in the selection interface for selection.

< apparatus embodiment >

In one embodiment, an electronic device is provided, which includes any of the interaction configuration means 5000 in the first apparatus embodiment above, and may also include any of the interaction configuration means 6000 in the second apparatus embodiment above.

In another embodiment, the electronic device may include a memory for storing executable commands and a processor. The processor is configured to execute any of the interaction configuration methods according to method embodiment one or method embodiment two above under control of the executable command.

The electronic device may be the server 1100 as shown in fig. 2, or may be the control terminal 1200 as shown in fig. 2.

< System embodiment >

This embodiment provides an interactive matching system, as shown in fig. 7, which may include a server 1100 as shown in fig. 2 and a control terminal 1200 as shown in fig. 2.

The server 1100 includes a memory for storing executable commands and a processor. The processor of the server 1100 is configured to execute any of the interactive configuration methods according to the first embodiment of the above method under the control of the executable command.

The control terminal 1200 includes a memory for storing executable commands and a processor. The processor of the control terminal 1200 is configured to execute any interactive configuration method according to the second embodiment of the above method under the control of the executable command.

Fig. 8 shows a non-limiting implementation flow of the interaction configuration system interacting with the interactable device, and as shown in fig. 8, the process of interacting with any interactable device by the interaction configuration system may include the following steps:

in step S201, after establishing a communication connection with the server 1100, the interactive apparatus 2000 transmits its own apparatus information to the server 1100.

The device information includes at least information reflecting a device type.

In step S1101, the server 1100 matches a corresponding interactive end control for the interactive device according to the received device information.

The server may perform the matching according to the device type, or may perform the matching according to an interactive object that the interactive device has, which is determined by the device type.

In step S1201, the control terminal 1200 provides a device list as shown in fig. 1 in response to an operation to view an interactable device.

The device list may be updated based on the interactable device that established a connection with the server or has established a connection.

In step S1202, the control terminal 1200 obtains the interactive device to be viewed selected by the user through the device list as the target device.

In step S1203, the control terminal 1200 transmits the target device to be viewed to the server 1100.

For example, the control terminal 1200 may send the device identification of the target device to the server for the server to determine the identity of the target device.

In step S1102, the server 1100 searches for an interactive end control matched to the target device.

Step S1103, the server 1100 configures the control terminal to provide the interactive end control on the interactive interface of the target device.

In step S1204, the control terminal 1200 obtains a control command triggered by the user through the input control therein.

In step S1205, the control terminal 1200 transmits the control command to the server 1100.

In step S1104, the server 1100 generates a standard control command that can be recognized by the target device 2000 according to the control command and the interactive object corresponding to the input control.

In step S1105, the server 1100 sends the annotation control command to the target device 2000.

In step S202, after receiving the standard control command, the target device 2000 executes a corresponding operation according to the standard control command to change the state of the interactive object.

In step S203, the target device 2000 reports its own status information to the server 1100.

In step S1106, the server 1100 extracts the current state of the interactive object corresponding to the output control from the reported state information.

In step S1107, the server 1100 configures the output control to perform the display corresponding to the current state.

In step S1206, the control terminal 1200 changes the state of the output control according to the configuration, so as to implement the display.

In another embodiment, the system 2000 may further include a separate display terminal 1300 as shown in fig. 2, and the control terminal 1200 or the server 1100 may further configure the display terminal 1300 to provide an output control therein, which is not described herein again.

< computer-readable storage Medium embodiment >

The present embodiments provide a computer-readable storage medium having stored therein an executable command that, when executed by a processor, performs a method described in any of the method embodiments of the present specification.

One or more embodiments of the present description may be a system, method, and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the specification.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations for embodiments of the present description may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), can execute computer-readable program instructions to implement various aspects of the present description by utilizing state information of the computer-readable program instructions to personalize the electronic circuit.

Aspects of the present description are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the description. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present description. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are equivalent.

The foregoing description of the embodiments of the present specification has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the application is defined by the appended claims.

Claims

1. An interactive configuration method, comprising:

2. The method of claim 1, wherein the interactive end control comprises at least one of an input control and an output control, wherein the input control is a control for controlling an interactive object possessed by the target device, and the output component is a control for showing a state of the interactive object.

3. The method of claim 1, wherein the device information includes interaction objects that the target device has, the interaction objects including at least one of a switch of a device, audio playback, human-machine conversation, index adjustment.

4. The method of claim 1, wherein the matching, according to the device information, a corresponding interactive end control for the target device comprises:

5. The method of claim 4, wherein the method further comprises the step of creating any of the object models, including:

6. The method of claim 1, wherein the method further comprises:

establishing a communication connection with the target equipment;

7. The method of claim 1, wherein the method further comprises:

8. The method of any of claims 1 to 7, wherein the method further comprises:

9. The method of claim 8, wherein the interactive end control comprises an input control, the method further comprising:

controlling the target equipment to execute corresponding operation according to a control command triggered by the provided input control; and/or the interactive end control comprises an output control, and the method further comprises the following steps:

acquiring the current state of an interactive object of the target equipment;

10. An interactive configuration method implemented by a control terminal includes:

acquiring target equipment to be checked;

11. The method of claim 10, the interactive end control comprising an input control, the method further comprising:

12. The method of claim 10, the interactive end control comprising an output control, the method further comprising:

acquiring state information of the target equipment;

13. The method of claim 10, wherein the obtaining a target device to view comprises:

14. The method of claim 13, wherein the providing a selection interface comprises:

15. An interaction configuration apparatus comprising:

16. An interaction configuration apparatus comprising:

17. An electronic device comprising the interaction configuration means of claim 15 or 16.

18. An interactive matching system, comprising:

a server comprising a memory and a processor, the memory of the server for storing executable commands; the processor of the server is configured to perform the method of any of claims 1-9 under control of the executable command; and the number of the first and second groups,

the control terminal comprises a memory and a processor, wherein the memory of the control terminal is used for storing executable commands; the processor of the control terminal is configured to perform the method of any of claims 10 to 14 under the control of the executable command.

19. A computer-readable storage medium storing executable instructions that, when executed by a processor, perform the method of any one of claims 1-14.