CN112910745B

CN112910745B - Control method and device of intelligent household equipment

Info

Publication number: CN112910745B
Application number: CN201911229162.1A
Authority: CN
Inventors: 邹东伟; 刘芳超; 周立安; 马小伟; 刘鹏
Original assignee: Vidaa Netherlands International Holdings BV
Current assignee: Vidaa Netherlands International Holdings BV
Priority date: 2019-12-04
Filing date: 2019-12-04
Publication date: 2023-09-19
Anticipated expiration: 2039-12-04
Also published as: CN112910745A

Abstract

The invention discloses a control method and equipment of intelligent home equipment, wherein a second intelligent home equipment determines at least one first intelligent home equipment serving as a service end according to a preset service discovery mechanism, determines a list comprising first identifiers corresponding to services provided by each first intelligent home equipment after being connected with each first intelligent home equipment, sends a service starting request carrying the first identifiers to the first intelligent home equipment according to the first identifiers selected from the list by a user, so that the first intelligent home equipment corresponding to the first identifiers feeds back a first message carrying service contents corresponding to the first identifiers according to the service starting request, and displays the service contents carried in the received first message. Therefore, the same multimedia resource is displayed on a plurality of intelligent household devices without adding additional physical devices in the intelligent household devices, namely, on the basis of not increasing the manufacturing cost of the intelligent household devices, and the user experience is improved.

Description

Control method and device of intelligent household equipment

Technical Field

The invention relates to the technical field of intelligent household equipment, in particular to a control method and equipment of intelligent household equipment.

Background

With the rapid development of the internet of things technology, intelligent home devices gradually tend to be mature and popular, and intelligent home devices such as mobile phones, televisions, intelligent refrigerators, personal computers (Personal Computer, PCs) and the like all have multimedia display functions, but in the prior art, except for screen projection from the mobile phone to the television, sharing display of multimedia resources among the televisions, the mobile phones, tablet computers and other increasingly popular intelligent home devices is difficult to realize.

Based on the above, how to realize the sharing display of multimedia resources between intelligent furniture devices is a technical problem to be solved by those skilled in the art.

Disclosure of Invention

The embodiment of the invention provides a control method and equipment for intelligent household equipment, which are used for realizing sharing display of multimedia resources among intelligent furniture equipment.

In a first aspect, an embodiment of the present invention provides a control method for an intelligent home device, where the control method is applicable to a side of a second intelligent home device serving as a client, and the method includes:

determining at least one first intelligent home device serving as a server according to a preset service discovery mechanism;

after being connected with each first intelligent home device, determining a list comprising first identifiers corresponding to services which can be provided by each first intelligent home device;

According to a first identifier selected from the list by a user, a service starting request carrying the first identifier is sent to the first intelligent home equipment corresponding to the selected first identifier, so that the first intelligent home equipment corresponding to the first identifier feeds back a first message carrying service content corresponding to the first identifier according to the service starting request;

and displaying according to the service content carried in the received first message.

Optionally, determining at least one first smart home device as a service end according to a preset service discovery mechanism specifically includes:

sending a service query request carrying a service to be queried to a preset multicast address, so that at least one intelligent home device serving as a service end feeds back an address carrying the intelligent home device and a second message carrying the service to be queried when the service query request is monitored and the service to be queried is judged to be matched with the service provided by the intelligent home device;

and determining the intelligent home equipment corresponding to the received second message as the first intelligent home equipment.

Optionally, determining a list including a first identifier corresponding to a service that can be provided by each of the first smart home devices specifically includes:

And acquiring a first identifier of the service which can be provided by each first intelligent home device according to the address of the first intelligent home device carried in the second message, and forming the list.

Optionally, the service corresponding to the first identifier is multimedia sharing service, and the service content is multimedia data; the service starting request carries a third identifier for representing the decoding capability of the second intelligent home equipment serving as the client, so that the first intelligent home equipment corresponding to the first identifier feeds back the multimedia data corresponding to the third identifier;

or the service corresponding to the first identifier is an application software service, and the service content is a function operation list of the application software;

or the service corresponding to the first identifier is multimedia synchronous service, and the service content is timestamp information of the multimedia content.

Optionally, when the service corresponding to the first identifier is a multimedia synchronization service, before sending a service start request carrying the first identifier to the first smart home device corresponding to the selected first identifier, the method further includes:

according to a first identifier selected from the list by a user, sending a first multimedia playing content request carrying the selected first identifier to the first intelligent home equipment corresponding to the first identifier according to a preset period, so that the first intelligent home equipment corresponding to the first identifier feeds back a third message carrying a second identifier of the playing multimedia content according to the first multimedia playing content request;

When the second identifier is carried in the third message, a second multimedia playing content request carrying the second identifier is sent to an upper-layer device providing the multimedia content, so that the upper-layer device feeds back a fourth message carrying the multimedia content according to the second multimedia playing content request;

and determining the multimedia content according to the fourth message.

Optionally, the second multimedia playing content request includes: the playing resolution of the multimedia content and/or the viewing angle of the multimedia content.

Optionally, displaying according to the service content carried in the received first message specifically includes:

and displaying the multimedia content which is time-synchronized with the first intelligent home equipment according to the received time stamp information of the multimedia content and the received multimedia content fed back by the upper equipment.

In a second aspect, an embodiment of the present invention provides a control method of an intelligent home device, where the control method is applicable to a first intelligent home device side serving as a server, and the control method includes:

after being connected with second intelligent home equipment serving as a client, receiving a service starting request sent by the second intelligent home equipment; the service starting request comprises a first identifier, wherein the first identifier is as follows: after the second intelligent home equipment determines at least one first intelligent home equipment serving as a service end according to a preset service discovery mechanism and the second intelligent home equipment is connected with each first intelligent home equipment, a user selects from a list which is determined and comprises first identifiers corresponding to services which can be provided by each first intelligent home equipment;

Determining service content corresponding to a first identifier according to the first identifier included in the service starting request;

and feeding back the first message carrying the determined service content to the second intelligent home equipment so that the first intelligent home equipment displays the service content carried in the first message according to the received service content.

Optionally, before receiving the service initiation request sent by the second smart home device, the method further includes:

monitoring a service query request carrying a service to be queried, which is sent by the second intelligent home equipment, on a preset multicast address;

when the fact that the service to be queried carried in the monitored service query request is matched with the service provided by the second intelligent home equipment is judged, a second message carrying the address of the second intelligent home equipment and the service to be queried is sent to the second intelligent home equipment, so that the second intelligent home equipment determines the intelligent home equipment corresponding to the received second message as the first intelligent home equipment.

Optionally, when the service corresponding to the first identifier is a multimedia synchronization service, before receiving a service start request sent by the second smart home device, the method further includes:

receiving a first multimedia playing content request sent by the second intelligent home equipment;

determining a second identifier of the playing multimedia content according to the received first multimedia playing content request;

and sending a third message carrying a second identifier of the multimedia content being played to the second intelligent home equipment, so that when the second intelligent home equipment sends a second multimedia content playing request to an upper-layer equipment providing the multimedia content according to the second identifier carried in the third message, the upper-layer equipment feeds back a fourth message carrying the multimedia content to the second intelligent home equipment according to the second multimedia content playing request, and determines the multimedia content according to the fourth message.

In a third aspect, an embodiment of the present invention provides an intelligent home device, where the device is adapted to be used as a side of a second intelligent home device of a client, and includes:

a memory for storing program instructions;

and a processor for calling the program instructions stored in the memory, and executing according to the obtained program:

In a fourth aspect, an embodiment of the present invention provides an intelligent home device, where the device is adapted to be used as a side of a first intelligent home device of a server, and includes:

A memory for storing program instructions;

In a fifth aspect, embodiments of the present invention provide a computer-readable nonvolatile storage medium storing computer-executable instructions for causing a computer to execute the above-described control method.

The invention has the following beneficial effects:

according to the control method and the control device for the intelligent home equipment, the second intelligent home equipment determines at least one first intelligent home equipment serving as a service end according to a preset service discovery mechanism, determines a list comprising first identifiers corresponding to services provided by the first intelligent home equipment after being connected with the first intelligent home equipment, sends a service starting request carrying the first identifiers to the first intelligent home equipment according to the first identifiers selected from the list by a user, so that the first intelligent home equipment corresponding to the first identifiers feeds back a first message carrying service contents corresponding to the first identifiers according to the service starting request, and displays the service contents carried in the received first message. Therefore, the sharing display of the multimedia resources among the intelligent home devices is realized without adding additional physical devices in the intelligent home devices, namely, on the basis of not increasing the manufacturing cost of the intelligent home devices, namely, the same multimedia resources are displayed on a plurality of intelligent home devices, and the user experience is improved.

Drawings

Fig. 1 is a flowchart of a control method of an intelligent home device provided in an embodiment of the present invention;

FIG. 2 is a schematic diagram of an SPDS according to an embodiment of the present invention;

fig. 3 is a schematic diagram of services provided by each first smart home device according to an embodiment of the present invention;

fig. 4 is a flowchart of another control method of smart home devices according to an embodiment of the present invention;

FIG. 5 is a flowchart of an interaction process of a multimedia sharing service provided in an embodiment of the present invention;

FIG. 6 is a schematic diagram of a list provided in an embodiment of the present invention;

FIG. 7 is a schematic diagram of a sub-list of My music provided in an embodiment of the invention;

FIG. 8 is a flow chart of an interaction process of an application software service provided in an embodiment of the present invention;

FIG. 9 is a schematic diagram of another list provided in an embodiment of the present invention;

FIG. 10 is a schematic diagram of a sub-list of televisions provided in an embodiment of the present invention;

FIG. 11 is a flowchart of an interaction procedure of a multimedia synchronization service provided in an embodiment of the present invention;

FIG. 12 is a schematic diagram of yet another list provided in an embodiment of the present invention;

fig. 13 is a schematic structural diagram of an intelligent home device according to an embodiment of the present invention;

fig. 14 is a schematic structural diagram of another smart home device according to an embodiment of the present invention.

Detailed Description

The following describes in detail a control method and a specific implementation manner of an intelligent home device according to an embodiment of the present invention with reference to the accompanying drawings. It should be noted that the described embodiments are only some embodiments of the present invention, and not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

The embodiment of the invention provides a control method of intelligent home equipment, which is suitable for one side of second intelligent home equipment serving as a client, and as shown in fig. 1, the control method can comprise the following steps:

s101, determining at least one first intelligent home device serving as a server according to a preset service discovery mechanism;

wherein, the first smart home device may be: the intelligent home appliances such as televisions, air conditioners, refrigerators, mobile phones, tablet computers and the like are not limited herein.

S102, after being connected with each first intelligent home device, determining a list comprising first identifiers corresponding to services which can be provided by each first intelligent home device;

the connection process between the first smart home device and the second smart home device may be any method known to those skilled in the art for implementing connection, which is not limited herein.

And after the first smart home device is connected with the second smart home device, an authentication process is further required, and after authentication is completed, a first identifier corresponding to the service provided by each first smart home device can be obtained, so as to determine the list, wherein any method capable of realizing authentication, which is well known to those skilled in the art, can be adopted for the authentication process, and the authentication process is not limited herein.

After the authentication process is completed, the authentication process is not required to be repeated in the authentication effective period, and when the authentication process exceeds the effective period, the authentication is performed, so that the control method of the intelligent home equipment is simplified, and the control efficiency is improved.

S103, according to a first identifier selected by a user from a list, a service starting request carrying the first identifier is sent to a first intelligent home device corresponding to the selected first identifier, so that the first intelligent home device corresponding to the first identifier feeds back a first message carrying service content corresponding to the first identifier according to the service starting request;

and S104, displaying according to the service content carried in the received first message.

Therefore, the sharing display of the multimedia resources among the intelligent home devices is realized without adding additional physical devices in the intelligent home devices, namely, on the basis of not increasing the manufacturing cost of the intelligent home devices, namely, the same multimedia resources are displayed on a plurality of intelligent home devices, and the user experience is improved.

In a specific implementation, in an embodiment of the present invention, determining at least one first smart home device as a server according to a preset service discovery mechanism specifically includes:

sending a service query request carrying the service to be queried to a preset multicast address, so that at least one intelligent home device serving as a service end feeds back the address carrying the intelligent home device and a second message of the service to be queried when the service query request is monitored and the service to be queried is judged to be matched with the service provided by the intelligent home device;

The preset service discovery mechanism may be understood as, but is not limited to, a service provider discovery service (Service Provider Discovery Service, SPDS), which is a basic service for implementing the sharing display of the multimedia resources between the smart home devices, that is, each smart home device needs to configure the SPDS, and only if the service is configured, the sharing display of the multimedia resources between the smart home devices can be implemented.

The SPDS may provide two modes, a client and a server, the server mode may provide services for the client of the SPDS, the client mode may display services provided by the server of the SPDS, or, if the services are multimedia data, the client mode may be understood as a display for displaying the multimedia data.

The SPDS is based on a simple service discovery protocol (Simple Service Discovery Protocol, SSDP) which provides a mechanism for the network to provide services to network devices without any need for configuration, administration and maintenance. SSDP has a query request type and a presence notification type, and in the present invention, only the query request type of SSDP is referred to.

In a specific implementation, the second smart home device may send a service query request to a preset multicast address, where a format of the service query request is as follows:

M-SEARCH*HTTP/1.1

HOST:239.255.255.250:1900

MAN:“ssdp:discover”

MX:seconds to delay response

ST:search target

the HOST address is fixed to 239.255.255.250:1900, which may be understood as a preset multicast address, and the preset multicast address is not limited thereto, but may be other multicast addresses different from the first smart home device and the second smart home device, which is not limited thereto.

MAN represents the query type, fixed to ssdp: discover, MX represents the longest waiting time for the second smart home device to respond, i.e. represents the longest waiting time for the second smart home device to wait for receiving the second message, ST represents the service to be queried.

Because the first intelligent home equipment serving as the service end can monitor the service query request on the multicast address, when the first intelligent home equipment monitors that the service to be queried in the service query request is matched with the service provided by the first intelligent home equipment, a second message can be fed back to the second intelligent home equipment, wherein the format of the fed-back second message can be as follows:

HTTP/1.1200OK

CACHE-CONTROL:max-age＝seconds until advertisement expires

DATE:when reponse was generated

EXT:

LOCATION:URL for UPnP description for root device

SERVER:OS/Version UPNP/1.0product/version

ST:search target

USN:advertisement UUID

Wherein, max-age indicates the effective time of the second message, DATE indicates the generation time of the second message, SERVER contains information such as operating system version, product information, etc., ST indicates the service to be queried, and is consistent with ST in the query service request, USN indicates the unified service name of different services, it provides a capability of identifying the same type of service, LOCATION indicates the address of the first smart home device, so that the second smart home device can determine the capability of the first smart home device capable of providing service and the corresponding service address according to the address, in other words, can obtain the first identifier of the service provided by the first smart home device according to the address.

Specifically, the second smart home device obtains the first identifier of the service provided by the first smart home device according to the address provided by the LOCATION, where a manner of obtaining the first identifier may be any method known to those skilled in the art that may obtain the first identifier, which is not limited herein.

Optionally, the obtained first identifier includes services that can be provided by the first smart home device, where each service carries activity (active) information and address (url) information, the activity information indicates whether the service is active, and the address information indicates an address of the service.

In this way, when the second smart home device serving as the client sends the service query request, the service query request may be sent to the multicast address, or may be sent to the multicast address, and may be selected according to the actual situation, which is not limited herein.

In the following, a specific embodiment will be described how the second smart home device determines the first smart home device.

The structure of the SPDS shown in fig. 2 is illustrated by taking the multicast address 239.255.255.250:1900 as an example:

the tablet personal computer 1 can be used as a second intelligent home device, and the notebook computer 2, the television 3 and the mobile phone 4 can be respectively used as a first intelligent home device 1, a first intelligent home device 2 and a first intelligent home device 3; the dashed lines in the figure indicate that communication may take place between the devices.

The tablet computer 1 sends a service query request carrying a service to be queried to the multicast address 239.255.255.250:1900; the notebook computer 2, the television 3 and the mobile phone 4 respectively monitor service inquiry requests on the multicast address 239.255.255.250:1900;

if the notebook computer 2 and the television 3 respectively judge that the service to be queried is matched with the service provided by the notebook computer 2 and the television 3 respectively send second messages carrying the address of the notebook computer and the service to be queried to the tablet computer 1;

If the mobile phone 4 determines that the service to be queried is not matched with the service provided by the mobile phone 4, the mobile phone 4 sends a message carrying the address of the mobile phone to the tablet computer 1 and the service to be queried is not matched with the service provided by the mobile phone, or the mobile phone 4 does not send any message to the tablet computer 1.

Therefore, the first intelligent household equipment can be determined through the method, the difficulty in sharing and displaying the multimedia resources among the intelligent furniture equipment is reduced, and the method is more practical.

In a specific implementation, in an embodiment of the present invention, determining a list including first identifiers corresponding to services that can be provided by each first smart home device specifically includes:

and acquiring a first identifier of the service which can be provided by each first intelligent home device according to the address of the first intelligent home device carried in the second message, and forming a list.

The service provided by the first intelligent home equipment comprises a synchronous clock service, an application software service, a multimedia sharing service and a multimedia synchronous display service. These four services are described below:

1. synchronous clock service

A network time protocol (Network Time Protocol, NTP) is used to synchronize reference times between communication devices, the reference times being a standard time that each smart home device has. Due to other reasons such as network, hardware and the like, the time displayed by the intelligent home equipment and the reference time may have deviation, that is, the time displayed by the intelligent home equipment and the reference time are inconsistent, but have continuity and monotonicity.

The reference time of different smart home devices may be the same or different, and may be specific according to actual situations.

The synchronous clock service may be implemented based on a simple network time protocol (Simple Network Time Protocol, SNTP), but is not limited thereto, and may be implemented by other protocols.

2. Application software service

The second intelligent home equipment is provided with application software information of the second intelligent home equipment, and can remotely start service, namely, after the second intelligent home equipment acquires the application software service, a function operation list of the application software can be selected and started.

3. Multimedia sharing service

The service can realize resource sharing of video and audio, pictures and files, and the second intelligent home equipment can display the content displayed by the first intelligent home equipment.

The display of the multimedia resources supports a source file mode and a transcoding mode, and for the source file mode, a hypertext transfer protocol (Hyper Text Transfer Protocol, http) can be adopted to transfer files, so that streaming and breakpoint continuous transmission are supported, and when streaming is supported, the second intelligent home equipment analyzes the multimedia resources, and the second intelligent home equipment can display the multimedia resources while receiving, and does not need to wait for all the multimedia resources to finish transferring and then display, thereby saving time and improving efficiency.

The transcoding mode aims at second intelligent home equipment which does not have decoding capability or has weak decoding capability, and the second intelligent home equipment can only display content or sound in a specific format, namely after the first intelligent home equipment analyzes multimedia resources, the analyzed data are sent to the second intelligent home equipment, so that the intelligent home equipment can display the content or the sound.

4. Multimedia synchronization service

The second smart home device synchronously displays the content currently being displayed by the first smart home device, that is, the second smart home device and the first smart home device display the same content with the same point, that is, display the pictures of the same point in time in the same content.

The following describes how the second smart home device synchronously displays the content of the first smart home device.

For example, consider the case where the content currently being displayed by the first smart home device is a movie:

for the multimedia synchronization service, the second smart home device displays the movie played by the first smart home device, and the playing progress of the second smart home device and the playing progress of the first smart home device are the same, that is, if the first smart home device is currently playing the movie content at 20 minutes, then the second smart home device also plays the movie content at 20 minutes.

The present invention is not limited to the above-described 4 services, i.e., the synchronous clock service, the application software service, the multimedia sharing service, and the multimedia synchronization service, and the description will be given by taking these 4 services as examples.

The following describes, in specific embodiments, services that each first smart home device can provide.

For example, as shown in fig. 3, the second smart home device a, the second smart home device B, the second smart home device C, and the second smart home device D are described as examples.

For synchronous clock service, only the second intelligent home equipment A can provide;

for the application software service, only the second smart home device B can provide;

for the multimedia sharing service, only the second smart home device D can provide;

for the multimedia synchronization service, only the second smart home device a may be provided.

Therefore, the list comprising the first identifiers of the services provided by each first intelligent home device is obtained, and the second intelligent home device and the first intelligent home device can display the multimedia resources.

In the embodiment of the invention, the service corresponding to the first identifier is multimedia sharing service, and the service content is multimedia data; the service starting request carries a third identifier for representing the decoding capability of the second intelligent home equipment serving as the client, so that the first intelligent home equipment corresponding to the first identifier feeds back the multimedia data corresponding to the third identifier;

or the service corresponding to the first identifier is multimedia synchronous service, and the service content is time stamp information of the multimedia content.

Therefore, according to different services selected by the user, the second intelligent home equipment displays different service contents, so that the requirements of the user are met, and the application of the intelligent home equipment in different service aspects is improved.

In a specific implementation, in an embodiment of the present invention, when a service corresponding to a first identifier is a multimedia synchronization service, before sending a service start request carrying the first identifier to a first smart home device corresponding to the selected first identifier, the method further includes:

according to a first identifier selected from the list by a user, a first multimedia playing content request carrying the selected first identifier is sent to a first intelligent home device corresponding to the first identifier according to a preset period, so that the first intelligent home device corresponding to the first identifier feeds back a third message carrying a second identifier of the playing multimedia content according to the first multimedia playing content request;

When the second identifier is carried in the third message, a second multimedia playing content request carrying the second identifier is sent to the upper-layer equipment for providing the multimedia content, so that the upper-layer equipment feeds back a fourth message carrying the multimedia content according to the second multimedia playing content request;

and determining the multimedia content according to the fourth message.

Among them, the multimedia synchronization service can be understood as: the second intelligent home equipment synchronously displays the content displayed by the first intelligent home equipment. When the content of the multimedia playing can support different definition, the user can select definition different from that of the first intelligent home equipment and display the content on the second intelligent home equipment, so that network transmission capacity and display effect are balanced.

And when the content played by the multimedia can support different viewing angles, the user can select different viewing angles and display the content on the second intelligent home equipment, so that the viewing requirements of the user at different angles are met.

Therefore, in order to enable the first smart home device and the second smart home device (hereinafter referred to as device a temporarily) to play the same multimedia content synchronously, when the user selects, from the list displayed by device a, which first smart home device is playing on device a, the device a first sends a first multimedia play content request carrying the first identifier of device B to the selected first smart home device (hereinafter referred to as device B temporarily) to inform device B that it wants to play the same multimedia content as it.

Accordingly, device B may feed back to device a third message carrying a second identification of the multimedia content being played by itself. After the device a determines the second identifier, a second multimedia play content request carrying the second identifier may be fed back to the upper layer, so as to inform the upper layer device what multimedia content is desired to be obtained by the device a, so that the upper layer device may feed back corresponding multimedia content to the device a according to the second identifier.

Illustratively, the reason for acquiring multimedia content from an upper device is that:

if the multimedia content is obtained from the first smart home device, the definition and the viewing angle of the multimedia content obtained from the first smart home device are fixed and cannot be selected because the definition and the viewing angle of the multimedia content played by the first smart home device are limited.

If the multimedia content is obtained from the upper-layer equipment, the upper-layer equipment is a provider of the multimedia content, and resources with various resolutions and various viewing angles can be provided, so that the multimedia content is obtained from the upper-layer equipment, the user can select definition and viewing angles to display the multimedia content, different requirements of the user are met, and the user experience is improved.

In a specific implementation, in an embodiment of the present invention, the second multimedia play content request includes: the playback resolution of the multimedia content, and/or the viewing angle of the multimedia content.

Therefore, the playing resolution and/or the viewing angle of the multimedia content can be selected according to the actual demands of the users, the viewing demands of different angles are met, and the user experience is improved.

In a specific implementation, in an embodiment of the present invention, displaying according to service content carried in a received first message specifically includes:

The time stamp information comprises the reference time of the first intelligent home equipment and the playing time of the multimedia content.

The playing time of the multimedia content can be understood as: the first intelligent home equipment determines time according to the displayed content and time of a plurality of second intelligent home equipment connected with the first intelligent home equipment.

How to determine the play time of the multimedia content is described below in an embodiment.

For example, taking a case that the second smart home devices connected to the first smart home device are the second smart home device 1, the second smart home device 2, and the second smart home device 3, and the first smart home device and the 3 second smart home devices play the same television series as each other as an example, the following description will be given:

The first intelligent home equipment plays the 10 th minute picture in the television play, the second intelligent home equipment 1 plays the 11 th minute picture in the television play, the second intelligent home equipment 2 plays the 12 th minute picture in the television play, and the second intelligent home equipment 3 plays the 10 th minute picture in the television play; at this time, the first smart home device may determine a suitable time, for example, but not limited to, an 11 th minute picture, in combination with the time points at which the 3 second smart home devices play the drama picture; then, the 11 th minute is used to determine the play time of the multimedia content.

It should be noted that the appropriate time may be understood as: in order to facilitate adjustment of one piece of time information of the playing time of the first intelligent home device and the playing time of the 3 second intelligent home devices. The suitable time may be determined according to practical situations, and is not limited herein.

The reference times of the first smart home device and the second smart home device may be the same or different.

If the reference time of the first intelligent home equipment is different from the reference time of the second intelligent home equipment, the reference time of the second intelligent home equipment can be adjusted according to the reference time of the first intelligent home equipment, and then the picture with the same time point as the play time is displayed according to the play time of the multimedia content of the first intelligent home equipment.

Therefore, the second intelligent home equipment can accurately and synchronously display the multimedia content of the first intelligent home equipment, so that users can watch the same multimedia content on different intelligent home equipment, and the experience of the users is improved.

In addition, when the first smart home device and the second smart home device play the multimedia content, due to the network, or software and hardware, the multimedia content played on the two devices may be unsynchronized, and delay occurs, so as to ensure that the synchronized pictures are played on the two devices, so that:

after the first intelligent home equipment and the second intelligent home equipment complete synchronous playing of the multimedia content, the synchronous operation is continuously carried out on the multimedia content played by the first intelligent home equipment and the second intelligent home equipment according to a preset period, the specific process is similar to the above, and repeated parts are omitted.

The preset period can be set to 500 milliseconds, and can be set to other time according to actual conditions, so that the design flexibility is improved.

It should be noted that, in the actual situation, after the first smart home device and the second smart home device complete the synchronous playing of the multimedia content, there may be a change in the multimedia content played on the first smart home device, at this time, in order to keep the first smart home device and the second smart home device playing the synchronous multimedia content, the following operations may be performed:

The first intelligent home equipment sends a change indication message carrying a second identifier of the changed multimedia content to the second intelligent home equipment;

the second intelligent home equipment sends a second multimedia playing content request carrying the second identification of the modified multimedia content to the upper-layer equipment according to the second identification carried in the received modification indication message;

the upper layer equipment feeds back a fourth message carrying the modified multimedia content to the second intelligent home equipment according to the second identifier carried in the second multimedia play content request;

the second intelligent home equipment determines the changed multimedia content;

the second intelligent home equipment sends a service starting request to the first intelligent home equipment;

the first intelligent home equipment sends a first message carrying time stamp information of the changed multimedia content to the first intelligent home equipment according to the received service starting request;

and the second intelligent home equipment displays the multimedia content which is synchronous with the time of the first intelligent home equipment according to the time stamp information of the changed multimedia content carried in the first message and the determined changed multimedia content.

After the above steps are completed, the synchronization operation can be continuously performed on the multimedia content played by the first smart home device and the second smart home device according to a preset period, and specific processes refer to the above content and repeated parts are omitted.

Based on the same inventive concept, the embodiment of the present invention provides a control method of an intelligent home device, where the control method is applicable to a first intelligent home device side as a client, as shown in fig. 4, and may include:

s401, after being connected with second intelligent home equipment serving as a client, receiving a service starting request sent by the second intelligent home equipment; the service starting request comprises a first identifier, wherein the first identifier is as follows: after the second intelligent home equipment determines at least one first intelligent home equipment serving as a service end according to a preset service discovery mechanism and the second intelligent home equipment is connected with each first intelligent home equipment, a user selects from the determined list comprising first identifiers corresponding to services provided by each first intelligent home equipment;

s402, determining service content corresponding to a first identifier according to the first identifier included in the service starting request;

s403, feeding back the first message carrying the determined service content to the second intelligent home equipment so that the first intelligent home equipment displays the service content carried in the received first message.

In a specific implementation, in an embodiment of the present invention, before receiving a service initiation request sent by a second smart home device, the method further includes:

monitoring a service query request carrying a service to be queried, which is sent by second intelligent home equipment, on a preset multicast address;

when judging that the service to be queried carried in the monitored service query request is matched with the service provided by the second intelligent home equipment, sending a second message carrying the address of the second intelligent home equipment and the service to be queried to the second intelligent home equipment, so that the second intelligent home equipment determines the intelligent home equipment corresponding to the received second message as the first intelligent home equipment.

In the embodiment of the invention, the service corresponding to the first identifier is multimedia sharing service, and the service content is multimedia data; the service starting request carries a multimedia playing mode so that the first intelligent home equipment corresponding to the first identifier feeds back multimedia data corresponding to the multimedia playing mode;

In a specific implementation, in an embodiment of the present invention, when the service corresponding to the first identifier is a multimedia synchronization service, before receiving a service start request sent by the second smart home device, the method further includes:

receiving a first multimedia playing content request sent by second intelligent home equipment;

and sending a third message carrying a second identifier of the multimedia content being played to the second intelligent home equipment, so that when the second intelligent home equipment sends a second multimedia playing content request to the upper-layer equipment providing the multimedia content according to the second identifier carried in the third message, the upper-layer equipment feeds back a fourth message carrying the multimedia content to the second intelligent home equipment according to the second multimedia playing content request, and determines the multimedia content according to the fourth message.

Therefore, when the multimedia content is acquired from the upper equipment, the resolution and the multi-image angle can be favorably selected, and when the multimedia content is acquired from the first intelligent home equipment, the selection cannot be performed, so that different requirements of users are met, and the user experience is improved.

The control method provided by the embodiment of the invention is described in the following by using a specific embodiment.

Embodiment one: taking the example that the user selects the eastern red in my music in the first smart home device 1 as an example for explanation, wherein the server side comprises the first smart home device 1 and the first smart home device 2, and it is assumed that both the first smart home devices can provide the service to be queried to the second smart home device, and the specific process is shown in fig. 5.

S501, the second intelligent home equipment sends a service query request comprising a service to be queried to a multicast address;

the service query request further includes an address of the second smart home device, so that the first smart home device may send a second message to the second smart home device according to the address.

S502, the first intelligent home equipment 1 and the first intelligent home equipment 2 monitor the service query request on a multicast address;

S503, the first intelligent home equipment 1 and the first intelligent home equipment 2 judge whether the service to be queried in the monitored service query request is matched with the service provided by the first intelligent home equipment 2; if not, ending the flow; if yes, go to step S504;

s504, the first intelligent home equipment 1 and the first intelligent home equipment 2 send second messages carrying self addresses and services to be queried to the second intelligent home equipment;

s505, the first intelligent home equipment 1 and the first intelligent home equipment 2 are respectively connected with the second intelligent home equipment, and authentication is carried out;

the authentication process is in an effective period without repeated authentication; during the period beyond the validity period, authentication is required.

And then, the second intelligent home equipment respectively sends request indication messages to the first intelligent home equipment 1 and the first intelligent home equipment 2 so that the first intelligent home equipment 1 and the first intelligent home equipment 2 send first indication messages carrying first identifiers capable of providing services.

S506, the first intelligent home equipment 1 and the first intelligent home equipment 2 respectively send first indication messages carrying first identifiers capable of providing services to the second intelligent home equipment;

S507, the second intelligent home equipment determines and displays a list comprising first identifiers corresponding to the services provided by each first intelligent home equipment according to the first identifiers carried in the first indication message;

in the list shown in fig. 6, PCI may be used as the first smart home device 1, and the mobile phone 1 may be used as the first smart home device 2. The first smart home device 1 can provide services including: my music and movies, the services that the second smart home device 2 can offer are: music collected, gansu 7 day tour, and work files.

And the list is in a hierarchical structure and keeps consistent with the file system of the first intelligent home equipment, and the list can be in video, audio and other file formats, that is, the format of the display content of the second intelligent home equipment is the same as the format of the display content of the first intelligent home equipment 1 and the first intelligent home equipment 2.

S508, the user selects the eastern red in the my music from the list;

wherein the user selected content is shown within the dashed boxes shown in fig. 6 and 7.

S509, the second intelligent home equipment sends a service starting request carrying a first identifier of Oriental red to the first intelligent home equipment 1;

The service start request may further carry a third identifier, for example, but not limited to, if the third identifier is 0, it indicates that the decoding capability of the second smart home device is stronger, and if the third identifier is 1, it indicates that the decoding capability of the second smart home device is weaker or no decoding capability;

therefore, when the third identifier carried in the service starting request is 0, the first intelligent home equipment can determine that the second intelligent home equipment has stronger decoding capability, so that the first message fed back to the second intelligent home equipment by the first intelligent home equipment can carry the non-decoded eastern red music;

when the third identifier carried in the service starting request is 1, the first intelligent home equipment can determine that the second intelligent home equipment does not have decoding capability or has weaker decoding capability, so that the first intelligent home equipment can decode the file of the Oriental red music first and then send the decoded data to the second intelligent home equipment.

S510, the first intelligent home equipment 1 sends a first message carrying eastern red music to the second intelligent home equipment;

s511, the second intelligent home equipment plays the Oriental red.

Embodiment two: taking a user selecting a cool application in the first smart home device 1 as an example for explanation, where the server includes the first smart home device 1 and the first smart home device 2, and it is assumed that both the first smart home devices can provide a service to be queried to the second smart home device, and a specific process is shown in fig. 8.

The steps of S801 to S807 are the same as those of S501 to S507 in the first embodiment, and specific reference is made to the above, and the repetition is omitted.

In the list shown in the second smart home device shown in fig. 9, the television may be used as the first smart home device 1, and the mobile phone 1 may be used as the first smart home device 2.

S808, the user selects a cool application in the television from the list;

wherein the user selected content is shown within the dashed boxes in fig. 9 and 10.

S809, the second intelligent home equipment sends a service starting request carrying a first identifier for controlling the cool to the first intelligent home equipment 1;

s810, the first intelligent home equipment 1 sends a first message carrying a control operation list for controlling the cool to the second intelligent home equipment;

S811, after the second intelligent home equipment receives the first message, determining a control operation list, so that a user performs control operation on the user according to the control operation list.

Embodiment III: taking the example that the user selects the multimedia content in the first smart home device 1 as an example, the server side includes the first smart home device 1 and the first smart home device 2, and it is assumed that both the first smart home devices can provide the service to be queried to the second smart home device, and the specific process is shown in fig. 11.

The steps of S1101 to S1107 are the same as those of S501 to S507 in the first embodiment, and specific reference is made to the above, and the repetition is omitted.

The list displayed by the second smart home device as shown in fig. 12 includes a television and a Hisense A6, where the television may be used as the first smart home device 1 and the Hisense A6 may be used as the first smart home device 2.

S1108, a user selects a television from the list;

wherein, the content selected by the user is shown in the dashed line box in fig. 12, that is, the user wants the television and the second smart home device to play the CCTV-1 news simulcast synchronously.

S1109, the second intelligent home equipment sends a first multimedia playing content request carrying a first identifier of the first intelligent home equipment 1 to the first intelligent home equipment 1;

S1110, the first intelligent home equipment 1 feeds back a third message carrying a second identifier of the playing CCTV-1 news simulcast to the second intelligent home equipment according to the received first multimedia playing content request;

s1111, the second intelligent home equipment sends a second multimedia playing content request carrying a second identifier to the upper layer equipment according to the second identifier carried in the received third message;

s1112, the upper layer equipment feeds back a fourth message carrying CCTV-1 news simulcast to the second intelligent home equipment according to the second identifier carried in the second multimedia play content request;

s1113, the second intelligent home equipment determines CCTV-1 news simulcast and sends a service starting request carrying a first identifier of the first intelligent home equipment 1 to the first intelligent home equipment;

s1114, the first intelligent home equipment sends a first message carrying the CCTV-1 news simulcast timestamp information to the second intelligent home equipment according to the received service starting request;

and S1115, the second intelligent home equipment displays the CCTV-1 news simulcast which is time-synchronized with the first intelligent home equipment according to the time stamp information of the CCTV-1 news simulcast carried in the first message and the determined CCTV-1 news simulcast.

Based on the same inventive concept, an embodiment of the present invention provides an intelligent home device, which is suitable for a side of a second intelligent home device serving as a client, as shown in fig. 13, and may include:

a memory 1301 for storing program instructions;

a processor 1302 for calling program instructions stored in the memory 1301, executing according to the obtained program:

after being connected with each first intelligent home equipment, determining a list comprising first identifiers corresponding to services which can be provided by each first intelligent home equipment;

according to a first identifier selected by a user from a list, a service starting request carrying the first identifier is sent to a first intelligent home device corresponding to the selected first identifier, so that the first intelligent home device corresponding to the first identifier feeds back a first message carrying service content corresponding to the first identifier according to the service starting request;

Based on the same inventive concept, an embodiment of the present invention provides an intelligent home device, which is suitable for a first intelligent home device side as a service end, as shown in fig. 14, and may include:

A memory 1401 for storing program instructions;

a processor 1402 for calling program instructions stored in the memory 1401, executing according to the obtained program:

after being connected with second intelligent home equipment serving as a client, receiving a service starting request sent by the second intelligent home equipment; the service starting request comprises a first identifier, wherein the first identifier is as follows: after the second intelligent home equipment determines at least one first intelligent home equipment serving as a service end according to a preset service discovery mechanism and the second intelligent home equipment is connected with each first intelligent home equipment, a user selects from the determined list comprising first identifiers corresponding to services provided by each first intelligent home equipment;

determining service content corresponding to the first identifier according to the first identifier included in the service starting request;

and feeding back the first message carrying the determined service content to the second intelligent home equipment so that the first intelligent home equipment displays the service content carried in the received first message.

Based on the same inventive concept, the embodiments of the present invention provide a computer-readable nonvolatile storage medium storing computer-executable instructions for causing a computer to execute the above-described control method.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, implement the functions specified in the flowchart block or blocks and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. The control method of the intelligent household equipment is characterized by comprising the following steps of:

according to a first identifier selected from the list by a user, a service starting request carrying the first identifier is sent to the first intelligent home equipment corresponding to the selected first identifier, so that the first intelligent home equipment corresponding to the first identifier feeds back a first message carrying service content corresponding to the first identifier according to the service starting request; when the service corresponding to the first identifier is a multimedia synchronization service, before sending a service starting request carrying the first identifier to the selected first smart home device corresponding to the first identifier, the method further comprises: according to a first identifier selected from the list by a user, sending a first multimedia playing content request carrying the selected first identifier to the first intelligent home equipment corresponding to the first identifier according to a preset period, so that the first intelligent home equipment corresponding to the first identifier feeds back a third message carrying a second identifier of the playing multimedia content according to the first multimedia playing content request; according to the second identifier carried in the third message, a second multimedia playing content request carrying the second identifier is sent to an upper-layer device providing the multimedia content, so that the upper-layer device feeds back a fourth message carrying the multimedia content according to the second multimedia playing content request; determining the multimedia content according to the fourth message; the service corresponding to the first identifier is multimedia synchronous service, and the service content corresponding to the first identifier carried in the first message is timestamp information of the multimedia content;

2. The method of claim 1, wherein determining at least one first smart home device as a server according to a preset service discovery mechanism specifically includes:

3. The method of claim 2, wherein determining the list including the first identifiers corresponding to the services that each of the first smart home devices can provide specifically includes:

4. The method of claim 1, wherein the second multimedia play content request includes: the playing resolution of the multimedia content and/or the viewing angle of the multimedia content.

5. The method of claim 1, wherein displaying according to the service content carried in the received first message specifically comprises:

6. The control method of the intelligent household equipment is characterized by comprising the following steps of:

after being connected with second intelligent home equipment serving as a client, receiving a service starting request sent by the second intelligent home equipment; the service starting request comprises a first identifier, wherein the first identifier is as follows: after the second intelligent home equipment determines at least one first intelligent home equipment serving as a service end according to a preset service discovery mechanism and the second intelligent home equipment is connected with each first intelligent home equipment, a user selects from a list which is determined and comprises first identifiers corresponding to services which can be provided by each first intelligent home equipment; when the service corresponding to the first identifier is a multimedia synchronization service, before receiving a service start request sent by the second smart home device, the method further includes: receiving a first multimedia playing content request sent by the second intelligent home equipment; determining a second identifier of the playing multimedia content according to the received first multimedia playing content request; sending a third message carrying a second identifier of the multimedia content being played to the second intelligent home equipment, so that the second intelligent home equipment sends a second multimedia playing content request to an upper-layer equipment providing the multimedia content according to the second identifier carried in the third message, and the upper-layer equipment feeds back a fourth message carrying the multimedia content to the second intelligent home equipment according to the second multimedia playing content request, so that the second intelligent home equipment determines the multimedia content according to the fourth message;

Determining service content corresponding to a first identifier according to the first identifier included in the service starting request; wherein, according to the first identifier included in the service starting request, determining the service content corresponding to the first identifier includes: if the service corresponding to the first identifier is determined to be the multimedia synchronous service according to the first identifier included in the service starting request, determining that the service content corresponding to the first identifier is the time stamp information of the multimedia content;

and feeding back the first message carrying the determined service content to the second intelligent home equipment so that the second intelligent home equipment displays the service content carried in the first message according to the received service content.

7. The method of claim 6, further comprising, prior to receiving the service initiation request sent by the second smart home device:

8. The utility model provides an intelligent household equipment, its characterized in that, intelligent household equipment is as the second intelligent household equipment of customer end, includes:

a memory for storing program instructions;

9. The utility model provides an intelligent household equipment, its characterized in that, intelligent household equipment is as first intelligent household equipment of service end, includes:

a memory for storing program instructions;

after being connected with second intelligent home equipment serving as a client, receiving a service starting request sent by the second intelligent home equipment; the service starting request comprises a first identifier, wherein the first identifier is as follows: after the second intelligent home equipment determines at least one first intelligent home equipment according to a preset service discovery mechanism and the second intelligent home equipment is connected with each first intelligent home equipment, a user selects from the determined list comprising first identifiers corresponding to services provided by each first intelligent home equipment; when the service corresponding to the first identifier is a multimedia synchronization service, before receiving a service start request sent by the second smart home device, the method further includes: receiving a first multimedia playing content request sent by the second intelligent home equipment; determining a second identifier of the playing multimedia content according to the received first multimedia playing content request; sending a third message carrying a second identifier of the multimedia content being played to the second intelligent home equipment, so that the second intelligent home equipment sends a second multimedia playing content request to an upper-layer equipment providing the multimedia content according to the second identifier carried in the third message, and the upper-layer equipment feeds back a fourth message carrying the multimedia content to the second intelligent home equipment according to the second multimedia playing content request, so that the second intelligent home equipment determines the multimedia content according to the fourth message;

10. A computer-readable non-volatile storage medium, characterized in that the computer-readable non-volatile storage medium stores computer-executable instructions for causing a computer to execute the control method of any one of claims 1-7.