WO2020243941A1

WO2020243941A1 - Method for using a communication account such as im to perform management and use of a device, system, electronic apparatus and storage medium

Info

Publication number: WO2020243941A1
Application number: PCT/CN2019/090285
Authority: WO
Inventors: 马增龙
Original assignee: 深圳光大同创新材料有限公司
Priority date: 2019-06-06
Filing date: 2019-06-06
Publication date: 2020-12-10

Abstract

Disclosed in the present invention are a method for using a communication account, such as IM, to perform management and use of a device, a system, an electronic apparatus and a storage medium, relating to the smart home field, and a software and hardware use model, solving the problem in the prior art of complex means of interaction between a user and a device. The method comprises: creating and binding individual device communication accounts for different devices, a device receiving by means of the device communication account a control and use request sent by another individual, and returning device response information; creating and binding an individual user communication account for a user; the user using a mobile terminal to log into the user communication account, and performing information exchange by this means with another other individual, thereby realizing use and control of a device, and communication with other users; creating a transmission relationship for interaction information between communication accounts, the transmission relationship being used to realize information exchange between individuals, thereby realizing a novel human-machine interaction mode of mutual use and control, as well as communication, between individuals.

Description

Method, system, electronic device and storage medium for managing and using equipment using IM and other communication accounts

Glossary

Equipment : includes, but is not limited to, robots, household appliances and other electronic products, vehicles, industrial manufacturing tools, personal computer software, mobile apps and other man-made tools, supplies, application software and services.

Communication account ; refers to the platform account provided by various communication platforms including, but not limited to, instant messaging (IM) account, phone number, email address, and IP address.

Individual : refers to the combination of a device and its IM or other communication account or a combination of a human and its IM or other communication account.

Mobile terminal : including but not limited to personal electronic devices such as desktop computers, notebook computers, mobile phones, tablet computers, and wearable smart hardware.

Technical field

The present invention relates to the field of smart home, the field of use and control of hardware equipment and software, and in particular to a method, system, electronic device and storage medium for managing and using equipment using communication accounts such as IM.

Background technique

In the fields of smart home, industrial production, and application software, there are methods for human users to interact with devices to use and control the devices.

The above-mentioned equipment also has a wide range of types, such as: robots, household appliances and other electronic products, vehicles, industrial manufacturing tools, personal computer software, mobile phone APP and other artificial tools, supplies, application software and services.

At present, people have many methods for remote use and control of hardware devices. Such as remote control, mobile phone APP, etc. The user needs to perform various manual operations. Each device has different ways of using it, and users need to learn and adapt independently. For software, such as Windows software and mobile APP, users need to understand the operating interface of the software, be familiar with the menus of various applications, and click the menu to perform various operations. This method of use brings a lot of inconvenience and knowledge requirements to users. That is to say, under the existing technologies and models, the interaction methods between humans and devices are very diverse and complicated.

technical problem

The main purpose of the present invention is to provide a method, system, electronic device and storage medium for using IM and other communication accounts to manage and use equipment, aiming to solve the problem of low interaction efficiency and inconsistent interaction methods between users and equipment in the prior art Technical issues.

Technical solutions

In order to achieve the above objective, the first aspect of the present invention provides a method for managing and using a device using a communication account such as IM, which includes: establishing and binding independent device communication accounts for different devices, and the device uses all of its binding The device communication account receives control and use requests from other user communication accounts or device communication accounts, executes the complained request and feeds back the response information of the device; establishes and binds independent user communication accounts for different users, and users use mobile terminals Log in to the user communication account, and use the user communication account to interact with other communication accounts, so as to realize the use and control of the device and communication with other users; establish the transmission of interactive information between the communication accounts The transmission relationship is used to realize information interaction between individuals, thereby realizing a new type of human-computer interaction mode of point-to-point and multipoint-to-multipoint mutual use and control between individuals.

Further, the establishing and binding independent device communication accounts for different devices includes: establishing and binding an independent device communication account for each device, and the device receives one or more device communication accounts through its bound device communication account. Control and use requests from other user communication accounts or device communication accounts; after the device operates on the request, the data and operation status are fed back to the requester through the device communication account bound to itself.

Further, the establishment and binding of independent device communication accounts for different devices also includes: establishing and binding an independent user communication account for each human user; the user can log in to his user communication account through different mobile terminals, and Use this user communication account to conduct one-to-one or one-to-many information exchange with other human users; it can also conduct one-to-one, one-to-many human-machine communication with all devices, so as to achieve simultaneous communication with a single device or multiple devices Use and control.

Further, the establishment of a transmission relationship of interactive information between the communication accounts includes: establishing a direct data transmission relationship between multiple communication accounts so that the user can interact with other individuals through a mobile terminal; other individuals refer to other individuals. Single or multiple human users, other single or multiple devices; establish a direct data transmission relationship between multiple communication accounts, so that the device can interact with other individuals through its own communication account; other individuals refer to other single or multiple humans User, other single or multiple devices; establish a human natural language conversion mechanism, which is used to convert the human natural language transmitted by the user or device to the target device into machine instructions and communicate to the target device; the target device responds After the machine instruction, the human natural language conversion mechanism will convert the feedback information of the target device into human natural language and send it back to the user or device.

The second aspect of the present invention provides a system for interacting with devices using communication methods, including: a device account binding module for establishing and binding independent device communication accounts for different devices, and the device is bound to the device The communication account receives control and use requests from other user communication accounts or device communication accounts and feeds back the response information of the device; the user account binding module is used to establish and bind independent user communication accounts for different users. Users use mobile The terminal logs in the user communication account, and uses the user communication account to interact with other communication accounts, so as to realize the use and control of the device and the communication with other users; the transmission relationship establishment module is used for the communication A transmission relationship of interactive information is established between accounts, and the transmission relationship is used to realize information interaction between individuals, thereby realizing a new type of human-computer interaction mode of point-to-point and multipoint-to-multipoint mutual use and control between individuals.

Further, the user account binding module includes: a device and account binding unit for establishing and binding an independent device communication account for each device, and the device receives one or more device communication accounts through the device communication account bound to it. A control and use request sent by a communication account of another user or a communication account of a device; after the device operates on the request, the data and operation status are fed back to the requester through its bound device communication account.

Further, the user account binding module further includes: a human user and account binding unit for establishing and binding an independent user communication account for each human user; the user can log in to his user communication account through different mobile terminals , And use the user communication account to conduct one-to-one or one-to-many information exchange with other human users; it can also conduct one-to-one, one-to-many human-machine communication with all devices to achieve a single device or multiple devices Simultaneous use and control.

Further, the transmission relationship establishment module includes: a first transmission unit, configured to establish a direct data transmission relationship between multiple communication accounts, so that the user can interact with other individuals through the mobile terminal; other individuals refer to other single or Multiple human users, other single or multiple devices; the second transmission unit, used for the direct data transmission relationship between multiple communication accounts, so that the device can interact with other individuals through its own communication account; other individuals refer to other single Or multiple human users, other single or multiple devices; language conversion unit, used to establish a human natural language conversion mechanism, the human natural language conversion mechanism is used to convert the human natural language transmitted by the user or device to the target device into a machine The instruction is transmitted to the target device; after the target device responds to the machine instruction, the human natural language conversion mechanism will convert the feedback information of the target device into human natural language and send it back to the user or device.

A third aspect of the present invention provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and capable of being run on the processor, wherein the processor executes the computer program When, implement any of the above methods.

A fourth aspect of the present invention provides a computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the method described in any one of the above is implemented.

Beneficial effect

The present invention provides a method, system, electronic device and storage medium for interacting with equipment using a communication mode. The beneficial effects are: establishing and binding a user communication account for the user, and establishing and binding a device communication account for the equipment, And after the data transmission relationship between the user communication account and the device communication account is established, the user communication account and the device communication account can interact, so that the user can use the user communication account on the mobile terminal to communicate with the device communication account on the device Interacting with the device allows the user to directly interact with the device, thereby directly using and controlling the device, thereby improving the efficiency of interaction between the user and the device.

Description of the drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a schematic block diagram of the flow of a method for device management and use according to an embodiment of the present invention;

2 is a schematic block diagram of the structure of a system for device management and use according to an embodiment of the present invention;

3 is a schematic block diagram of another structure of a system for device management and use according to an embodiment of the present invention;

4 is a schematic block diagram of the structure of an electronic device according to an embodiment of the present invention.

Embodiments of the invention

In order to make the objectives, features, and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the description The embodiments are only a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work shall fall within the protection scope of the present invention.

Please refer to Figure 1, which is a method of using IM and other communication accounts to manage and use devices, including: S1, establish and bind independent device communication accounts for different devices, and the device receives through its bound device communication accounts Control and use requests sent by other user communication accounts or device communication accounts and feedback the response information of the device, the device can also send use or control requests to other devices through its own device communication account; the device can also actively initiate contact with humans User information interaction; S2. Establish and bind independent user communication accounts for different users. The user uses a mobile terminal to log in to the user communication account, and uses the user communication account to interact with other communication accounts to realize the use and Control and communicate with other users; S3. Establish a transmission relationship of interactive information between communication accounts. The transmission relationship is used to realize information interaction between individuals, thereby achieving point-to-point, single-point-to-multipoint, and multi-point-to-multipoint A new type of human-computer interaction mode for mutual use and control between individuals.

Specifically, the device communication account and the mobile terminal communication account may be an instant messaging account (IM account), phone number, mobile phone number, IP address, etc., and the communication platform is an IM platform or other communication platform. In this embodiment, the device communication account The user communication account is an IM account, and the communication platform is an IM platform.

The establishing and binding independent user communication accounts for different users includes: establishing and binding an independent device communication account for each device, and the device receives one or more other user communication through the device communication account bound to it. The control and use request sent by the account or device communication account; after the device operates on the request, it will feed back the data and operating status to the requester through the device communication account bound to itself; the device can also use the binding The device communication account sends usage or control requests to other devices, and the device can also actively initiate information interaction with human users.

The establishment and binding of independent device communication accounts for different devices also includes: establishing and binding independent user communication accounts for each human user; users can log in to their user communication accounts through different mobile terminals, and use this user The communication account communicates one-to-one or one-to-many information with other human users; it can also communicate with all devices one-to-one, one-to-many, so as to achieve the simultaneous use and control of a single device or multiple devices ; Any combination of information exchanges can also be carried out between human users.

The establishment of a transmission relationship of interactive information between the communication accounts includes: establishing a direct data transmission relationship between multiple communication accounts so that users can interact with other individuals through a mobile terminal; other individuals refer to other single or multiple Individual human users, other single or multiple devices; establish a direct data transmission relationship between multiple communication accounts, so that the device can interact with other individuals through its bound communication accounts; other individuals refer to other single or multiple humans User, other single or multiple devices; establish a human natural language conversion mechanism, which is used to convert the human natural language transmitted by the user or device to the target device into machine instructions and communicate to the target device; the target device responds After the machine instruction, the human natural language conversion mechanism will convert the feedback information of the target device into human natural language and send it back to the user or device.

Specifically, the human natural language conversion mechanism includes: a picture recognition terminal integrated with automatic image recognition technology, a speech recognition terminal integrated with speech conversion text technology, a human natural language semantic recognition terminal integrated, and GPS coordinates and addresses integrated with GPS functions Conversion terminal, text recognition terminal integrated with text recognition technology, video recognition terminal integrated with video recognition technology, and document recognition terminal integrated with document recognition technology; in this embodiment, the human natural language conversion mechanism also integrates machine learning technology , An application scenario of machine recognition technology is as follows: The user says I am sleeping. The system turns off all the lights. The user also said: Turn on the night light. The next day the user said I was asleep. At this time, the night light will not turn off.

In this embodiment, the user communication account bound to the user and the device communication account bound to the device are collectively referred to as individuals;

In addition, mobile terminals include personal electronic devices such as desktop computers, notebook computers, mobile phones, tablet computers, and wearable smart hardware.

The embodiment of the present application provides a system for device management and use. Please refer to Figure 2. The system includes: a device account binding module 1, a user account binding module 2, and a transmission relationship establishing module 3; and a device account binding module 1 Used to establish and bind independent device communication accounts for different devices. The device receives control and use requests from other user communication accounts or device communication accounts through the device communication account bound to it, and feeds back the reply information of the device , The device can also send use or control requests to other devices through the device communication account bound to itself, and the device can also actively initiate information interaction with human users; the user account binding module 2 is used to establish and bind different users An independent user communication account. The user uses a mobile terminal to log in to the user communication account, and uses the user communication account to interact with other communication accounts, so as to realize the use and control of the device and communication with other users; transmission relationship The establishment module 3 is configured to establish a transmission relationship of interactive information between the communication accounts established in the device account binding module 1 and the user account binding module 2, and the transmission relationship is used to implement information interaction between individuals , So as to realize the new human-computer interaction mode of point-to-point, single-point-to-multipoint, and multi-point-to-multipoint mutual use and control between individuals.

The user account binding module 2 includes: a device and account binding unit for establishing and binding an independent device communication account for each device, and the device receives one or more other user communications through the device communication account bound to it The control and use request sent by the account or device communication account; after the device operates on the request, it will feed back the data and operating status to the requester through the device communication account bound to itself; the device can also use the binding The device communication account sends usage or control requests to other devices, and the device can also actively initiate information interaction with human users.

The user account binding module 2 also includes: a human user and account binding unit, which is used to establish and bind an independent user communication account for each human user; users can log in to their user communication account through different mobile terminals and use this The user communication account communicates one-to-one or one-to-many information with other human users; it can also conduct one-to-one, one-to-many human-machine communication with all devices, so as to achieve simultaneous use and control.

The transmission relationship establishment module 3 includes: a first transmission unit, used to establish a direct data transmission relationship between multiple communication accounts, so that users can interact with other individuals through the mobile terminal; other individuals refer to other single or multiple human users , Other single or multiple devices; the second transmission unit is used to establish a direct data transmission relationship between multiple communication accounts so that the device can interact with other individuals through its own communication account; other individuals refer to other single or multiple people Class user, other single or multiple devices; language conversion unit, used to establish a human natural language conversion mechanism, the human natural language conversion mechanism is used to convert the human natural language transmitted by the user or device to the target device into machine instructions and communicate To the target device; after the target device responds to the machine instruction, the human natural language conversion mechanism will convert the feedback information of the target device into human natural language and send it back to the user or device.

Please refer to Figure 3. In this embodiment, multiple users such as user 1, user 2...user N send information directly to device 1, device 2... device N through the IM platform or other communication platforms, and the language conversion mechanism is in the user Language conversion between devices and devices, so that a single user or multiple users can interact with multiple devices behind a single device; in this embodiment, the device takes curtains as an example, and the language conversion mechanism is responsible for the human language and curtain instructions Translate each other to realize the natural language communication between the user and the curtain, thereby realizing the direct interaction between the user and the device, thereby improving the interaction efficiency between the user and the device, and solving the interaction between the user and the device The problem of inconsistent methods.

An embodiment of the present application provides an electronic device. Please refer to 4. The electronic device includes: a memory 601, a processor 602, and a computer program stored in the memory 601 and running on the processor 602, and the processor 602 executes the computer program At the same time, implement the methods of management and use of the equipment described in the foregoing.

Further, the electronic device further includes: at least one input device 603 and at least one output device 604.

The aforementioned memory 601, processor 602, input device 603, and output device 604 are connected via a bus 605.

Among them, the input device 603 may specifically be a camera, a touch panel, a physical button or a mouse, etc. The output device 604 may specifically be a display screen.

The memory 601 may be a high-speed random access memory (RAM, Random Access Memory) The memory can also be non-volatile memory, such as disk memory. The memory 601 is used to store a group of executable program codes, and the processor 602 is coupled with the memory 601.

Further, the embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium may be the electronic device provided in each of the foregoing embodiments, and the computer-readable storage medium may be the aforementioned memory. 601. A computer program is stored on the computer-readable storage medium, and when the program is executed by the processor 602, the method for managing and using the device described in the foregoing embodiment is implemented.

Further, the computer storage medium may also be a U disk, a mobile hard disk, a read-only memory 601 (ROM, Read-Only Memory), RAM, magnetic disks or optical disks and other media that can store program codes.

In the several embodiments provided in this application, it should be understood that the disclosed device and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division, and there may be other divisions in actual implementation, for example, multiple modules or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or modules, and may be in electrical, mechanical or other forms.

The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional modules in each embodiment of the present invention may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules.

If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present invention essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention.

It should be noted that for the foregoing method embodiments, for simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described sequence of actions. Because according to the present invention, certain steps can be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the involved actions and modules are not necessarily all required by the present invention.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in an embodiment, reference may be made to related descriptions of other embodiments.

The above is a description of the method, system, electronic device, and computer-readable storage medium for the management and use of a device provided by the present invention. For those skilled in the art, according to the ideas of the embodiments of the present invention, in the specific implementation and There will be changes in the scope of application. In summary, the content of this specification should not be construed as limiting the present invention.

Claims

A method for using communication accounts such as IM to manage and use equipment, which is characterized in that it includes:

Establish and bind independent device communication accounts for different devices. The device receives control and use requests from other user communication accounts or device communication accounts through the device communication account bound to it, and the device executes the request and feeds back the request. The reply information of the device; the device can also send use or control requests to other devices through the device communication account bound to itself; the device can also actively initiate information interaction with human users;

Establish and bind independent user communication accounts for different users. The user uses a mobile terminal to log in to the user communication account, and uses the user communication account to interact with other communication accounts, thereby realizing the use and control of the device and the Communication with other users;

To establish a transmission relationship of interactive information between the communication accounts, the transmission relationship is used to realize information interaction between individuals, thereby realizing point-to-point, single-point-to-multipoint, and multi-point-to-multipoint mutual use between individuals And control the new type of human-computer interaction mode.
The method for managing and using devices using communication accounts such as IM according to claim 1, wherein said establishing and binding independent device communication accounts for different devices comprises:

Establish and bind an independent device communication account for each device, and the device receives control and use requests from one or more other user communication accounts or device communication accounts through the device communication account bound; After the operation is requested, the data and operation status will be fed back to the requester through the device communication account bound to it; the device can also send use or control requests to other devices through the device communication account bound to it, and the device can also initiate actively Information interaction with human users.
The method for managing and using devices using communication accounts such as IM according to claim 1, wherein the establishing and binding independent device communication accounts for different devices further comprises:

Establish and bind an independent user communication account for each human user; users can log in to their user communication account through different mobile terminals, and use the user communication account to communicate one-to-one or one-to-many with other human users; It can also conduct one-to-one, one-to-many human-machine communication with all devices, so as to achieve the simultaneous use and control of a single device or multiple devices; human users can also exchange information in any combination.
The method for managing and using a device using a communication account such as IM according to claim 2, wherein:

The establishing a transmission relationship of interactive information between the communication accounts includes:

Establish a direct data transmission relationship between multiple communication accounts so that users can interact with other individuals through the mobile terminal; other individuals refer to other single or multiple human users, other single or multiple devices;

Establish a direct data transfer relationship between multiple communication accounts, so that the device can interact with other individuals through its own bound communication account; other individuals refer to other single or multiple human users, other single or multiple devices;

Establish a human natural language conversion mechanism, the human natural language conversion mechanism is used to convert the human natural language transmitted by the user or device to the target device into machine instructions and transmit them to the target device; after the target device responds to the machine instructions, the human natural language The conversion mechanism will convert the feedback information of the target device into human natural language and send it back to the user or device.
A system for using communication accounts such as IM to manage and use equipment, which is characterized in that it includes:

The device account binding module is used to establish and bind independent device communication accounts for different devices. The device receives control and use requests from other user communication accounts or device communication accounts through the device communication account bound to it. The device executes the request and feeds back the response information of the device. The device can also send use or control requests to other devices through the device communication account bound to itself, and the device can also actively initiate information interaction with human users;

The user account binding module is used to establish and bind independent user communication accounts for different users. The user uses a mobile terminal to log in to the user communication account, and uses the user communication account to interact with other communication accounts to achieve Use and control the equipment and communicate with other users;

The transmission relationship establishment module is used to establish a transmission relationship of interactive information between the communication accounts, and the transmission relationship is used to realize information interaction between individuals, thereby realizing point-to-point, single-point-to-multipoint, and multi-point-to-multipoint A new type of human-computer interaction model for mutual use and control between individuals.
The system for managing and using devices using communication accounts such as IM according to claim 5, characterized in that:

The user account binding module includes:

The device and account binding unit is used to establish and bind an independent device communication account for each device, and the device receives one or more other user communication accounts or device communication accounts through the device communication account bound to it. Control and use request; after the device operates on the request, it will feed back the data and operating status to the requester through its bound device communication account; the device can also send use to other devices through the device communication account bound to itself Or control request, the device can also actively initiate information interaction with human users.
The system for managing and using devices using communication accounts such as IM according to claim 5, characterized in that:

The user account binding module further includes:

The human user and account binding unit is used to establish and bind an independent user communication account for each human user; users can log in to their user communication account through different mobile terminals, and use this user communication account to communicate with other human users One-to-one or one-to-many information exchange; also one-to-one, one-to-many man-machine communication with all devices, so as to achieve the simultaneous use and control of a single device or multiple devices.
The system for managing and using devices using communication accounts such as IM according to claim 6, characterized in that:

The transmission relationship establishment module includes:

The first transmission unit is used to establish a direct data transmission relationship between multiple communication accounts so that users can interact with other individuals through the mobile terminal; other individuals refer to other single or multiple human users, and other single or multiple devices ；

The second transmission unit is used for the direct data transmission relationship between multiple communication accounts, so that the device can interact with other individuals through its own communication account; other individuals refer to other single or multiple human users, other single or multiple devices ；

The language conversion unit is used to establish a human natural language conversion mechanism. The human natural language conversion mechanism is used to convert the human natural language transmitted by the user or device to the target device into machine instructions and transmit them to the target device; after the target device responds to the machine instructions The human natural language conversion mechanism will convert the feedback information of the target device into human natural language and send it back to the user or device.
An electronic device, comprising: a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor implements claim 1 when the computer program is executed by the processor To the method described in any one of 4.
A computer-readable storage medium with a computer program stored thereon, wherein the computer program implements the method described in any one of claims 1 to 4 when the computer program is executed by a processor.