[ summary of the invention ]
In order to solve the above problems in the prior art, the present invention provides a touch-enabled shared device system, which has the following technical solutions:
comprises a plurality of sharing devices, a cloud server and a plurality of touch control type user terminals,
the cloud server supports a cloud protocol in a distributed cloud control system protocol, the touch-control user terminals and the sharing devices all have user terminal protocols, and the user terminal protocols and the cloud protocol of the cloud server are based on the same distributed cloud control protocol;
the cloud server comprises a gesture command database device, a hand image searching device, an authorized user hand image database device, a touch gesture command analyzing device, a gesture command storing device, a gesture track comparing device, a standard hand image storing device and a hand size comparing device;
the sharing device comprises a microprocessor, a sensor, a wireless communication module and a device unit, wherein the microprocessor is used for receiving a gesture command analyzed by the cloud server and controlling the device unit to operate;
the gesture command database device correspondingly stores gesture tracks, equipment units and corresponding operation commands;
the touch control type user side comprises a touch control gesture input device, a touch control gesture command setting device, an authority control device, a touch control gesture sending device, a hand static image acquisition device and a head image acquisition device;
the touch gesture input device inputs a gesture track of a user through touch;
the touch gesture sending device sends a gesture track input by a user to a cloud server;
the touch gesture command analysis device is used for receiving a user gesture track from a touch client, matching and searching the gesture track in the gesture command database module, obtaining an equipment unit operation command corresponding to the user gesture track, and transmitting the analyzed equipment unit operation command to a corresponding equipment unit;
the authority control device is used for carrying out authority management and control on gesture setting and operation of the sharing equipment and comprises a hand static image acquisition module, a touch gesture setting authority management module and a child operation authority limiting module;
the touch gesture command setting device is used for setting a gesture corresponding to an operation command of the sharing equipment by a user and comprises a permission checking triggering module and a touch gesture command setting module;
wherein the authorized user hand image database device stores therein a static image of a user hand having a touch gesture command setting authority; the hand static image acquisition device is used for acquiring a static image of the hand;
the permission check triggering module is used for triggering a touch gesture setting permission management module in the permission control device to manage whether the user has the setting permission of the touch gesture after the user selects the touch gesture command setting option;
the touch control gesture setting authority management module is used for managing the setting authority of the touch control gestures of the plurality of sharing devices by a user, receiving authority triggering check information from the authority checking trigger module in the touch control gesture command setting device, and transmitting the static image of the hand of the user, which is acquired by the hand static image acquisition module, to the hand image searching device of the cloud server;
the hand image searching device in the cloud server matches and searches the acquired static image of the hand of the user with the touch gesture command setting authority stored in the hand image database device of the authorized user, if the matched hand image is searched, the authority checking result is the setting of the touch gesture command allowed by the user, otherwise, the authority checking result is the setting of the touch gesture command refused by the user, and the authority checking result is transmitted to a touch gesture command setting module in the touch gesture command setting device of the touch user side;
the touch gesture command setting module comprises a gesture track acquisition sub-module, a gesture command setting sub-module and a gesture command transmission sub-module;
the gesture track acquisition submodule is used for acquiring the movement track of the user gesture and transmitting the movement track of the gesture to the gesture track comparison device of the cloud server when the right check result is the setting of a command allowing the user to touch the gesture;
the gesture track comparison device is used for comparing the obtained movement track of the user gesture with the movement track of the set gesture stored in the gesture command database device, if the same gesture track is obtained, the comparison result is that the gesture movement track input by the user is successfully matched, otherwise, the comparison result is that the matching is failed, and the comparison result is transmitted to a gesture command setting submodule in a touch gesture command setting module of the touch user terminal;
the gesture command setting submodule is used for prompting the user to select an operation command corresponding to the movement track and a corresponding equipment unit when the received comparison result indicates that the movement track matching of the gesture input by the user fails, and setting a gesture command, and when the received comparison result indicates that the movement track matching of the gesture input by the user succeeds, the user needs to input different movement tracks again;
the gesture command transmitting submodule is used for transmitting the equipment unit corresponding to the set gesture, the operation command and the corresponding gesture track to a gesture command storage device of the cloud server;
the gesture command storage device stores the received gesture tracks, the equipment units and the corresponding operation commands into a gesture command database device;
the child operation authority limiting module comprises a starting judgment sub-module and an image acquisition sub-module;
the starting judgment submodule is used for triggering the image acquisition submodule to shoot a static image of a hand of a user and transmitting the static image of the hand of the user to the hand size comparison module of the cloud server when the user sends a touch gesture for starting a specific equipment unit;
the hand size comparison module is used for comparing the size of the static image of the hand of the user shot by the received image acquisition sub-module with the size of a standard hand image stored in the standard hand image storage device, judging that the user is an adult or a suspected child according to a comparison result, transmitting the touch gesture of the user to the specific equipment unit to the gesture command analysis device when the comparison result indicates that the user is the adult, allowing the user to operate the specific equipment unit, and transmitting the comparison result to the touch type user side when the comparison result indicates that the user is the suspected child;
when the touch control type user end receives the comparison result and indicates that the user is suspected of being a child, starting a head image acquisition device to acquire a head image of the user and transmitting the head image to a cloud server;
the cloud server transmits the head image to a touch control type user end of a user with an administrator identity,
the touch control type user side of the user with the administrator identity is used for determining whether the user is a child or not according to the received head image and transmitting a determination result to the cloud server;
and when the comparison result indicates that the user is a child, the cloud server does not transmit the touch gesture of the user on the specific equipment unit to the gesture command analysis device, and rejects the operation of the user on the specific equipment unit.
According to the touch gesture control system, the setting of the touch gesture by the user can be realized under the authority control, the child identities of other users can be monitored in real time by the user with the administrator identity, the setting of the touch gesture is more flexible and humanized, the safety of the authority management of the touch gesture is improved, and meanwhile, the shared equipment can be controlled by the gesture without the need of equipment such as a mobile phone terminal.
[ detailed description ] embodiments
The present invention will now be described in detail with reference to the drawings and specific embodiments, wherein the exemplary embodiments and descriptions are provided only for the purpose of illustrating the present invention and are not to be construed as unduly limiting the invention.
The basic idea of the invention is: the setting of the user to the touch control gesture under the authority control is achieved, and the user with the administrator identity monitors the child identities of other users in real time, so that the setting of the touch control gesture is more flexible and humanized, the authority control is performed, and the safety of the authority management of the touch control gesture is improved.
The invention discloses a touch gesture control system of shared equipment, which adopts the technical scheme as follows:
the system comprises a plurality of sharing devices, a cloud server and a plurality of touch control type user terminals, wherein a user controls the sharing devices to purchase goods or controls goods selling devices to distribute goods by using the touch control type user terminals;
in an embodiment of the present invention, a sharing device with a touch-controlled user end is provided, for example, a touch-controlled tablet pc is provided on the sharing device, and a user can implement an online shopping mall platform preview/order-placing function through the touch-controlled tablet pc, and for example, a consumer wants to purchase fresh meat on a certain device, but the fresh meat in the device is sold out, so the consumer can place an order through the touch screen, select the fresh meat, then select a delivery address, and after placing the order, the delivery person delivers the fresh meat to a designated address required by the consumer according to a corresponding request. Or the consumer can select the scheduled time to extract the fresh meat from the equipment, the dispensing personnel only need to dispense the fresh meat to the equipment before the scheduled time, and the consumer can extract the fresh meat by himself. The delivery address may be at the discretion of the consumer.
In one embodiment, the cloud server supports a cloud protocol in a distributed cloud control system protocol, the plurality of touch clients and the plurality of sharing devices have client protocols, and the client protocols and the cloud protocol of the cloud server are based on the same distributed cloud control protocol;
as shown in fig. 1, the cloud server includes a gesture command database device, a hand image searching device, an authorized user hand image database device, a touch gesture command parsing device, a gesture command storing device, a gesture trajectory comparing device, a standard hand image storing device, and a hand size comparing device;
in one embodiment, the sharing device comprises a microprocessor, a sensor, a wireless communication module and a device unit, wherein the microprocessor is used for receiving gesture commands analyzed by a cloud server and controlling the device unit to operate;
the gesture command database device correspondingly stores gesture tracks, equipment units and corresponding operation commands;
as shown in fig. 2, the touch-control user side includes a touch-control gesture input device, a touch-control gesture command setting device, an authority control device, a touch-control gesture sending device, a hand static image obtaining device, and a head image obtaining device;
in one embodiment, the hand still image capturing device and the head image capturing device are cameras; the touch gesture input device is a touch screen.
The touch gesture input device inputs a gesture track of a user through touch, and in one embodiment, the touch input to a touch screen can be realized through a hand or a touch pen, and the touch gesture track of the user is input;
the touch gesture sending device sends a gesture track input by a user to a cloud server;
the touch gesture command analysis device is used for receiving a user gesture track from a touch client, matching and searching the gesture track in the gesture command database module, obtaining an equipment unit operation command corresponding to the user gesture track, and transmitting the analyzed equipment unit operation command to a corresponding equipment unit;
the authority control device is used for carrying out authority management and control on gesture setting and operation of the sharing equipment and comprises a hand static image acquisition module, a touch gesture setting authority management module and a child operation authority limiting module;
the touch gesture command setting device is used for setting a gesture corresponding to an operation command of the sharing equipment by a user and comprises a permission checking triggering module and a touch gesture command setting module;
wherein the authorized user hand image database device stores therein a static image of a user hand having a touch gesture command setting authority; in one embodiment, the images of the hands of the user with the touch gesture command setting authority are captured in advance and stored in the authorized user hand image database device, for example, the family members with the administrator identity in the family, or the middle-aged members such as father, mother and the like in the family, while the children or guests generally do not have the touch gesture command setting authority.
The hand static image acquisition device is used for acquiring a static image of the hand;
the permission check triggering module is used for triggering a touch gesture setting permission management module in the permission control device to manage whether the user has the setting permission of the touch gesture or not after the user selects and sets a touch gesture command option, and in one embodiment, the touch gesture command option can be set as a touch button or an option in a touch menu in the touch client;
the touch control gesture setting authority management module is used for managing whether touch control gestures of a plurality of sharing devices have setting authority or not by a user, receiving authority triggering checking information from the authority checking triggering module in the touch control gesture command setting device, and transmitting static images of the hands of the user, acquired by the hand static image acquisition module, to the hand image searching device of the cloud server;
the hand image searching device in the cloud server performs matching search on the acquired static image of the hand of the user and the static image of the hand of the user with the touch gesture command setting authority stored in the authorized user hand image database device, wherein the matching search includes but is not limited to matching comparison of textures, gray scales, shapes, lengths and sizes of two images, if the matched hand image is searched, the authority checking result is that the user is allowed to set the touch gesture command, otherwise, the authority checking result is that the user is refused to set the touch gesture command, and the authority checking result is transmitted to a touch gesture command setting module in the touch gesture command setting device of the touch client;
the touch gesture command setting module comprises a gesture track acquisition sub-module, a gesture command setting sub-module and a gesture command transmission sub-module;
the gesture track acquisition submodule is used for acquiring the movement track of the gesture of the user and transmitting the movement track of the gesture to the gesture track comparison device of the cloud server when the right check result is that the touch gesture command of the user is allowed to be set, and in one embodiment, the gesture track acquisition submodule is a camera;
the gesture track comparison device is used for comparing the obtained movement track of the user gesture with the movement track of the set gesture stored in the gesture command database device, if the same gesture track is obtained, the comparison result is that the gesture movement track input by the user is successfully matched, otherwise, the comparison result is that the matching is failed, and the comparison result is transmitted to a gesture command setting submodule in a touch gesture command setting module of the touch user terminal;
the gesture command setting submodule is used for prompting the user to select an operation command corresponding to the movement track and a corresponding equipment unit when the received comparison result indicates that the movement track of the gesture input by the user is matched unsuccessfully, and setting a gesture command;
the gesture command transmitting submodule is used for transmitting the equipment unit corresponding to the set gesture, the operation command and the corresponding gesture track to a gesture command storage device of the cloud server;
the gesture command storage device stores the received gesture tracks, the equipment units and the corresponding operation commands into a gesture command database device;
the child operation authority limiting module comprises a starting judgment sub-module and an image acquisition sub-module, wherein the image acquisition sub-module is a camera in one embodiment;
the starting judgment submodule is used for triggering the image acquisition submodule to shoot a static image of a hand of a user and transmitting the static image of the hand of the user to the hand size comparison module of the cloud server when the user sends a touch gesture for starting a specific equipment unit;
in one embodiment, for example, the user sends a touch gesture to open the shared device, the specific device unit includes, but is not limited to, a shared refrigerator, a storage cabinet, a microwave oven, etc., since the child cannot well master how to use the shared device, the child is not allowed to start the device unit in order to prevent an operation accident, etc., and the health and safety of the child can be ensured.
The hand size comparison module is used for comparing the size of the static image of the hand of the user shot by the received image acquisition sub-module with the size of a standard hand image stored in a standard hand image storage device, wherein the standard hand image is an image of the average size of a common adult hand, the standard hand image is different in size from an adult hand, and the sizes of male and female hands are also different, and in one embodiment, the image of the average size of the common adult hand can be acquired by performing sampling data analysis on a plurality of adult hand images;
while the hand size of the child under 12 years old is smaller than the average size of the ordinary adult, in one embodiment, the child under 12 years old is regarded as the child, and other age limits can be set, if the child under 14 years old, 16 years old and the like exist, of course, individual situations exist, some adult female hands are also relatively small, some child hands are relatively large, but the size is normally within a threshold range, so an online threshold value for comparison is set, and further the family member with the administrator identity judges in real time when the above threshold value is out of the threshold value, firstly the user is judged to be an adult or a suspected child according to the hand image comparison result, when the static image of the hand of the user is taken to be compared with the standard hand image stored in the standard hand image storage device in size, the former is larger than the latter, the comparison result indicates that the user is an adult, transmitting the touch gesture of the user on the specific equipment unit to a gesture command analysis device, allowing the user to operate the specific equipment unit, otherwise, indicating that the user is suspected child according to the comparison result, and transmitting the comparison result to a touch user side when the user is suspected child according to the comparison result;
when the touch control type user end receives the comparison result and indicates that the user is suspected of being a child, starting a head image acquisition device to acquire a head image of the user and transmitting the head image to a cloud server;
the cloud server transmits the head image to a touch control type user end of a user with an administrator identity,
the touch control type user side of the user with the administrator identity is used for determining whether the user is a child or not according to the received head image and transmitting a determination result to the cloud server;
and when the comparison result indicates that the user is a child, the cloud server does not transmit the touch gesture of the user on the specific equipment unit to the gesture command analysis device, and rejects the operation of the user on the specific equipment unit.
The user can be preset to different authority levels according to the identity, including an administrator, common family members, guests and the like.
According to the method and the system, whether the user with the administrator identity is the child identity or not is monitored in real time through the head image, the problem of inaccuracy in the prior art is avoided, and the safety and the accuracy of authority management are improved.
The above description is only a preferred embodiment of the present invention, and all equivalent changes or modifications of the structure, characteristics and principles described in the present invention are included in the scope of the present invention.