CN111983984A - Control right distribution method, device, equipment and medium - Google Patents

Control right distribution method, device, equipment and medium Download PDF

Info

Publication number
CN111983984A
CN111983984A CN202010836606.4A CN202010836606A CN111983984A CN 111983984 A CN111983984 A CN 111983984A CN 202010836606 A CN202010836606 A CN 202010836606A CN 111983984 A CN111983984 A CN 111983984A
Authority
CN
China
Prior art keywords
target
control right
target device
target object
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010836606.4A
Other languages
Chinese (zh)
Other versions
CN111983984B (en
Inventor
朱理森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Anhui Hongcheng Opto Electronics Co Ltd
Original Assignee
Anhui Hongcheng Opto Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anhui Hongcheng Opto Electronics Co Ltd filed Critical Anhui Hongcheng Opto Electronics Co Ltd
Priority to CN202010836606.4A priority Critical patent/CN111983984B/en
Publication of CN111983984A publication Critical patent/CN111983984A/en
Priority to PCT/CN2020/136930 priority patent/WO2022036966A1/en
Application granted granted Critical
Publication of CN111983984B publication Critical patent/CN111983984B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G05B19/4183Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by data acquisition, e.g. workpiece identification
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G05B19/41835Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by programme execution
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G05B19/41845Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by system universality, reconfigurability, modularity
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • G05B19/4188Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by CIM planning or realisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition

Abstract

The application discloses a control right distribution method, a control right distribution device, control right distribution equipment and a control right distribution medium. The method comprises the following steps: acquiring a first image of a target object; determining first behavior information of the target object based on the first image; and in the case that the first behavior information is determined to be used for representing that the target object requests the control right of the target device, the control right of the target device is distributed to the target object. According to the embodiment of the application, the problem of resource waste in the scene that a plurality of users need to acquire the control right of the intelligent device in parallel can be solved.

Description

Control right distribution method, device, equipment and medium
Technical Field
The present application relates to the field of data services, and in particular, to a method, an apparatus, a device, and a medium for allocating control rights.
Background
Currently, intelligent devices (such as intelligent large-screen interaction devices and intelligent televisions) are mostly controlled through remote control devices. In some application scenarios, there is a need for parallel control of the same intelligent device by multiple users. For example, in a multi-user conference scene or a teaching interaction scene, a plurality of users are required to perform parallel control on the intelligent device.
If a plurality of users want to perform parallel control on the same intelligent device, currently, each user is equipped with a remote control device, so that the users can acquire the control right of the intelligent device by using the remote control device. However, equipping each user with a remote control device increases hardware costs, resulting in wasted resources.
Disclosure of Invention
The application provides a control right distribution method, a control right distribution device, control right distribution equipment and a control right distribution medium, which can solve the problem of resource waste in a scene that a plurality of users need to acquire the control right of intelligent equipment in parallel.
A first aspect of the present application provides a control right allocation method, including:
acquiring a first image of a target object;
determining first behavior information of the target object based on the first image;
and in the case that the first behavior information is determined to be used for representing that the target object requests the control right of the target device, the control right of the target device is distributed to the target object.
A second aspect of the present application provides a control right assignment device, including:
the first image acquisition module is used for acquiring a first image of a target object;
a first behavior information determination module for determining first behavior information of the target object based on the first image;
and the control right distribution module is used for distributing the control right of the target equipment to the target object under the condition that the first behavior information is determined to be used for representing the control right of the target equipment requested by the target object.
A third aspect of the present application provides a control right assignment device including: a processor and a memory storing computer program instructions; the processor, when executing the computer program instructions, implements the control right assignment method as provided in the first aspect above.
A fourth aspect of the present application provides a computer storage medium having computer program instructions stored thereon, which when executed by a processor implement the control right allocation method as provided in the first aspect above.
According to the embodiment of the application, the first behavior information of the target object is identified by using the acquired first image of the target object, and the control right of the target device is allocated to the target object when the first behavior information is determined to be used for representing the control right of the target device requested by the target object. By the control right distribution method, distribution of the control right of the target equipment can be completed according to the behavior information of the target object. Therefore, the target object can acquire the control right of the target device through the behavior of the target object, and the remote control device does not need to be configured, so that the hardware cost is reduced, and the resources are saved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic flow chart diagram of a first embodiment of a control right assignment method provided in accordance with the present application;
FIG. 2 is a schematic flow chart diagram of a second embodiment of a control right assignment method provided in accordance with the present application;
FIG. 3 is a schematic flow chart diagram of a third embodiment of a control right assignment method provided in accordance with the present application;
FIG. 4 is a schematic flow chart diagram of a fourth embodiment of a control right assignment method provided in accordance with the present application;
FIG. 5 is a schematic diagram of an embodiment of a control right distribution apparatus according to the present application;
fig. 6 is a schematic structural diagram of an embodiment of a control right distribution apparatus provided in the present application.
Detailed Description
Features and exemplary embodiments of various aspects of the present application will be described in detail below, and in order to make objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail below with reference to the accompanying drawings and the embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present application by illustrating examples thereof.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Under the scene that a plurality of users want to perform parallel control on the same intelligent device, currently, each user is equipped with a remote control device, so that each user can acquire the control right of the intelligent device by using the respective remote control device. For example, in an application scenario of a multi-person conference, in order to improve conference efficiency, each participant in the conference needs to control an interactive display device in a conference room. It is currently necessary to pre-configure each participant with a remote control device capable of controlling the interactive display device in the conference room. However, equipping each participant with a remote control device increases hardware costs and wastes resources.
In order to solve the above problems, the present application provides a method, an apparatus, a device, and a medium for allocating a control right, where a target object may obtain a control right of a target device by using its own behavior, and a remote control device does not need to be configured for the target object, so that hardware cost may be reduced and resources may be saved.
For the sake of understanding, the control right assignment method provided in the present application is described in detail below with reference to specific embodiments and the accompanying drawings.
Fig. 1 is a schematic flowchart of a first embodiment of a control right distribution method according to the present application. The execution subject of the control right distribution method provided by the application can be a target device with an interactive screen. Wherein the target device is a controlled device. For example, the target device may be a smart teaching device, a smart television, or a smart computer.
As shown in fig. 1, the control right assignment method 100 provided by the present application includes steps 110 to 130.
Step 110, a first image of a target object is acquired.
In some embodiments of the present application, the target object may be a separate entity that issues the action. In some examples, the target object may be an object such as a person or anthropomorphic device. For example, in a meeting room scenario, the target object may be a person participating in a meeting. As another example, in a classroom setting, the target object may be a teacher or a student.
In an embodiment of the present application, the first image of the target object may be one static image of the target object, or may be a sequence of images of the target object, i.e. a plurality of images of the target object.
In some embodiments of the present application, the first image of the target object may be acquired by a pre-configured image acquisition device in the target device. In some examples, the image capture device may be a general camera, a three-dimensional camera, or other sensor device that captures images.
In some embodiments of the present application, if there are multiple target objects within an image acquisition area of an image acquisition device, the image acquisition device may acquire an image of the image acquisition area and obtain a first image of each target object from the image.
For example, object detection may be performed on the image of the image acquisition area using a pre-trained object detection model to obtain a first image of each target object.
Step 120, determining first behavior information of the target object based on the first image.
In some embodiments of the present application, the first behavior information of the target object may be identified by extracting a biometric feature of the target object in the first image. As one example, the first behavior information of the target object may be determined by extracting facial expression features and human posture features of the target object in the first image.
In some embodiments of the present application, the first image of the target object may also be input into a pre-trained behavior recognition model, so as to obtain first behavior information of the target object.
In an embodiment of the present application, a behavior recognition model may be trained using a sample image including an object and behavior labels corresponding to the sample image. As one example, the behavior recognition model may be a naive bayes classifier, an artificial neural network classifier, a support vector machine classifier, a convolutional neural network model, or a cyclic neural network model, among others.
In some examples, if the first image of the target object is a single image of the target object, the first image is input into a pre-trained behavior recognition model to obtain a behavior recognition result, i.e., first behavior information. For example, if the target object is a user a who participates in a conference. And if the first image of the user A is the image of the nodding of the user A, inputting the first image into the behavior recognition model, and obtaining the first behavior information of the user A as the nodding.
In some examples, if the first image of the target object is an image sequence of the target object, each image in the image sequence may be input into the behavior recognition model, so as to obtain a behavior recognition result corresponding to each image; and then obtaining first behavior information of the target object based on the behavior recognition result corresponding to each image.
As an example, the first image of the target object is a plurality of images of the target image acquired at preset time intervals, i.e., an image sequence of the target object. If each image in the image sequence of the target object is input into the behavior recognition model, and the behavior recognition result corresponding to each image is obtained as the target object gazing the target device, since the behavior recognition result of the target object gazing the target device can be obtained based on each image in the image sequence, the first behavior information of the target object can be obtained as the concentration behavior of the target object on the target device.
For another example, if the behavior recognition result of each image in a part of images in the image sequence is that the target object gazes at the target device, and the behavior recognition result of another part of images in the image sequence is that the target object is a head-of-point behavior, the first behavior information of the target object includes a head-of-point behavior after the head-of-point behavior and a concentration behavior of the target device.
And step 130, in the case that the first behavior information is determined to be used for representing that the target object requests the control right of the target device, the control right of the target device is distributed to the target object.
In some embodiments of the present application, a first request behavior for characterizing that the target object requests the control right of the target device may be set in advance. The first request behavior may be a specific behavior set in advance, such as a concentration behavior, a nod behavior, or a recruit behavior, etc., for the target device.
In some examples, the first request behavior may also include a plurality of behaviors, e.g., the first request behavior may include a focus on behavior of the target device followed by a nod behavior.
In the embodiment of the present application, if the first behavior information matches a preset first request behavior, the first behavior information is used to represent that the target object requests the control right of the target device, and then the target device may assign its own control right to the target object.
After the target device allocates the control right to the target object, the target device allocates the relevant resources to the target object so as to realize the control of the target device by the subsequent target object.
In the embodiment of the present application, if a plurality of target objects exist in the image capturing area of the image capturing device of the target device, the control right of the target device may be allocated to each target object according to the control right allocation method provided above, so that the target device may be controlled by a plurality of target objects in parallel.
In an embodiment of the present application, first behavior information of a target object is recognized by using an acquired first image of the target object. And in the case that the first behavior information is determined to be used for representing that the target object requests the control right of the target device, the control right of the target device is distributed to the target object. By the control right distribution method, the control right of the target device can be distributed according to the behavior information of the target object, so that the target object can acquire the control right of the target device through own behavior without configuring a remote control device. Therefore, the hardware cost can be reduced, and the resources can be saved.
In some embodiments of the present application, in order to meet usage requirements of a target device in different scenarios, in a case that it is determined that first behavior information is used to characterize a target object and request a control right of the target device, before allocating the control right of the target device to the target object, the control right allocation method provided by the present application further includes: acquiring first information related to the control right of the target equipment; and determining that the first information meets a preset control right distribution condition.
Wherein the first information comprises at least one of the following information: characteristic information of the target object and a first state parameter of the target device.
In some embodiments, the first state parameter of the target device may comprise at least one of: the control right distribution authority of the target device, the running state parameter of the target device and the current control right distribution mode of the target device.
As an example, the control right assignment right of the target device refers to whether the target device supports assignment of the control right. That is, whether the target device supports dynamic access of the target object.
As an example, the operational state parameters of the target device include at least one of the following parameters: a current running time of the target device, a target number of objects having a control right of the target device, and processing performance information of the target device.
It should be noted that the control right assignment pattern of the target device may be any one of the following control right assignment patterns:
(1) exclusive mode
The exclusive mode (i.e., the second control right allocation mode) is a mode capable of allocating only the control right of the target device to one object. That is, in the exclusive mode, the target device can only allow one object to access. If the current control right allocation mode of the target device is the exclusive mode and the target device does not allocate the control right to any object yet, the control right of the target device is allocated to the target object when the target device determines that the first behavior information of a certain target object is used for representing that the target object requests the control right of the target device.
In the exclusive mode, if the target device has already assigned control to one object, if other objects request control of the target device, the target device will refuse to assign control to other objects, i.e., the target device will not assign control to other objects.
(2) Parallel mode
Parallel mode refers to a mode in which the target device can assign control to N objects, each of which is equal. N is an integer greater than or equal to 1.
In the parallel mode, each object to which the control right of the target device is assigned is peer-to-peer. Each object can independently and autonomously request to acquire the control right of the target device and request to cancel the control right of the target device. That is, each object having the control right of the target device can independently and autonomously access or exit the target device without interfering with each other. In the parallel mode, each object having control of the target device cannot actively intervene and manage the control of the target device by other objects.
(3) Master-slave mode
The master-slave mode refers to a mode in which the target device can assign control to N objects and at least one manager exists in the objects. Wherein the administrator in the plurality of objects can manage the control right of the target device by other non-administrators having the control right of the target device.
The manager is a special object, and besides controlling the target device like a general object, the manager can also perform other predefined functions, such as managing other objects accessing the same target device. For example, the administrator may prohibit the target device from assigning control to a specified object, the administrator may remove control of the target device by an object, the administrator may upgrade a non-administrator to an administrator, and so on.
In the master-slave mode, similar to the parallel mode, each object to which the control right of the target device is assigned may independently and autonomously request to acquire the control right of the target device and request to cancel the control right of the target device. That is, each object having the control right of the target device can independently and autonomously access or exit the target device without interfering with each other.
In the embodiment of the present application, the target device has the above three control right distribution modes, and may also have other types of control right distribution modes, which is not limited herein.
In an embodiment of the present application, the first information may include different types of information, and each type of information has a corresponding preset control right assignment condition. And when each type of information in the first information meets the corresponding preset control right distribution condition, determining that the first information meets the preset control right distribution condition.
If the first information includes the control right distribution authority of the target device, the preset control right distribution condition includes that the target device supports distribution of the control right.
If the first information includes the control right distribution authority of the target device, after the first information is acquired, whether the target device supports distribution of the control right can be judged according to the acquired control right distribution authority of the target device. If the target device does not support the distribution of the control right, the target device can directly refuse to distribute the control right to the target object.
If the target device supports the allocation of the control right, it may be determined whether other information in the first information satisfies a corresponding control right allocation condition. The order of judging whether the other types of information except the control right distribution authority in the first information satisfy the corresponding preset control right distribution condition is not specifically limited.
If the first information includes a target number of objects having a control right of the target device, the preset control right distribution condition includes that the target number is smaller than a first preset number. The first preset number is a preset maximum number of objects for which the current control right assignment mode of the target device supports assignment of the control right by the target device. For example, in the exclusive mode, the first preset number is 1. In the parallel mode or the master-slave mode, the first predetermined number is 10.
If the first information includes the current control right distribution mode of the target device, the preset control right distribution condition includes that the current control right distribution mode is not the second control right distribution mode, or the current control right distribution mode is the second control right distribution mode and the target device does not distribute the control right to any object. The second control right allocation mode is the exclusive mode.
If the first information includes the current running time of the target device, the preset control right distribution condition includes that the running time is within a first preset time range. For example, the first preset time range is the working time of a working day.
If the first information includes processing capability information of the target device. For example, the processing performance information is the processor utilization rate, the preset control right distribution condition includes that the processor utilization rate is smaller than a first preset utilization rate threshold value.
In some embodiments, the feature information of the target object may include biometric information capable of identifying the identity of the target object, such as face feature information or iris feature information.
If the first information comprises the characteristic information of the target object, the preset control right distribution condition comprises that the characteristic information of the target object is matched with the characteristic information in the first preset characteristic information base, and/or the characteristic information of the target object is not matched with the characteristic information in the second preset characteristic information base.
The characteristic information in the first preset characteristic information base comprises the characteristic information of an object to which the preset target equipment can be assigned with the control right. The feature information in the second preset feature information base includes feature information of an object to which the preset target device cannot assign the control right.
In the embodiment of the application, under the condition that the first information is determined to meet the preset control right distribution condition, the target device redistributes the control right to the target object, the control right can be distributed according to the use requirements of the target device in different scenes, the flexibility is higher, and the application range is wider.
Fig. 2 is a flowchart illustrating a control right distribution method according to a second embodiment of the present application.
Referring to fig. 2, a target device acquires a first image of a target object. The target object determines first behavior information of the target object based on the first image. Then, the target object determines that the target object requests the control right of the target device based on the first behavior information, that is, the target device receives an access request of the target object. Next, the target device acquires first information related to the control right of the target device. The first information comprises characteristic information of the target object and a first state parameter of the target device.
Then, the target device judges whether the first state parameter of the target device meets a preset control right distribution condition corresponding to the state parameter. For the description of the first status parameter and the preset control right assignment condition corresponding to the first status parameter, reference is made to the above description, and details are not repeated herein. And if the first state parameter of the target equipment does not meet the preset control right distribution condition corresponding to the state parameter, the target equipment refuses to distribute the control right to the target object.
If the first state parameter of the target device meets the preset control right distribution condition corresponding to the state parameter, the target device continues to determine whether the feature information of the target object is matched with the feature information in the first preset feature information base (namely, the white list distributed by the control right), and whether the feature information of the target object is not matched with the feature information in the second preset feature information base (namely, the black list distributed by the control right).
And if the characteristic information of the target object is matched with certain characteristic information in the first preset characteristic information base and is not matched with any characteristic information in the second preset characteristic information base, the target equipment allocates the control right to the target object. And if the characteristic information of the target object is not matched with any characteristic information in the first preset characteristic information base and/or is matched with one characteristic information in the second preset characteristic information base, the target equipment refuses to distribute the control right to the target object.
In some embodiments of the present application, after step 130, in order to improve the efficiency of the target object controlling the target device, the control right assignment method provided by the present application further includes: generating virtual control equipment associated with the target object and a target control identifier associated with the target object; and displaying the virtual control device and the target control identifier so that the target object controls the target device based on the virtual control device and the target control identifier.
As an example, the virtual control device may be a device such as a virtual keyboard for controlling the target device by the target object.
As one example, the target control identification is used to prompt a control location for the target device. For example, the target control identifier may be a preset pattern of a cursor.
In some embodiments, after the target device assigns control to a target object, a unique identity may be created for the target object, and the target control identity and the virtual control device created for the target object may be associated with the identity.
With continued reference to fig. 2, after the target device assigns control rights to the target object, the target device creates a target control identity associated with the target object, such that the target object controls the target device based on the target control identity.
In some embodiments, a graphical list of each object to which control has been assigned may also be displayed on the target device to show which objects are currently assigned control of the target device.
In some embodiments, the target device may also animate the received control information sent by the target object to improve the user's interaction experience.
In the embodiment of the present application, there is a need to switch the control right assignment mode of the target device in some scenarios. For example, in a teacher scenario, the control right assignment mode of the interactive smart device in a classroom can be generally configured as an exclusive mode during the course of a teacher. However, if the teacher wants to interact with the student, the student is allowed to gain control of the target device. Therefore, in order to improve the flexibility of control over the target device, the control right distribution method provided by the application can also realize switching of the control right distribution mode according to the requirement of the target object.
In some embodiments, after step 130, the control right assignment method provided herein further includes steps 140 to 160.
Step 140, a second image of the target object is acquired.
And step 150, determining second behavior information of the target object based on the second image.
And 160, switching the control right distribution mode of the target equipment to the target control right distribution mode under the condition that the second behavior information is used for representing that the target object requests to switch the control right distribution mode of the target equipment to the target control right distribution mode.
In the embodiment of the present application, the specific implementation of step 140 is similar to that of step 110, and is not described herein again. I.e. the second image may be a still image or a sequence of images.
In the embodiment of the present application, the specific implementation manner of step 150 is similar to the specific implementation manner of step 120, and is not described herein again.
As can be seen from the above description, the target device may have three control right distribution modes, and of course, other types of control right distribution modes may be set for the target device. The default control right assignment mode of the target device may be preset, and may be any one of the three control right assignment modes described above, for example.
In some embodiments of the present application, a second request behavior for characterizing that the target object requests to switch the control right assignment mode of the target device to the target control right assignment mode may be preset. The second request behavior may be a specific behavior set in advance.
In some embodiments, different types of second request behaviors may be preset according to different target control right assignment patterns. For example, if the target object wants to switch to the exclusive mode, the second request behavior may be a behavior compared to the stroke number 1; if the target object wants to switch to the parallel mode, the second request behavior may be a behavior compared to the stroke number 2; if the target object wants to switch to master-slave mode, the second requested behavior may be a behavior compared to the stroke number 3.
In other embodiments, the target device receives a target control right assignment pattern selected by the target object before step 140. As an example, all the control right assignment patterns may be displayed on the screen of the target device, and the target object may select the target control right assignment pattern on the screen of the target device.
It is worth mentioning that the second request behavior may be one behavior or may include a plurality of behaviors.
It should be noted that, in order to distinguish the request requirement of the target object, the first request behavior and the second request behavior may set different behaviors.
In the embodiment of the application, the target object can switch the control right distribution mode of the target device through the behavior request without configuring a remote control device, so that not only is resources saved, but also the control right distribution mode of the target device can be switched according to different requirements, and the flexibility is higher.
In some embodiments of the present application, to further improve flexibility of controlling the target device, the control right assignment method provided by the present application further includes: acquiring second information related to a control right distribution mode of the target equipment; and determining that the second information meets the preset control right distribution mode switching condition.
Wherein the second information comprises at least one of the following information: characteristic information of the target object and a second state parameter of the target device.
In some embodiments, the second state parameter of the target device may comprise at least one of: control right assignment mode switching right of the target device, operation state parameters of the target device, and control right assignment mode information (e.g., a current control right assignment mode and a target control right assignment mode of the target device).
As one example, the control right assignment mode switching authority of the target device refers to whether the target device supports switching of the control right assignment mode.
In the embodiment of the present application, the control right distribution mode switching right of the target device may be set in advance. If the target device does not support the switching of the control right distribution mode, the target device does not support the switching request of the control right distribution mode initiated by any target object.
As an example, the operational state parameters of the target device include at least one of the following parameters: current runtime of the target device and processing performance information of the target device.
In an embodiment of the present application, the second information may include different types of information, and each type of information has a corresponding preset control right distribution mode switching condition. And when each type of information in the second information meets the corresponding preset control right distribution mode switching condition, determining that the second information meets the preset control right distribution mode switching condition.
If the second information includes the control right distribution mode switching right of the target device, the preset control right distribution mode switching condition includes that the target device supports the switching of the control right distribution mode.
If the second information includes the control right distribution mode switching right of the target device, after the second information is acquired, whether the target device supports the switching of the control right distribution mode can be judged according to the acquired control right distribution mode switching right of the target device. If the target device does not support the switching of the control right distribution mode, the target device may directly refuse to switch the control right distribution mode.
If the target device supports the switching of the control right distribution mode, it may be determined whether other information in the second information satisfies a corresponding preset control right distribution mode switching condition. The order of judging whether the other types of information in the second information except the control right distribution mode switching authority satisfy the corresponding control right distribution mode switching condition is not specifically limited.
If the second information includes control right distribution mode information, the preset control right distribution mode switching condition includes a switching relationship between two switchable control right distribution modes supported by the target device.
And if the preset control right distribution mode switching condition comprises a switching relation of switching the current control right distribution mode to the target control right distribution mode, determining that the control right distribution mode information meets the preset control right distribution mode switching condition.
The switching relationship between any two control right assignment modes may be configured in advance. For example, a switching relationship for switching from the exclusive mode to the parallel mode may be configured in advance.
As an example, if the predetermined control right distribution mode switching condition includes a switching relationship of the exclusive mode to the parallel mode and a switching relationship of the exclusive mode to the master-slave mode. And if the current control right distribution mode is an exclusive mode and the target control right distribution mode is a parallel mode, representing that the control right distribution mode information meets the preset control right distribution condition.
It is worth mentioning that, due to the switching from the parallel mode to the exclusive mode, only one object can be reserved to control the target device, and the other objects need to remove the control right of the target device. However, in parallel mode, each object is equal. Therefore, in order to improve the interaction experience of the user, in some embodiments, the switching relationship of the parallel mode to the exclusive mode may not be configured. That is, it may be preconfigured that the target device does not support switching from the parallel mode to the exclusive mode. In different application scenarios, a switching relationship for switching the parallel mode to the exclusive mode can be configured according to actual requirements.
It should be noted that if the unmanaged object requests to switch from the master-slave mode to another mode, the target device generally does not support this. Therefore, the preset control right distribution mode switching condition may include a switching relationship of switching the master-slave mode to another mode, and the target object is an unmanaged object. For example, it is possible to determine whether or not the target object is a management object by comparing the feature information of the target object with the feature information library of the management object. If the target object is a management object, it may be determined that the control right distribution mode information satisfies a preset control right distribution mode switching condition. If the target object is a non-management object, it may be determined that the control right distribution mode information does not satisfy the preset control right distribution mode switching condition.
Therefore, if the second information includes the control right distribution mode information, the preset control right distribution mode switching condition may include a switching relationship between two switchable control right distribution modes supported by the target device, and a limited condition that the switching relationship needs to satisfy.
If the second information includes the current operation time of the target device, the preset control right distribution mode switching condition includes that the operation time is within a second preset time range. For example, the second preset time range is the working time of a working day.
If the second information includes processing performance information of the target device, such as processor utilization, the predetermined control right distribution mode switching condition includes that the processor utilization is smaller than a second predetermined utilization threshold.
If the second information includes feature information of the target object, the preset control right distribution mode switching condition includes that the feature information of the target object is matched with feature information in a third preset feature information base, and/or the feature information of the target object is not matched with feature information in a fourth preset feature information base.
And the feature information in the third preset feature information base comprises the feature information of an object for which the preset target equipment supports the switching of the control right distribution mode. The feature information in the fourth preset feature information base includes feature information of an object for which the preset target device does not support the switching of the control right distribution mode.
Fig. 3 is a flowchart illustrating a control right distribution method according to a second embodiment of the present application.
Referring to fig. 3, the target device acquires a second image of the target object. The target device determines second behavior information of the target object based on the second image. Then, the target device determines that the target object requests to switch the control right distribution mode of the target device to the target control right distribution mode based on the second behavior information, that is, the target device receives the mode switching request of the target object. Next, the target device acquires second information related to the control right assignment pattern of the target device. The second information comprises characteristic information of the target object and a second state parameter of the target device.
Then, the target device determines whether the second state parameter of the target device meets a preset control right distribution mode switching condition corresponding to the state parameter. And if the second state parameter of the target equipment does not meet the preset control right distribution mode switching condition corresponding to the state parameter, the target equipment refuses to switch the control right distribution mode of the target equipment to the target control right distribution mode.
If the second state parameter of the target device meets the preset control right distribution mode switching condition corresponding to the state parameter, the target device continues to determine whether the feature information of the target object is matched with the feature information in the third preset feature information base (namely, the white list for control right distribution mode switching), and whether the feature information of the target object is not matched with the feature information in the fourth preset feature information base (namely, the black list for control right distribution mode switching).
And if the characteristic information of the target object is matched with certain characteristic information in the third preset characteristic information base and is not matched with any characteristic information in the fourth preset characteristic information base, the target equipment switches the control right distribution mode of the target equipment to the target control right distribution mode. And if the characteristic information of the target object is not matched with any characteristic information in the third preset characteristic information base and/or is matched with any characteristic information in the fourth preset characteristic information base, the target equipment refuses to switch the control right distribution mode of the target equipment to the target control right distribution mode.
When the target device switches the control right distribution mode of the target device to the target control right distribution mode, initializing the parameters of the target control right distribution mode. For example, the timeout timer in the target control assignment mode may be reset.
If the exclusive mode is switched to other modes or the parallel mode is switched to the master-slave mode, the object with the control right is not required to be removed, and the control right distribution mode of the target equipment is switched.
However, if the parallel mode or the master-slave mode is switched to the exclusive mode, and there are a plurality of objects having the control right of the target device, only the control right of one object to the target device can be reserved, and the control right of the other objects to the target device is removed.
It should be noted that, if the target object requests the control right allocation mode of the target device to switch from the parallel mode or the master-slave mode to the exclusive mode, the unique control right of the target device is allocated to the target object, and the control right of other objects to the target device is removed.
However, if the target device receives a mode switching request for switching from the parallel mode or the master-slave mode to the exclusive mode, the target device cannot determine a request target of the mode switching request. For example, if an object sends a mode switching request for switching from a parallel mode or a master-slave mode to an exclusive mode to a target device using a keyboard or other devices, the target device cannot determine the identity of the object that sent the mode switching request. Therefore, it is necessary to select one object in the exclusive mode from a plurality of objects having the control right of the target device to switch to the exclusive mode.
In some embodiments of the present application, the control right assignment method provided by the present application further includes steps 170 to 190.
Step 170, receiving a first control right distribution mode switching request, where the first control right distribution mode switching request is used to request to switch the control right distribution mode of the target device from the first control right distribution mode to the second control right distribution mode.
Step 180, screening out a first object from a plurality of objects with the control right of the target equipment, wherein the first object is the object with the highest control activity degree on the target equipment in the plurality of objects;
step 190, control of the target device is assigned to the first object.
The first control right distribution mode is a mode that the target device can distribute control right to N objects, the second control right distribution mode is a mode that the target device can distribute control right to only one object, and N is an integer greater than or equal to 1. For example, the first control right assignment mode may be a parallel mode or a master-slave mode. The second control right allocation mode may be an exclusive mode.
In the embodiment of the application, the object with the highest control activity degree on the target device is screened from the plurality of objects with the control right of the target device, and is used as the object which is only allocated with the control right of the target device in the second control right allocation mode, and the object which is allocated with the control right in the exclusive mode is selected from the control angle of the target device, so that the reasonableness is stronger.
In some embodiments of the present application, step 180 comprises steps A through B. Step A, obtaining a first target duration associated with each object in a plurality of objects, wherein the first target duration is a duration between a first moment and a second moment, the first moment is a moment when a first control right distribution mode switching request is received, and the second moment is a moment when the object controls a target device for the last time; and step B, determining a first object based on each first target duration.
In an embodiment of the present application, the first target duration may reflect a duration in which the object associated with the duration stops controlling the target device. If the first target duration is shorter, the time representing that the object associated with the first target duration controls the target device is later, so that the first target duration can reflect the control activity of the target device.
In some embodiments of the present application, step B includes steps B1 through B5. Step B1, determining a minimum first target duration based on each first target duration; step B2, under the condition that the number of the minimum first target duration is one, determining the object associated with the minimum first target duration as the first object; step B3, under the condition that the number of the minimum first target duration is at least two, obtaining a second target duration associated with each second object, wherein the second target duration is a duration between the first time and a third time, the third time is a time when the target device distributes the control right to the object for the last time, and the second object is an object associated with the minimum first target duration; step B4, determining a maximum second target duration based on each second target duration; and step B5, determining the second object associated with the maximum second target duration as the first object.
In step B1, each first target duration may be sorted to obtain a minimum first target duration. In the embodiment of the present application, if the number of the minimum first target time periods is one, the object associated with the minimum first target time period is the object of the last control target device, that is, the object has a high possibility of controlling the target device again, and thus the object may be regarded as the first object.
If the number of the minimum first target durations is multiple, the first object may be selected according to the time when each object has last accessed the target device. The second target duration may reflect a duration that each object has last accessed the target device. If the second target duration is longer, the time representing that the object accesses the target device is earlier, the possibility that the object controls the target device again is higher, and therefore the second object associated with the largest second target duration can be determined as the first object.
In step B4, each second target duration may be sorted to obtain a maximum second target duration.
It should be noted that, if there are a plurality of second objects associated with the maximum second target duration, one object is randomly selected from the plurality of second objects as the first object.
In the embodiment of the present application, the target device needs to not only assign the control right to the object, but also remove the control right of the object when the object has no control requirement on the target device.
In the embodiment of the present application, the removal of the control right of a certain object to the target device may be the removal requested by the object actively, may be the removal by other objects, or may be the automatic removal without the perception.
In the scenario where the target object actively requests to remove the control right of the target device, after step 130, the control right assignment method provided by the present application includes steps 210 to 230.
Step 210, acquiring a third image of the target object;
step 220, determining third behavior information of the target object based on the third image;
and step 230, in the case that the third behavior information is determined to be used for representing that the target object requests to cancel the control right of the target device, removing the control right of the target object to the target device.
In the embodiment of the present application, the specific implementation manner of step 210 is similar to that of step 110, and is not described herein again. The specific implementation of step 220 is similar to that of step 120, and is not described herein again.
In some embodiments, a third request behavior for characterizing that the target object requests to cancel the control right of the target device may be set in advance. The third requested behavior may be a specific behavior set in advance, such as a different behavior of attention diversion behavior, head shaking behavior, etc. to the target device.
In some examples, the third requested behavior may also include a plurality of behaviors, e.g., the third requested behavior may include a first attention-shifting behavior with respect to the target device and then a head-shaking behavior.
In an embodiment of the application, if the third behavior information matches a preset third request behavior, the third behavior information is used to represent that the target object requests to cancel the control right of the target device, and the target device may remove the control right of the target object to the target device. And when the target device removes the control right of the target object on the target device, clearing the resources allocated to the target object, removing the virtual control device and the target control identifier associated with the target object, and removing a list item corresponding to the target object on the screen of the target device.
In the embodiment of the present application, if a plurality of target objects exist in the image capturing area of the image capturing device of the target device, the control right of each target object to the target device may be cancelled according to the control right assignment method provided above.
In some embodiments, the third image may comprise a plurality of image sequences of the target object. For example, a plurality of image sequences of the target object may be acquired at preset time intervals for a first preset duration. Wherein a behavior information of the target object is obtained based on each image sequence in the third image. If the behavior information of the target object obtained based on each image sequence represents that the behavior of the target object is the same third request behavior, the target object continues the same preset behavior within the first preset time duration, namely the target object continues the third request behavior. For example, if the target object continuously transfers attention to the target device within a first preset time period, which represents that the target object may not have a need to control the target device, the control right of the target object to the target device may be removed.
Fig. 4 is a schematic flowchart of a fourth embodiment of a control right distribution method provided in the present application. As shown in fig. 4, after step 130, the target device acquires a sequence of images of the target object, i.e. one of the third images. The target device determines the behavior of the target object based on a sequence of images of the target object. The target device then determines whether the behavior of the target object is to divert attention to the target device.
And if the target equipment determines that the behavior of the target object is not the attention of the transfer to the target equipment, executing corresponding operation according to the behavior of the target object. For example, the behavior of the target object may be a behavior of requesting mode switching or a control behavior of the target device, or the like.
And if the target device determines that the behavior of the target object is to divert attention to the target device, starting a first timer. The target device then continues to acquire a sequence of images of the target object after a preset time interval. The target device determines the behavior of the target object based on the retrieved one of the image sequences of the target object. The target device then determines whether the behavior of the target object is to divert attention to the target device.
When the behavior of the target object determined based on the re-acquired image sequence does not divert the attention of the target device, it represents that the target device does not continuously divert the attention of the target device within the first preset time period, but receives the control behavior of the target device again, and the target device clears the time period recorded by the first timer and executes the corresponding operation based on the behavior of the target object.
And when the behavior of the target object determined based on the re-acquired image sequence still transfers attention to the target device, judging whether the duration recorded by the first timer is greater than a first preset duration. And if the duration recorded by the first timer is less than the first preset duration, returning to continuously acquire the image sequence of the target object. If the duration recorded by the first timer is longer than a first preset duration, the target device determines that the behavior of the target object is continuously transferred to the target device within the first preset duration based on the acquired image sequence, and then removes the control right of the target device by the target object.
In the embodiment of the application, when the target object continues the same preset behavior (i.e., the third request behavior) within the first preset duration, the accuracy of determining that the target object does not have the requirement for controlling the target device may be improved, so that the accuracy of removing the control right of the target object to the target device is improved, and the target device is prevented from being removed by mistake.
If there are a plurality of target objects each having the control right of the target device, a first timer may be assigned to each target object. If the target device only sets one system process to manage the control rights of all the objects to the target device, the target device needs to perform the method shown in fig. 4 by polling each target object to determine whether the control rights of the target object to the target device need to be removed. If the target device allocates a process to each target object for managing the control right of the object to the target device, each process may respectively execute the method shown in fig. 4 to determine whether the control right of the target object to the target device needs to be removed.
In some embodiments, in a scenario where the target object automatically leaves an image capture area of an image capture device in the target device or is occluded by other objects, it is also necessary to remove the control right of the target object to the target device. That is, after step 130, the control right assignment method provided by the present application further includes: and if the image of the target object cannot be acquired within the second preset time length, removing the control right of the target object to the target equipment.
In the embodiment of the application, in order to improve the accuracy of removing the control right and avoid the false removal, after the image of the target object cannot be acquired within the second preset time period, the control right of the target object to the target device is removed.
For example, the target device acquires an image in an image acquisition area of the image acquisition device, and performs object detection on the image to obtain a detection result. And judging whether the detection result comprises the target object or not. And if the detection result does not include the target object, starting a second timer, and re-acquiring the image in the image acquisition area after a preset time interval. And when the target object still does not exist in the image acquisition area of the image acquisition equipment which is obtained again, judging whether the recording time length of the second timer is greater than a second preset time length. And if the recording time length of the second timer is less than a second preset time length, re-acquiring the image in the image acquisition area after a preset time interval. And if the recording time of the second timer is longer than a second preset time, namely the image of the target object cannot be acquired within the second preset time, removing the control right of the target object on the target equipment.
In the embodiment of the application, whether the image of the target object can be acquired or not is detected, so that the object with the control right of the target equipment can be effectively managed, and the waste of resources is avoided. And whether the control right of the target object to the target equipment needs to be removed or not is judged by detecting the image of the target object, so that the manpower management is not needed, and the efficiency of managing the object with the control right of the target equipment can be improved.
In some embodiments, there is a scenario where a management object cancels the control right of other non-management objects due to the presence of the management object. In some embodiments, after step 130, the control right assignment method provided by the present application further includes: receiving a removal instruction of a management object to a target object, wherein the management object can manage the control right of an object with the control right of the target device to the target device; and removing the control right of the target object to the target device based on the removing instruction.
In some embodiments, the removal instruction may be a fourth request action issued by the management object. A fourth request behavior for characterizing the removal instruction may be preset.
In an embodiment of the present application, an image of an image capturing area of an image capturing apparatus may be acquired, and an image of each object in the image capturing area may be acquired by an object detection model. And then analyzing the image of each object to obtain the fourth behavior information of each object. And if the fourth behavior information matches the fourth requested action, the fourth behavior information is used for indicating to cancel the control right of the target object to the target device, and whether the object is the management object is judged based on the characteristic information of the object corresponding to the fourth behavior information.
In some embodiments, whether the object is the management object is determined by comparing the feature information of the object corresponding to the fourth behavior information with a preset feature information library of the management object. And if the object corresponding to the fourth behavior information is the management object, determining that a removal instruction sent by the management object is received.
It should be noted that the management object may select the target object for which the control right needs to be removed by selecting the identifier of each object having the control right of the target device displayed on the target device.
In some embodiments, if the management object wants to restore the control right of the target object to the target device, a restoration instruction requesting to restore the control right of the target object to the target device may also be issued by the specified action. When the target device receives the recovery instruction, the control right of the target device is redistributed to the target object.
In some embodiments, the management object may set a time period for removing the control right of the target object to the target device, and the control right of the target object to the target device may be automatically restored after the time period is exceeded.
In the embodiment of the application, in the whole process of controlling the target device, no matter the control right of the target device is obtained or removed, the remote control device is not needed, the target object can be quickly accessed to the target device and quickly exited from the target device, and the cost of controlling the target device can be reduced. Moreover, the target device is controlled through the behavior of the object, and the mutual influence and conflict when a plurality of objects operate and control the target device can be reduced.
In the embodiment of the application, different control parameters can be pre-configured in the target equipment, the requirements on the control of the target equipment under different scenes are met, and the coordination can be performed between a strict control management mode and a loose humanized control mode.
Fig. 5 is a schematic structural diagram of an embodiment of a control right distribution device provided in the present application. As shown in fig. 5, the control right assignment device 500 includes:
a first image obtaining module 510, configured to obtain a first image of a target object;
a first behavior information determining module 520 for determining first behavior information of the target object based on the first image;
a control right assignment module 530, configured to assign the control right of the target device to the target object if it is determined that the first behavior information is used to characterize the control right of the target device requested by the target object.
According to the embodiment of the application, the first behavior information of the target object is identified by using the acquired first image of the target object. And in the case that the first behavior information is determined to be used for representing that the target object requests the control right of the target device, the control right of the target device is distributed to the target object. By the control right distribution method, the control right of the target device can be distributed according to the behavior information of the target object, so that the target object can acquire the control right of the target device through own behavior without configuring a remote control device. Therefore, the hardware cost can be reduced, and the resources can be saved.
In some embodiments of the present application, the control right allocating apparatus 500 further includes:
the first information acquisition module is used for acquiring first information related to the control right of the target equipment;
the second determining module is used for determining that the first information meets the preset control right distribution condition;
wherein the first information comprises at least one of the following information:
characteristic information of the target object and a first state parameter of the target device.
In some embodiments of the present application, the control right allocating apparatus 500 further includes:
the generation module is used for generating virtual control equipment and a target control identifier which are associated with a target object;
and the display module is used for displaying the virtual control equipment and the target control identifier so that the target object controls the target equipment based on the virtual control equipment and the target control identifier.
In some embodiments of the present application, the control right allocating apparatus 500 further includes:
the second image acquisition module is used for acquiring a second image of the target object;
the second behavior information determining module is used for determining second behavior information of the target object based on the second image;
and the switching module is used for switching the control right distribution mode of the target equipment to the target control right distribution mode under the condition that the second behavior information is used for representing that the target object requests to switch the control right distribution mode of the target equipment to the target control right distribution mode.
In some embodiments of the present application, the control right allocating apparatus 500 further includes:
a second information acquisition module for acquiring second information related to switching of the control right distribution mode of the target device;
the third determining module is used for determining that the second information meets the switching condition of the preset control right distribution mode;
wherein the second information comprises at least one of the following information:
characteristic information of the target object and a second state parameter of the target device.
In some embodiments of the present application, the control right allocating apparatus 500 further includes:
a switching request receiving module, configured to receive a first control right distribution mode switching request, where the first control right distribution mode switching request is used to request to switch a control right distribution mode of a target device from a first control right distribution mode to a second control right distribution mode;
the screening module is used for screening a first object from a plurality of objects with the control right of the target equipment, wherein the first object is the object with the highest control activity degree on the target equipment in the plurality of objects;
a control right assignment module 530, further configured to assign a control right of the target device to the first object;
the first control right distribution mode is a mode that the target device can distribute control right to N objects, the second control right distribution mode is a mode that the target device can distribute control right to only one object, and N is an integer greater than or equal to 1.
In some embodiments of the present application, the screening module comprises:
a first target duration obtaining unit, configured to obtain a first target duration associated with each object in the multiple objects, where the first target duration is a duration between a first time and a second time, the first time is a time when a first control right distribution mode switching request is received, and the second time is a time when the object controls the target device for the last time;
a first object determination unit for determining a first object based on each of the first target durations.
In some embodiments of the present application, the first object determination unit comprises:
a first determining subunit, configured to determine a minimum first target duration based on each first target duration;
the first object determining subunit is used for determining the object associated with the minimum first target duration as the first object under the condition that the number of the minimum first target durations is one;
a second target duration obtaining subunit, configured to obtain, when the number of the minimum first target durations is at least two, a second target duration associated with each second object, where the second target duration is a duration between the first time and a third time, the third time is a time at which the target device has last allocated a control right to the object, and the second object is an object associated with the minimum first target duration;
a second determining subunit, configured to determine a maximum second target duration based on each second target duration;
and the first object determination subunit is further used for determining a second object associated with the maximum second target duration as the first object.
In some embodiments of the present application, the control right allocating apparatus 500 further includes:
the third image acquisition module is used for acquiring a third image of the target object;
a third behavior information determining module for determining third behavior information of the target object based on the third image;
and the control right removing module is used for removing the control right of the target object to the target equipment under the condition that the third behavior information is determined to be used for representing that the target object requests to cancel the control right of the target equipment.
In some embodiments of the present application, the third behavior information is used for characterizing that the target object is indicated to continue the same preset behavior for a first preset duration.
In some embodiments of the present application, the control right removing module is further configured to:
and if the image of the target object cannot be acquired within the second preset time length, removing the control right of the target object to the target equipment.
In some embodiments of the present application, the control right allocating apparatus 500 further includes:
a removal instruction receiving module, configured to receive a removal instruction of a management object to a target object, where the management object is capable of managing a control right of an object having the control right of the target device to the target device;
and the control right removing module is also used for removing the control right of the target object to the target equipment based on the removing instruction.
Other details of the control right distribution device according to the embodiment of the present application are similar to the control right distribution method provided in the present application described above with reference to fig. 1 to 4, and are not described again here.
The control right assignment method and apparatus according to the embodiment of the present application described in conjunction with fig. 1 to 5 may be implemented by a control right assignment device. Fig. 6 is a schematic diagram showing a hardware configuration of a control right assignment device according to an embodiment of the application.
As shown in fig. 6, the control right assignment device 600 in the present embodiment includes: the system comprises a processor 601, a memory 602, a communication interface 603 and a bus 610, wherein the processor 601, the memory 602 and the communication interface 603 are connected through the bus 610 and complete mutual communication.
In particular, the processor 601 may include a Central Processing Unit (CPU), or A Specific Integrated Circuit (ASIC), or may be configured as one or more integrated circuits implementing embodiments of the present application.
Memory 602 may include mass storage for data or instructions. By way of example, and not limitation, memory 602 may include an HDD, floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Memory 602 may include removable or non-removable (or fixed) media, where appropriate. The memory 602 may be internal or external to the control right assigning apparatus 600, where appropriate. In a particular embodiment, the memory 602 is a non-volatile solid-state memory. In a particular embodiment, the memory 602 includes Read Only Memory (ROM). Where appropriate, the ROM may be mask-programmed ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory or a combination of two or more of these.
The communication interface 603 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiments of the present application.
The bus 610 includes hardware, software, or both to couple the components of the control right assignment device 600 to each other. By way of example, and not limitation, a bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hypertransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus or a combination of two or more of these. Bus 610 may include one or more buses, where appropriate. Although specific buses are described and shown in the embodiments of the application, any suitable buses or interconnects are contemplated by the application.
That is, the control right assigning apparatus 600 shown in fig. 6 may be implemented to include: a processor 601, a memory 602, a communication interface 603, and a bus 610. The processor 601, the memory 602, and the communication interface 603 are coupled via a bus 610 and communicate with each other. The memory 602 is used to store program code; the processor 601 executes a program corresponding to the executable program code by reading the executable program code stored in the memory 602, so as to execute the control right assignment method in any embodiment of the present application, thereby implementing the control right assignment method and apparatus described in conjunction with fig. 1 to 5.
The embodiment of the application also provides a computer storage medium, wherein the computer storage medium is stored with computer program instructions; the computer program instructions realize the control right distribution method provided by the embodiment of the application when being executed by the processor.
It is to be understood that the present application is not limited to the particular arrangements and instrumentality described above and shown in the attached drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present application are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications, and additions or change the order between the steps after comprehending the spirit of the present application.
The functional blocks shown in the above structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the present application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
As will be apparent to those skilled in the art, for convenience and brevity of description, the specific working processes of the systems, modules and units described above may refer to corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present application, and these modifications or substitutions should be covered within the scope of the present application.

Claims (15)

1. A control right assignment method comprising:
acquiring a first image of a target object;
determining first behavior information of the target object based on the first image;
and in the case that the first behavior information is determined to be used for representing that the target object requests the control right of the target device, the control right of the target device is distributed to the target object.
2. The control right assignment method according to claim 1, wherein before the assigning the control right of the target device to the target object, the control right assignment method further includes:
acquiring first information related to the control right of the target equipment;
determining that the first information meets a preset control right distribution condition;
wherein the first information comprises at least one of:
characteristic information of the target object and a first state parameter of the target device.
3. The control right assignment method according to claim 1, wherein after the assignment of the control right of the target device to the target object, the control right assignment method further includes:
generating a virtual control device and a target control identifier associated with the target object;
displaying the virtual control device and the target control identifier so that the target object controls the target device based on the virtual control device and the target control identifier.
4. The control right assignment method according to claim 1, wherein after the assignment of the control right of the target device to the target object, the control right assignment method further includes:
acquiring a second image of the target object;
determining second behavior information of the target object based on the second image;
and switching the control right distribution mode of the target equipment to a target control right distribution mode under the condition that the second behavior information is used for representing that the target object requests to switch the control right distribution mode of the target equipment to the target control right distribution mode.
5. The control right assignment method according to claim 4, wherein before the switching of the control right assignment mode of the target device to the target control right assignment mode, the control right assignment method further comprises:
acquiring second information related to switching of a control right distribution mode of the target device;
determining that the second information meets a preset control right distribution mode switching condition;
wherein the second information comprises at least one of the following information:
characteristic information of the target object and a second state parameter of the target device.
6. The control right assignment method according to claim 1, further comprising:
receiving a first control right distribution mode switching request for requesting switching of the control right distribution mode of the target device from a first control right distribution mode to a second control right distribution mode;
screening out a first object from a plurality of objects with the control right of the target device, wherein the first object is an object with the highest control activity degree on the target device in the plurality of objects;
assigning control of the target device to the first object;
the first control right distribution mode is a mode in which the target device can distribute control right to N objects, the second control right distribution mode is a mode in which the target device can distribute control right to only one object, and N is an integer greater than or equal to 1.
7. The control right allocation method according to claim 6, wherein the screening out the first object from the plurality of objects having the control right of the target device includes:
acquiring a first target time length associated with each object in the plurality of objects, wherein the first target time length is a time length between a first time and a second time, the first time is a time when the first control right distribution mode switching request is received, and the second time is a time when the object controls the target equipment for the last time;
determining the first object based on each of the first target durations.
8. The control right assignment method according to claim 7, wherein the determining the first object based on each of the first target time periods includes:
determining a minimum first target duration based on each of the first target durations;
determining the object associated with the minimum first target duration as the first object under the condition that the number of the minimum first target durations is one;
acquiring a second target duration associated with each second object under the condition that the number of the minimum first target durations is at least two, wherein the second target duration is a duration between the first time and a third time, the third time is a time when the target device allocates the control right to the object last time, and the second object is an object associated with the minimum first target duration;
determining a maximum second target duration based on each of the second target durations;
determining a second object associated with the maximum second target duration as the first object.
9. The control right assignment method according to claim 1, wherein after the assignment of the control right of the target device to the target object, the control right assignment method further includes:
acquiring a third image of the target object;
determining third behavior information of the target object based on the third image;
and removing the control right of the target object to the target device under the condition that the third behavior information is determined to be used for representing that the target object requests to cancel the control right of the target device.
10. The control right distribution method according to claim 9, wherein the third behavior information is used to characterize that the target object continues the same preset behavior for a first preset duration.
11. The control right assignment method according to claim 1, wherein after the assignment of the control right of the target device to the target object, the control right assignment method further includes:
and if the image of the target object cannot be acquired within a second preset time length, removing the control right of the target object to the target equipment.
12. The control right assignment method according to claim 1, wherein after the assignment of the control right of the target device to the target object, the control right assignment method further includes:
receiving a removal instruction of a management object to the target object, wherein the management object can manage the control right of an object with the control right of the target device to the target device;
and removing the control right of the target object to the target device based on the removing instruction.
13. A control right assignment device comprising:
the first image acquisition module is used for acquiring a first image of a target object;
a first behavior information determination module for determining first behavior information of the target object based on the first image;
and the control right distribution module is used for distributing the control right of the target equipment to the target object under the condition that the first behavior information is determined to be used for representing the control right of the target equipment requested by the target object.
14. A control right assignment device, characterized in that the control right assignment device comprises: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, implements the control right assignment method of any of claims 1-12.
15. A computer storage medium having computer program instructions stored thereon which, when executed by a processor, implement the control right assignment method of any one of claims 1-12.
CN202010836606.4A 2020-08-19 2020-08-19 Control right distribution method, device, equipment and medium Active CN111983984B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010836606.4A CN111983984B (en) 2020-08-19 2020-08-19 Control right distribution method, device, equipment and medium
PCT/CN2020/136930 WO2022036966A1 (en) 2020-08-19 2020-12-16 Control right distributing method, apparatus, and device, and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010836606.4A CN111983984B (en) 2020-08-19 2020-08-19 Control right distribution method, device, equipment and medium

Publications (2)

Publication Number Publication Date
CN111983984A true CN111983984A (en) 2020-11-24
CN111983984B CN111983984B (en) 2022-05-17

Family

ID=73434173

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010836606.4A Active CN111983984B (en) 2020-08-19 2020-08-19 Control right distribution method, device, equipment and medium

Country Status (2)

Country Link
CN (1) CN111983984B (en)
WO (1) WO2022036966A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022036966A1 (en) * 2020-08-19 2022-02-24 安徽鸿程光电有限公司 Control right distributing method, apparatus, and device, and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102375538A (en) * 2010-08-17 2012-03-14 Lg电子株式会社 Display device and control method thereof
CN104333793A (en) * 2014-10-17 2015-02-04 宝鸡文理学院 Gesture remote control system
CN105592141A (en) * 2015-11-05 2016-05-18 杭州华三通信技术有限公司 Connection number control method and device
CN108107743A (en) * 2017-11-28 2018-06-01 珠海格力电器股份有限公司 Distribution method, device, storage medium and the processor of control authority
CN110535944A (en) * 2019-08-29 2019-12-03 广州华多网络科技有限公司 The method and device of user's alive data processing
CN111145749A (en) * 2019-12-31 2020-05-12 联想(北京)有限公司 Control method and control device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080156989A1 (en) * 2006-12-28 2008-07-03 O2Micro Inc. Motion sensing/recognition by camera applications
EP2421252A1 (en) * 2010-08-17 2012-02-22 LG Electronics Display device and control method thereof
CN102591446A (en) * 2011-01-10 2012-07-18 海尔集团公司 Gesture control display system and control method thereof
CN111983984B (en) * 2020-08-19 2022-05-17 安徽鸿程光电有限公司 Control right distribution method, device, equipment and medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102375538A (en) * 2010-08-17 2012-03-14 Lg电子株式会社 Display device and control method thereof
CN104333793A (en) * 2014-10-17 2015-02-04 宝鸡文理学院 Gesture remote control system
CN105592141A (en) * 2015-11-05 2016-05-18 杭州华三通信技术有限公司 Connection number control method and device
CN108107743A (en) * 2017-11-28 2018-06-01 珠海格力电器股份有限公司 Distribution method, device, storage medium and the processor of control authority
CN110535944A (en) * 2019-08-29 2019-12-03 广州华多网络科技有限公司 The method and device of user's alive data processing
CN111145749A (en) * 2019-12-31 2020-05-12 联想(北京)有限公司 Control method and control device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
刘要华: "基于智能终端的多屏互动机制的研究与设计", 《中国优秀硕士学位论文全文数据库(电子期刊)信息科技辑》 *
陈磊: "智能电视终端资源管理及服务性能优化的研究", 《中国博士学位论文全文数据库(电子期刊)信息科技辑》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022036966A1 (en) * 2020-08-19 2022-02-24 安徽鸿程光电有限公司 Control right distributing method, apparatus, and device, and medium

Also Published As

Publication number Publication date
WO2022036966A1 (en) 2022-02-24
CN111983984B (en) 2022-05-17

Similar Documents

Publication Publication Date Title
US10885306B2 (en) Living body detection method, system and non-transitory computer-readable recording medium
CN112346859A (en) Resource scheduling method and device, electronic equipment and storage medium
CN109237736B (en) Control method of household appliance and household appliance
CN101799824A (en) Signal conditioning package, method and program
CN105528703A (en) Method and system for implementing payment verification via expression
US10949573B2 (en) Unlocking control methods and related products
CN111983984B (en) Control right distribution method, device, equipment and medium
CN108205621A (en) Authority distributing method and device
WO2020111776A1 (en) Electronic device for focus tracking photographing and method thereof
CN110111458A (en) Realize method, system and door access machine that face is deployed to ensure effective monitoring and control of illegal activities
CN114244642B (en) Control method and device of equipment, computer readable storage medium and processor
US10920356B2 (en) Optimizing processing methods of multiple batched articles having different characteristics
JP6625247B2 (en) Distributed coordination system, device behavior monitoring device, and home appliance
CN109729270A (en) A kind of control method, device and electronic equipment
CN109960920A (en) Information processing method and electronic equipment
CN113342170A (en) Gesture control method, device, terminal and storage medium
CN110248181B (en) Self-reset method, device and system for external equipment and computer readable medium
CN110750350B (en) Large resource scheduling method, system, device and readable storage medium
CN106921617B (en) Public equipment reservation control method and device
CN116540556A (en) Equipment control method and device based on user habit
CN110928600A (en) Cleaning method and device for terminal background application, mobile terminal and electronic equipment
CN115499438A (en) Task allocation method and device, electronic equipment and storage medium
CN115966203A (en) Audio acquisition method and device
CN114445894A (en) Storage cabinet management method and device, storage cabinet, electronic equipment and storage medium
CN109710719B (en) Information display method, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant