WO2023065799A1

WO2023065799A1 - Human-computer interaction control method and device and storage medium

Info

Publication number: WO2023065799A1
Application number: PCT/CN2022/113401
Authority: WO
Inventors: 李冰
Original assignee: 中兴通讯股份有限公司
Priority date: 2021-10-21
Filing date: 2022-08-18
Publication date: 2023-04-27
Also published as: CN116009753A

Abstract

The present invention provides a human-computer interaction control method and device and a storage medium. The method comprises: detecting interaction information of a target object in real time; then determining, according to the interaction information as well as position information of first intelligent devices, second intelligent devices used for work; and finally, respectively issuing work instructions to the second intelligent devices used for work so as to instruct the second intelligent devices used for work to cooperatively work on the basis of the work instructions.

Description

Human-computer interaction control method, device and storage medium

Cross References to Related Applications

This disclosure claims priority to the Chinese patent application CN202111227973.5 filed on October 21, 2021, entitled "Human-computer interaction control method, device and storage medium", the entire content of which is incorporated into this disclosure by reference.

technical field

The present disclosure relates to the field of communication technologies, and in particular to a method, device and storage medium for man-machine interaction control.

Background technique

With the continuous development of information technology and Internet technology, smart devices are becoming more and more common in people's lives. For example, an audio playback device that can directly interact with the user, an electronic device that automatically selects a connected device, etc. However, existing smart devices are usually independent of each other, and cannot be effectively combined to provide services for users and complete effective interaction with users in complex environmental conditions.

Contents of the invention

The main purpose of the present disclosure is to provide a human-computer interaction control method, device and storage medium, aiming at instructing different smart devices to work according to the interaction information and location information of the target object, so as to realize the combination of multiple smart devices for the user Provide services, and then complete effective collaborative interaction with users.

In a first aspect, the present disclosure provides a human-computer interaction control method, the method includes: detecting interaction information of a target object in real time; determining each second smart device used for work according to the interaction information and position information of each first smart device; A work order is issued to each of the second smart devices used for work, so as to instruct each of the second smart devices used for work to perform cooperative work based on the work order.

In a second aspect, the present disclosure also provides a human-computer interaction control device, including: a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and realize the above first aspect when executing the computer program The steps of the human-computer interaction control method.

In a third aspect, the present disclosure also provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the processor implements the steps of the human-computer interaction control method in the first aspect.

Description of drawings

In order to illustrate the technical solution of the present disclosure more clearly, the following will briefly introduce the accompanying drawings used in the description of the embodiments. Obviously, the accompanying drawings in the following description are some embodiments of the present disclosure. As far as people are concerned, other drawings can also be obtained based on these drawings on the premise of not paying creative work.

Fig. 1 is a schematic structural diagram of a human-computer interaction control system provided in some cases;

FIG. 2 is a schematic structural diagram of the human-computer interaction control system provided by the present disclosure;

FIG. 3 is a schematic diagram of the implementation flow of the human-computer interaction control method provided by the present disclosure;

FIG. 4 is a schematic diagram of an application scenario of the human-computer interaction control method provided by the present disclosure;

Fig. 5 is a schematic structural diagram of a human-computer interaction control device provided by the present disclosure.

Detailed ways

The technical solution in the present disclosure will be clearly and completely described below with reference to the drawings in the present disclosure. Apparently, the described embodiments are some of the embodiments of the present disclosure, but not all of them. Based on the embodiments in the present disclosure, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present disclosure.

The flow charts shown in the drawings are just illustrations, and do not necessarily include all contents and operations/steps, nor must they be performed in the order described. For example, some operations/steps can be decomposed, combined or partly combined, so the actual order of execution may be changed according to the actual situation.

It should be understood that the terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the present disclosure. As used in this disclosure and the appended claims, the singular forms "a", "an" and "the" are intended to include plural referents unless the context clearly dictates otherwise.

Before describing the human-computer interaction control method, device and storage medium provided by the present disclosure, the principle of human-computer interaction and the technical problems existing in the existing intelligent interaction system will be exemplarily described with reference to FIG. 1 . First of all, human-computer interaction refers to the effective transmission of information between humans and computers through intelligent input and output devices. It can be seen from Figure 1 that in the existing human-computer interaction technology, it is common for a person to interact with a single smart device of the same category (such as smart device 1, smart device 2, ... or according to any of the smart devices n For example, assuming that smart device 1 is an audio playback device and smart device 2 is a video playback device, the user inputs a voice signal to the audio playback device or video playback device, and after the audio playback device receives the voice signal, it outputs and The received voice signal matches the information, or the user inputs a voice signal to the video playback device, and the video playback device activates the display screen after receiving the voice signal. However, if there are multiple smart devices of the same category in different locations in the same space, when the user needs to interact with the smart devices of this category, not only cannot effectively interact with multiple smart devices at the same time, but also interact with a single The interaction of smart devices in this category will also be affected by other smart devices of the same category around them, resulting in the problem of interaction failure. Therefore, in the existing human-computer interaction process, there are problems that multiple smart devices cannot be effectively combined to provide services for users in a complex environment, and human-computer interaction is invalid.

In order to solve the above technical problems, the present disclosure provides a human-computer interaction control method, device, storage medium and system. It should be noted that, with reference to the accompanying drawings, the implementation principle and process of the human-computer interaction control method provided by some embodiments of the present disclosure will be exemplarily described below. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.

Please refer to FIG. 2 , which is a schematic structural diagram of the human-computer interaction control system provided by the present disclosure. It can be seen from FIG. 2 that the human-computer interaction control system 20 provided in this embodiment includes: a plurality of smart devices 201 and electronic devices 202 of different types. Wherein, the multiple smart devices 201 of different categories may be the smart device 1 of the first category, the smart device 2 of the second category, . . . , the smart device n of the nth category, and so on. The smart device 201 corresponding to each category can perform interactive work according to the user's state, behavior, operation and other interaction information detected by the electronic device 202 . In an exemplary embodiment, after the electronic device 202 detects the interaction information of the target object (user), according to the interaction information and the location information of each smart device 201, it can deduce the smart device that needs to interact with the user, and then control each Smart devices work together. The user can interact with multiple smart devices without any burden in the smart space composed of smart devices, so that multiple smart devices can work together.

Wherein, a detection device 2021 may be provided on the electronic device 202 . Wherein, the electronic device 202 may be a server or a terminal device, and the server may be a single server or a server cluster; the terminal device includes but is not limited to a mobile phone terminal, a tablet computer, a desktop computer, a robot, a wearable smart device, and the like. In an exemplary embodiment, the detection device 2021 may be a preset type of sensor or detector disposed on the electronic device 202, such as an infrared detection sensor, a radar detector, or a photon detector. Certainly, in some other embodiments of the present disclosure, the detection device 2021 may also be other electronic equipment connected in communication with the electronic equipment 202 or a sensor installed at a preset distance from the electronic equipment 202 . In addition, the detection device 2021 can be a plurality of information sensing modules distributed in the entire environmental space where the smart device is installed, and the plurality of information sensing modules can be evenly distributed in the environmental space where the smart device is installed, and can fully cover the entire environmental space. Of course, each information sensing module covered in the environment space where the smart device is installed is connected to the electronic device 202 in communication. In an exemplary embodiment, the detection device 2021 may be a plurality of different types of sensors, detectors or other information perception modules, etc., of course, may also be a plurality of sensors, detectors or information perception modules of the same type. For example, the detection device 2021 includes but is not limited to a camera, a temperature sensor, an audio receiver, and an action recognizer.

Understandably, if the detecting device 2021 is other electronic equipment connected to the electronic equipment 202, the other electronic equipment may also be a server or a terminal equipment. In an exemplary embodiment, in the embodiment of the present disclosure, the detecting means 2021 is configured to detect the interaction information made by the target object in real time. Wherein, the target object is a user in a space preset with at least two smart devices, and the interaction information includes user's state, behavior, operation and other information. Of course, the detection device 2021 can also be used to sense various information in the current environment and obtain the sensed information. It can also send the sensed information to the electronic device 202. After the electronic device 202 analyzes the sensed information, Send control instructions to each smart device according to the analysis results. Specifically, it may be a gesture action made by the user or a voice message sent by the user. In an exemplary embodiment, it is assumed that the detecting device 2021 is a photon detector disposed on the electronic device 202, and the photon detector can be used to detect an operation behavior of a target object (user), such as a gesture. In an exemplary embodiment, a photon detector includes an optical camera and a sensor. Wherein, the optical camera is used to capture gestures of the target object, and the sensor is used to transmit the user's gestures captured by the optical camera to the electronic device 202 . In an exemplary embodiment, the photon detector may further include a structured light device, which may be used to collect user location information, and may transmit the collected user location information to the electronic device 202 through the sensor.

Among them, the electronic device 202 is connected to each smart device 201 in communication, and is used to determine the smart device used for work from each smart device 201 according to the interaction information made by the target object and the location information of each smart device 201 . In an exemplary embodiment, for ease of distinction, each smart device 201 in the space where the target object is located is marked as a first smart device, and each smart device determined to be used for work is marked as a second smart device. After determining each second smart device used for work, the electronic device 202 issues a work order to each second smart device used for work, so as to instruct each second smart device to perform cooperative work based on the work order.

Wherein, the first smart device can be a smart device of a different category, and certainly can be a smart device of the same category. In this embodiment, in an exemplary embodiment, it is assumed that the electronic device 202 determines that each second smart device used to interact with the user is an audio playback device according to the gesture action of the target object. The location information of the audio playback device determines that the audio playback device specifically used to send the audio signal includes the first audio playback device and the second audio playback device, and then sends the work to the determined first audio playback device and the second audio playback device respectively. Instructions to instruct the first audio playback device and the second audio playback device to perform coordinated work. In an exemplary embodiment, the work instruction carries the signal strengths of the sound signals respectively output by the first audio playback device and the second audio playback device. After the first audio playback device and the second audio playback device receive their respective work instructions, they respectively output sound signals with corresponding signal strengths within a specified time. It can be understood that the sound signal intensity output by the first audio playback device and the second audio playback device can be controlled to be different in different time periods, or the first audio playback device and the second audio playback device can be controlled to output sound signals alternately, and The intensity of the sound signal output during the alternation is different.

Of course, the electronic device 202 may determine that the second smart device used for work may include smart devices of different types according to the interaction information of the user. For example, the electronic device 202 determines that the second smart device used for work includes at least one audio playback device and at least one video playback device according to the user's voice information and/or the user's gesture action. In an exemplary embodiment, assuming that the target user needs to make a video call, in this application scenario, the detection device 2021 to be used includes an audio receiver and/or a camera; in an exemplary embodiment, the electronic device 202 receives After the audio receiver detects the voice information of the target object and/or the user's gestures captured by the camera, it analyzes the voice information or recognizes the gestures, and determines that the second smart device that needs to interact with the target object is an audio playback device and a video playback device , and then according to the relative position information between the target object and each audio playback device and video playback device, issue work instructions to each audio playback device and video playback device respectively, control each audio playback device to output audio signals, and each video playback device Start the video function. It can be understood that it is necessary to determine in real time the audio playback device that needs to output audio signals and the video playback device that needs to start the video function according to the relative position information between each audio playback device and the target object, and determine in real time each audio signal that needs to be output. The intensity of the audio signal output by the audio playback device, so that when the target object moves in the preset space, it is guaranteed that the target object always receives a fixed-strength audio signal and the video playback device that activates the video function is always in front of the target object. In an exemplary embodiment, the work instruction carries a first time for instructing the audio playback device to output audio signals and a second time for the video playback device to play video information. For example, as the target object moves, the intensity of the audio signal output by the audio device relatively far away from the target object is gradually weakened at the first time, and the audio signal output by the audio device relatively close to the target object is controlled at the first time. The intensity of the device gradually increases, and the real-time position relative to the target object is determined according to the image information of the target object captured by the camera in real time, and the video playback device in front of the target object starts the video function at a second time.

Understandably, the first smart device includes, but is not limited to, an air conditioner, an audio device, a smell output device, a video playback device, and the like.

It can be known from the above-mentioned embodiments that the human-computer interaction control system provided by the present disclosure first detects the interaction information of the target object, and realizes determining the corresponding category from at least two types of first smart devices according to the detected interaction information of the target object. The second smart device; then determine the second smart device used for work according to the position information of each second smart device; and then issue work instructions to each second smart device used for work to instruct each The second smart device performs work based on the work order. According to the interaction information and location information of the target object, different smart devices are instructed to work, and different smart devices are combined to provide services for users, and then complete effective interaction with users.

Please refer to FIG. 3 . FIG. 3 is a schematic diagram of an implementation flow of a human-computer interaction control method provided by the present disclosure. As shown in FIG. 3 , the human-computer interaction control method is applied to the electronic device 202 shown in FIG. 2 , including steps S301 to S303. Details are as follows.

S301. Detect interaction information of a target object in real time.

In this embodiment, the electronic device detects the interaction information of the target object in real time through the detection device. Wherein, the target object is a user who enters the environment where the human-computer interaction control system is located. When the target object needs to interact with the first smart device in the current environment, it can make preset interaction information, such as gestures or For voice information, the electronic device detects the interaction information made by the target object in real time, and determines the smart device that matches the interaction information of the target object. It can be understood that, in addition to gesture information or voice information, the interaction information may also be other user interaction information, such as touch interaction information, which is not specifically limited herein. Of course, the electronic device can also control the corresponding smart device to work through the environmental information. For example, the electronic device can control the air conditioner to work according to the detected ambient temperature information, and control different air conditioners to perform different tasks according to the movement of the target object. temperature control etc.

S302. Determine each second smart device used for work according to the interaction information and the location information of each first smart device.

Wherein, the electronic device can determine which type of first smart device the target object needs to interact with according to the interaction information, and then determine the user information from the corresponding type of first smart device according to the position information of each first smart device of the determined type. A second smart device for work.

For example, assuming that the interaction information of the target object is a preset gesture action for starting a video call, after the electronic device detects the gesture action, it determines the device that the target object needs to interact with from the plurality of first smart devices according to the gesture action. A video playback device for video calls. Wherein, the multiple first smart devices may be of the same type or of different types, for example including but not limited to, video playback devices, audio devices, air conditioners, refrigerators, smell output devices, and the like.

In an exemplary embodiment, the interaction information includes at least one of gesture actions, voice information, and touch information, and each second smart device used for work is determined according to the interaction information and the position information of each first smart device, The method includes: analyzing the interaction information to obtain each first smart device matching the interaction information; acquiring location information of each first smart device, and determining each second smart device for working according to the location information of each first smart device.

For example, the interaction information is a gesture action, and the gesture action is used to indicate that a device capable of inputting and outputting the interaction information needs to be activated. In an exemplary embodiment, the gesture action can be analyzed in the electronic device to obtain the semantic information corresponding to the gesture action, and the association mapping relationship between the semantic information and the device category is pre-stored in the electronic device. After the semantic information corresponding to the gesture action of the target object is analyzed, each first smart device matching the semantic information corresponding to the gesture action is determined from among the first smart devices according to the association mapping relationship.

In addition, the electronic device further includes a voice recognition function. After detecting the voice information of the target object, the electronic device recognizes the voice information to determine each first smart device that matches the voice information.

Correspondingly, after the electronic device obtains each first smart device that matches the interaction information of the target object, it obtains the location information of each first smart device, and determines each first smart device for working from each first smart device according to the location information. 2. Smart devices.

Wherein, according to the position information of each first smart device, determining each second smart device for work may include: according to the position information, respectively determining the relative position information between the target object and each first smart device; according to the relative position information, and select each second smart device for work from each first smart device.

In an exemplary embodiment, the position information of each first smart device is pre-stored in the electronic device. In an embodiment of the present disclosure, the electronic device The position information calculates the relative position information between the target object and each first smart device; according to the calculated relative position information, each second smart device used for work can be determined from each first smart device. In an exemplary embodiment, each second smart device used for work refers to each second smart device that performs cooperative interaction with the target object. Wherein, the relative position between each second smart device and the target object for collaborative interaction with the target object is within the preset communication range, and as the target object moves, when the target object moves to the first position Determining the relative position information between the second smart device used for work and the target object is the same as determining the relative position information between the second smart device used for work and the target object when the target object moves to the second position. That is to say, as the location information of the target object is constantly changing, it is necessary to continuously determine the second smart device used for work from each first smart device, so as to ensure that the target object can receive the same Information. For example, with the movement of the target object, the strength of the sound signal received by the target object, or the clarity of the screen display picture can remain unchanged.

In an exemplary embodiment, in practical applications, when the target object moves to the first position, the relative position information between the target object and the determined second smart device used for work is related to the target object moving to the second position. position, the relative position information between the target object and the determined second smart device used for work may be different. When the target object is at the first location, it corresponds to the output signal strength of the second smart device for work, and when the target object is at the second location, it corresponds to the output signal strength of the second smart device for work. By adjusting the output signal strength of the second smart device corresponding to different positions, it is ensured that the user receives the same signal when the user is at the first position and the second position.

In an exemplary embodiment, according to the relative position information between each second smart device and the target object, selecting each second smart device for work from the first smart devices includes: if there is a first smart device and If the relative position information between the target objects satisfies the preset position information evaluation condition, it is determined that the first smart device meeting the preset position information evaluation condition is the second smart device used for work, wherein the preset position information evaluation The condition is the relative position information between the target object at the first position and the second smart device determined to be used for work, and the relative position information between the target object at the second position and the second smart device determined to be used for work. The location information is the same.

S303. Issue a work instruction to each second smart device used for work respectively, so as to instruct each second smart device used for work to perform cooperative work based on the work order.

In an exemplary embodiment, as the second smart device is different, the work instruction carries different instruction information. For example, assuming that the second smart device includes an audio playback device, the work instruction carries information for instructing each audio playback device to coordinate output The strength value of the audio signal, respectively issuing work instructions to each second smart device used for work may include: determining each second smart device used for work according to the relative position information between each second smart device and the target object device, and the output signal strength of each second smart device used for work; sending work instructions with their respective output signal strengths to each second smart device used for work.

In an exemplary embodiment, assuming that the second smart device is an audio playback device, in this embodiment, according to the relative position information between each audio playback device and the target object, it is determined that the output signal strength of each second smart device is expressed as Pn; in an exemplary embodiment,

Wherein, An represents the relative position information between the nth audio playback device and the target object (in an exemplary embodiment, is the distance between the nth audio playback device and the target object), and Pn represents the nth audio playback device The signal strength (in one exemplary embodiment, the sound signal strength) output by the device.

As another example, the second smart device may include an audio playback device and a video playback device, and the work instruction carries the first time for instructing the audio playback device to output audio signals and the second time for the video playback device to play video information, and the audio playback device to output The strength value of the audio signal. Based on the work instruction, the audio playback device and the video playback device can be controlled to work together. Wherein, the first time may include the second time.

Wherein, the video playback device may be a video playback device with a display screen. It can be understood that when the position information of the target object changes, according to the relative position information between the target object and the display screens of each video playback device, different video playback devices can be controlled to switch and display, or two or more video playback devices can be controlled. Two video playback devices display at the same time to ensure that as the target user moves, the display screen of the video playback device is always in front of the user, so that the user can clearly know the content displayed on the display screen at any time.

In addition, the video playback device may also include a camera, and the work order may also carry instruction information for activating the camera. According to the work instructions, the video playback device can be controlled to start the display screen and the camera at different time periods, and the purpose of controlling the display screen and the camera to work interactively has been achieved.

In an exemplary embodiment, the process of starting the video playback device is the same as that of starting the audio playback device, and details will not be repeated here. It can be understood that, in addition to the audio playback device or video playback device described in the above embodiments, the second smart device can also be other types of smart devices with information interaction functions, such as smart home appliances or lamps such as air conditioners, refrigerators, and washing machines. , TV, switch, etc., are not specifically limited here.

Through the above analysis, it can be seen that the human-computer interaction control method provided by the present disclosure detects the interaction information of the target object in real time, and determines each second smart device used for work according to the interaction information and the position information of each first smart device, respectively. A work order is issued to each second smart device used for work, so as to instruct each second smart device used for work to perform work based on the work order. According to the interaction information and location information of the target object, different smart devices are instructed to work, and different smart devices are combined to provide services for users, and then complete effective collaborative interaction with users.

Please refer to FIG. 4 , which is a schematic diagram of an application scenario of the human-computer interaction control method provided by the present disclosure. As can be seen from FIG. 4, in this embodiment, the human-computer interaction control system 20 includes an electronic device 202, two detection devices 203 (in this embodiment, the detection device 201 is connected to the electronic device in communication) and two first intelligent devices 201 . In an exemplary embodiment, the detection device 203 is a sound detection device, for example, a microphone device; the first smart device 201 is a sound output device, for example, an audio playback device. In an exemplary embodiment, the microphone device is used to detect the sound signal output by the target object 400, and send the detected sound signal to the electronic device 202, and the electronic device 202 determines that the target object 400 needs to communicate with the After the audio playback device interacts, obtain the relative position information (for example, the relative position information is the relative distance) between the target object 400 and each audio playback device, and determine from each audio playback device according to the determined relative position information. The audio playback device for the sound signal and the sound signal intensity output by each audio playback device used to output the sound signal. Wherein, the microphone device can detect the sound source position information of the sound signal emitted by the target object 400, and send the sound source position information to the electronic device 202, and the electronic device 202 can use the received sound source position information and the pre-stored Position information, determine the relative position information (distance) of the target object 400 relative to each audio playback device, and finally determine the audio playback device outputting the sound signal and the sound signal strength output by each audio playback device according to the determined relative position information. For example, audio playback devices at different locations can be controlled to output sound signals of different intensities, so as to ensure that the target object can receive stable sound signals when moving in the corresponding space. Realized the combination of multiple audio playback devices to complete effective interaction with users.

Please refer to FIG. 5 . FIG. 5 is a schematic structural diagram of a human-computer interaction control device provided by the present disclosure. As shown in FIG. 5, in this embodiment, the electronic device 202 includes a processor 501 and a memory 502, and the processor 501 and the memory 502 are connected through a bus 503, such as an I2C (Inter-integrated Circuit) bus.

In an exemplary embodiment, the processor 501 is used to provide computing and control capabilities to support the operation of the entire electronic device 202 . The processor 501 can be a central processing unit (Central Processing Unit, CPU), and the processor 501 can also be other general processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC) ), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Wherein, the general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

In an exemplary embodiment, the memory 502 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) disk, an optical disk, a U disk, or a mobile hard disk.

Those skilled in the art can understand that the structure shown in FIG. 5 is only a block diagram of a partial structure related to the disclosed solution, and does not constitute a limitation on the electronic device 202 to which the disclosed solution is applied. The specific electronic device 202 may include more or fewer components than shown, or combine certain components, or have a different arrangement of components.

Wherein, the processor is used to run the computer program stored in the memory, and realize the functions of the electronic device 202 provided by the present disclosure when executing the computer program.

In one embodiment, the processor is used to run a computer program stored in the memory, and implement the following steps when executing the computer program: detect the interaction information of the target object in real time; according to the interaction information and the position information of each first smart device, determine Each second smart device used for work; sends a work order to each second smart device used for work respectively, so as to instruct each second smart device used for work to perform cooperative work based on the work order.

In an embodiment, the interaction information includes at least one of gesture action, voice information, and touch information.

In an embodiment, according to the interaction information and the location information of each first smart device, determining each second smart device used for work includes: parsing the interaction information to obtain each first smart device that matches the interaction information; obtaining The location information of each first smart device determines each second smart device used for work according to the location information of each first smart device.

In an embodiment, according to the position information of each first smart device, determining each second smart device for work includes: according to the position information, respectively determining the relative position information between the target object and each first smart device; According to the relative position information, each second smart device for working is selected from each first smart device.

In an embodiment, after selecting each second smart device for working from each first smart device according to the relative position information between each first smart device and the target object, further comprising: after detecting the target object When the location changes, each second smart device used for work is reselected; wherein, the relative position information of the reselected second smart device and the target object is the same as that of the second smart device and the target object before reselection The relative position information is the same.

In an embodiment, the second smart device used for work includes at least one of a video playback device, a camera device, an audio playback device, and a video playback device.

In an embodiment, the second smart device used for work includes an audio playback device, and the work instruction carries an intensity value for instructing each audio playback device to output an audio signal cooperatively.

In one embodiment, the second smart device used for work includes an audio playback device and a video playback device, and the work instruction carries the first time for instructing the audio playback device to output audio signals and the second time for the video playback device to play video information , and the intensity value of the audio signal output by the audio playback device.

The human-computer interaction control method, device, and storage medium provided by the present disclosure first detect the interaction information of the target object in real time, and then determine each second smart device for work according to the interaction information and the position information of each first smart device, Finally, a work order is issued to each second smart device used for work, so as to instruct each second smart device used for work to perform cooperative work based on the work order. According to the interaction information of the target object and the location information of each smart device, different smart devices are instructed to work together, and different smart devices are combined to provide services for users, and then complete effective collaborative interaction with users.

It should be noted that those skilled in the art can clearly understand that for the convenience and brevity of the description, the working process of the electronic device described above can refer to the description of the function of the electronic device in the foregoing TCP connection establishment method embodiment The process will not be repeated here.

Those of ordinary skill in the art can understand that all or some of the steps in the methods disclosed above, the functional modules/units in the system, and the device can be implemented as software, firmware, hardware, and an appropriate combination thereof. In hardware embodiments, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components. Components cooperate to execute. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit . Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those of ordinary skill in the art, the term computer storage media includes both volatile and nonvolatile media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. permanent, removable and non-removable media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

It should be understood that the term "and/or" used in the present disclosure and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations. It should be noted that, as used herein, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or system comprising a set of elements includes not only those elements, It further includes other elements not expressly listed, or further includes elements inherent in such a process, method, article, or system. Without further limitations, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article or system comprising that element.

The above serial numbers of the present disclosure are for description only, and do not represent the advantages and disadvantages of the embodiments. The above is only an embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope of the present disclosure. , these modifications or replacements should all fall within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be determined by the protection scope of the claims.

Claims

A human-computer interaction control method, the method comprising:

Real-time detection of interactive information of target objects;

Determine each second smart device used for work according to the interaction information and the location information of each first smart device;

Issue work instructions to the respective second smart devices used for work, so as to instruct the respective second smart devices used for work to perform coordinated work based on the work instructions.
The human-computer interaction control method according to claim 1, wherein the interaction information includes at least one of gesture actions, voice information, and touch information.
The human-computer interaction control method according to claim 2, wherein, according to the interaction information and the position information of each first smart device, determining each second smart device for work includes:

Analyzing the interaction information to obtain each of the first smart devices that match the interaction information;

The respective second smart devices used for work are determined according to the location information of the respective first smart devices matched with the interaction information.
According to the human-computer interaction control method according to any one of claims 1 to 3, wherein, according to the location information of each of the first smart devices, determining each of the second smart devices for work includes:

Determining relative position information between the target object and each of the first smart devices respectively according to the position information;

According to the relative position information, each of the second smart devices used for work is selected from each of the first smart devices.
The human-computer interaction method according to claim 4, wherein, after selecting each of the second smart devices for work from each of the first smart devices according to the relative position information, further comprising:

Reselecting each of the second smart devices used for work when it is detected that the location of the target object changes;

Wherein, the reselected relative position information of the second smart device and the target object is the same as the relative position information of the second smart device and the target object before reselection.
The human-computer interaction control method according to claim 5, wherein the second smart device comprises at least one of a video playback device, a camera device, an audio playback device and a video playback device.
The human-computer interaction control method according to claim 5, wherein the second smart device includes an audio playback device, and the work instruction carries an intensity value for instructing each audio playback device to output an audio signal cooperatively.
The human-computer interaction control method according to claim 5, wherein the second smart device includes an audio playback device and a video playback device, and the work order carries a first time for instructing the audio playback device to output an audio signal and the second time when the video playback device plays the video information, and the intensity value of the audio signal output by the audio playback device.
A human-computer interaction control device, comprising:

memory and processor;

The memory is used to store computer programs;

The processor is configured to execute the computer program and realize the steps of the human-computer interaction control method according to any one of claims 1 to 8 when executing the computer program.
A computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor realizes the man-machine according to any one of claims 1 to 8 The steps of the interactive control method.