TWI743853B - Device control method, electronic device and medium thereof - Google Patents

Abstract

Embodiments of the present application disclose a device control method, electronic device and medium. The method includes: acquiring a program code for controlling the operation of a first controlled device through a local agent program; The local agent program sends the program code to the first controlled device, so that the first controlled device runs the program code.

Description

Device control method, electronic device and storage medium

This application relates to smart device control technology, in particular to a device control method, electronic device, and computer storage medium.

At present, the remote control method for smart devices can be applied to many fields, for example, it can be applied to the field of remote control or programming education. In related technologies, when controlling smart devices, corresponding control instructions can be sent through fixed command buttons.

The embodiment of the application proposes a device control method, an electronic device, and a computer storage medium.

The embodiment of the present application provides a device control method, and the method includes: Obtain the code used to control the work of the first controlled device through the local agent program; The program code is sent to the first controlled device through the local agent program, so that the first controlled device runs the program code.

In some embodiments of the present application, the method further includes: After the program code is sent to the first controlled device, the feedback information of the first controlled device is received, and the feedback information is generated by the first controlled device after running the program code.

It can be seen that by receiving the feedback information, the operation status of the above-mentioned code can be obtained, and the processing of the code can be facilitated. For example, when the operation of the code does not meet expectations, the code can be modified.

In some embodiments of the present application, the method further includes: After receiving the feedback information of the first controlled device, the feedback information is loaded and/or displayed on the terminal where the local agent program is located.

It can be seen that by loading and/or displaying the feedback information, it is convenient for the user to intuitively know the operation of the above-mentioned code.

In some embodiments of the present application, the feedback information includes the execution result of the program code.

It can be seen that by loading and/or displaying the feedback information, it is convenient for the user to intuitively know the execution result of the above-mentioned code.

In some embodiments of the present application, the obtaining the program code for controlling the operation of the controlled device through the local agent program includes: Obtain the program code submitted by the user based on the web (WEB) page through the local agent program.

In this way, when the local agent is running, the local agent can collect the corresponding code; it can be seen that the user can submit the code more conveniently based on the WEB page.

The embodiment of the present application also provides another device control method, which is applied to the first controlled device, and the method includes: Receiving a program code for controlling the operation of the first controlled device sent by the terminal through a local agent program; the program code is collected by the local agent program; Run the code.

In some embodiments of the present application, the method further includes: Run the program code to generate feedback information, and send the feedback information to the terminal.

It can be seen that by sending the feedback information to the terminal, the terminal can be informed of the operation of the above-mentioned program code, which is convenient for processing the program code. For example, when the operation of the program code does not meet expectations, the program code can be modified.

In some embodiments of the present application, the feedback information includes the execution result of the program code.

It can be seen that by sending the feedback information to the terminal, the terminal can be informed of the execution result of the above-mentioned code.

In some embodiments of the present application, the method further includes: By running the program code, a control instruction of the second controlled device is generated, wherein the first controlled device and the second controlled device form a communication connection; Sending the control instruction of the second controlled device to the second controlled device, so that the second controlled device executes the control instruction of the second controlled device; Receive the instruction execution result sent by the second controlled device, generate the control instruction of the first controlled device according to the instruction execution result, and execute the control instruction of the first controlled device; wherein, the instruction The execution result is obtained by the second controlled device after executing the control instruction of the second controlled device.

It can be seen that the embodiments of the present application provide a cooperative control scheme for the first controlled device and the second controlled device. In some embodiments of the present application, the first controlled device and the second controlled device can be realized based on the above-mentioned code. Cooperative control of the second controlled device.

In some embodiments of the present application, the method further includes: Acquiring work mode switching information; the work mode switching information is used to instruct the first controlled device and the second controlled device to switch the current working mode to the target working mode; According to the work mode switching information, control the first controlled device to switch the work mode; send the work mode switch information to the second controlled device so that the second controlled device is based on the work mode switch information Switch working mode.

In this way, for each controlled device, multiple working modes can be set. When in different working modes, the working mode of the controlled device is different. It can be seen that the embodiments of the present application can realize synchronous switching of the working modes of the first controlled device and the second controlled device.

In some embodiments of the present application, the control instruction of the second controlled device is an image detection instruction, and the execution result of the instruction is an image detection result; The generating the control instruction of the first controlled device according to the instruction execution result, and executing the control instruction of the first controlled device includes: Generating a control instruction of the first controlled device according to the image detection result, and the control instruction of the first controlled device is a human tracking instruction; According to the human body tracking instruction, the movement state of the first controlled device is controlled.

It can be seen that, in the embodiment of the present application, human body tracking can be realized on the basis of the coordinated control of the first controlled device and the second controlled device.

In some embodiments of the present application, the generating a control instruction of the first controlled device according to the image detection result includes: In response to the image detection result indicating that the human body has become smaller, generating a control instruction for controlling the advancement of the first controlled device; In response to the image detection result indicating that the human body becomes larger, generating a control instruction for controlling the first controlled device to remain stationary; In response to the image detection result indicating that the human body is located on the left side of the first controlled device, generating a control instruction for controlling the first controlled device to turn left; In response to the image detection result indicating that the human body is located on the right side of the first controlled device, a control instruction for controlling the first controlled device to turn right is generated.

It can be seen that, in the embodiment of the present application, human body tracking can be accurately achieved by controlling the motion state of the first controlled device.

In some embodiments of the present application, the first controlled device and the second controlled device are connected through a wired connection.

In this way, the reliability of the communication between the first controlled device and the second controlled device can be ensured.

The embodiment of the present application also provides a terminal, the terminal includes an acquisition module and a first processing module, wherein: The obtaining module is configured to obtain the code used to control the work of the first controlled device through the local agent program; The first processing module is configured to send the program code to the first controlled device through the local agent program, so that the first controlled device runs the program code.

In some embodiments of the present application, the first processing module is further configured to receive feedback information from the first controlled device after sending the program code to the first controlled device, so The feedback information is generated after the first controlled device runs the program code.

It can be seen that by receiving the feedback information, the operation status of the above-mentioned code can be obtained, and the processing of the code can be facilitated. For example, when the operation of the code does not meet expectations, the code can be modified.

In some embodiments of the present application, the first processing module is further configured to, after receiving the feedback information of the first controlled device, perform the feedback information on the terminal where the local agent program is located. Load and/or display.

It can be seen that by loading and/or displaying the feedback information, it is convenient for the user to intuitively know the operation of the above-mentioned code.

In some embodiments of the present application, the feedback information includes the execution result of the program code.

It can be seen that by loading and/or displaying the feedback information, it is convenient for the user to intuitively know the execution result of the above-mentioned code.

In some embodiments of the present application, the obtaining module is configured to obtain the program code submitted by the user based on the WEB page through the local agent program.

In this way, when the local agent is running, the local agent can collect the corresponding code; it can be seen that the user can submit the code more conveniently based on the WEB page.

An embodiment of the present application also provides a first controlled device. The first controlled device includes a receiving module and a second processing module, wherein: A receiving module, configured to receive a program code for controlling the operation of the first controlled device sent by the terminal through a local agent program; the program code is collected by the local agent program; The second processing module is configured to run the program code.

In some embodiments of the present application, the second processing module is further configured to run the program code to generate feedback information, and send the feedback information to the terminal.

It can be seen that by sending the feedback information to the terminal, the terminal can be informed of the operation of the above-mentioned program code, which is convenient for processing the program code. For example, when the operation of the program code does not meet expectations, the program code can be modified.

In some embodiments of the present application, the feedback information includes the execution result of the program code.

It can be seen that by sending the feedback information to the terminal, the terminal can be informed of the execution result of the above-mentioned code.

In some embodiments of the present application, the second processing module is further configured to: By running the program code, a control instruction of the second controlled device is generated, wherein the first controlled device and the second controlled device form a communication connection; Sending the control instruction of the second controlled device to the second controlled device, so that the second controlled device executes the control instruction of the second controlled device; Receive the instruction execution result sent by the second controlled device, generate the control instruction of the first controlled device according to the instruction execution result, and execute the control instruction of the first controlled device; wherein, the instruction The execution result is obtained by the second controlled device after executing the control instruction of the second controlled device.

It can be seen that the embodiments of the present application provide a cooperative control scheme for the first controlled device and the second controlled device. In some embodiments of the present application, the first controlled device and the second controlled device can be realized based on the above-mentioned code. Cooperative control of the second controlled device.

In some embodiments of the present application, the second processing module is further configured to obtain work mode switching information; control the first controlled device to switch work modes according to the work mode switching information; The mode switching information is sent to the second controlled device so that the second controlled device switches the working mode based on the working mode switching information; the working mode switching information is used to instruct the first controlled device and the second controlled device 2. The controlled device switches the current working mode to the target working mode.

In this way, for each controlled device, multiple working modes can be set. When in different working modes, the working mode of the controlled device is different. It can be seen that the embodiments of the present application can realize synchronous switching of the working modes of the first controlled device and the second controlled device.

In some embodiments of the present application, the control instruction of the second controlled device is an image detection instruction, and the execution result of the instruction is an image detection result; The second processing module is configured to generate a control instruction of the first controlled device according to the image detection result, and the control instruction of the first controlled device is a human body tracking instruction; according to the human body tracking Instructions to control the motion state of the first controlled device.

It can be seen that, in the embodiment of the present application, human body tracking can be realized on the basis of the coordinated control of the first controlled device and the second controlled device.

In some embodiments of the present application, the second processing module is configured to generate a control instruction for controlling the advancement of the first controlled device in response to the image detection result indicating that the human body becomes smaller; In response to the image detection result indicating that the human body becomes larger, a control instruction for controlling the first controlled device to remain stationary is generated; and in response to the image detection result indicating that the human body is located on the first controlled device In the case of the left side of the first controlled device, a control instruction for controlling the first controlled device to turn left is generated; in response to the image detection result indicating that the human body is located on the right side of the first controlled device, a control instruction for controlling the first controlled device is generated The control instruction for the first controlled device to turn right.

It can be seen that, in the embodiment of the present application, human body tracking can be accurately achieved by controlling the motion state of the first controlled device.

In some embodiments of the present application, the first controlled device and the second controlled device are connected through a wired connection.

In this way, the reliability of the communication between the first controlled device and the second controlled device can be ensured.

The embodiment of the present application also provides a terminal, the terminal includes a processor and a memory for storing a computer program that can run on the processor; wherein, When the processor is used to run the computer program, any one of the above-mentioned device control methods applied to the terminal is executed.

An embodiment of the present application also provides an electronic device, which includes a processor and a memory for storing a computer program that can run on the processor; wherein, When the processor is used to run the computer program, any one of the above-mentioned device control methods applied to the first controlled device is executed.

The embodiment of the present application also provides a computer storage medium on which a computer program is stored, and when the computer program is executed by a processor, any one of the above-mentioned device control methods is implemented.

The embodiment of the present application also provides a computer program, including computer-readable code, and when the computer-readable code runs in a terminal, a processor in the terminal executes any one of the above-mentioned device control methods applied to the terminal.

The embodiment of the present application also provides another computer program, including computer-readable code. When the computer-readable code runs in an electronic device, the processor in the electronic device executes the above-mentioned application applied to the first controlled device. Any kind of equipment control method.

In the device control method, electronic device, and computer storage medium proposed in the embodiments of the present application, the program code used to control the operation of the first controlled device is obtained through a local agent program; the program code is sent to all through the local agent program The first controlled device enables the first controlled device to run the program code. The technical solution of the embodiment of the present application can obtain and push the program code based on the local agent program, and then can realize the control of the first controlled device based on the program code, and the program code can be flexibly edited, so that it can be more flexible Control the first controlled device.

It should be understood that the above general description and the following detailed description are only exemplary and explanatory, rather than limiting the application.

The application will be further described in detail below in conjunction with the drawings and embodiments. It should be understood that the embodiments provided here are only used to explain the application, and are not used to limit the application. In addition, the embodiments provided below are part of the embodiments for implementing the application, rather than providing all the embodiments for implementing the application. In the case of no conflict, the technical solutions described in the embodiments of the application can be combined in any manner. Implement.

It should be noted that in the embodiments of the present application, the terms "including", "including" or any other variants thereof are intended to cover non-exclusive inclusion, so that a method or device including a series of elements not only includes what is clearly stated Elements, but also include other elements not explicitly listed, or elements inherent to the implementation of the method or device. Without more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other related elements (such as steps or steps in the method) in the method or device that includes the element. The unit in the device, for example, the unit may be part of the circuit, part of the processor, part of the program or software, etc.).

For example, the device control method provided in the embodiment of the application includes a series of steps, but the device control method provided in the embodiment of the application is not limited to the recorded steps. Similarly, the terminal and controlled device provided in the embodiment of the application include A series of modules are provided, but the terminals and controlled equipment provided in the embodiments of the present application are not limited to include the explicitly recorded modules, and may also include modules that need to be set to obtain related information or perform processing based on the information.

The term "and/or" in this article is only an association relationship describing related objects, which means that there can be three relationships. For example, A and/or B can mean: A alone exists, A and B exist at the same time, and B exists alone. three conditions. In addition, the term "at least one" herein means any one or any combination of at least two of the multiple, for example, including at least one of A, B, and C, and may mean including those made from A, B, and C Any one or more elements selected in the set.

The embodiments of the present application can be applied to a control system composed of a terminal and a controlled device, and can be operated with many other general-purpose or special-purpose computing system environments or configurations. Here, the terminal can be a thin client, a thick client, a handheld or laptop device, a microprocessor-based system, a set-top box, a programmable consumer electronics product, a networked personal computer, a small computer system, etc. The control device may be an electronic device such as a smart car. The device control method provided in the embodiments of the present application can also be implemented by executing computer program codes by a processor.

Electronic devices such as terminals and controlled devices can be described in the general context of computer system executable instructions (such as program modules) executed by the computer system. Generally, program modules can include routines, programs, target programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types.

In some embodiments of the present application, the educational robot is a general teaching aid model for modern programming education, which can be controlled by WEB or mobile application (Application, APP) user terminal; in the related smart device control scheme , Usually through Bluetooth, wireless video transmission, and then information processing on the server side; in the first exemplary solution, a concept based on Wi-Fi (Wireless Fidelity) communication is proposed to control the video car system, The system consists of four parts: an EEG acquisition card, a smart phone, a mobile car, and a personal computer. The connection between the smart phone and the EEG acquisition card is realized through Bluetooth, and the remote control of the mobile car can be realized; in the second example In the solution, a remote control weeding robot is proposed. In actual implementation, a camera and a Global Positioning System (GPS) chip can be installed on the robot body. The car completes video capture and then transmits it through wireless communication. To the host computer, after completing the relevant processing, the instructions are issued to the robot; in the third exemplary solution, a remote system management solution for the sweeper is proposed. In actual implementation, the communication module can be used to The mobile phone information is wirelessly transmitted to the network management server, and then the management platform provides services to the users. The solution mainly uses the WEB method to provide related services to facilitate the user's management of the equipment.

In the above-mentioned smart device control scheme, only wireless communication can be used to complete fixed command transmission, and only fixed command buttons can be used to send fixed control commands; the communication quality of the wireless communication network will affect the communication between upper and lower computers.

In related technologies, remote control of smart devices based on WEB is an efficient and convenient solution, which plays an extremely important role in the field of remote control and education; however, there are still many problems that need to be resolved in order to achieve accurate and instant control. ; First, because the upper and lower computers use wireless connection, but the wireless network is unstable and the packet loss rate is large, there are big problems in the occasions with high performance requirements, which limits the application scenarios; secondly, only related technologies The transmission of control commands from the upper computer to the lower computer is realized, and feedback information cannot be collected or effectively processed. The issuance of control instructions on the WEB side of the upper computer and the collection and reporting of the feedback information of the execution commands on the lower computer side are also required Design a flexible and complex architecture.

In view of the foregoing technical problems, in some embodiments of the present application, a technical solution for device control is proposed. The embodiments of the present application can be implemented in scenarios such as educational robots, remote control, and smart remote control.

An embodiment of the present application proposes a device control method; FIG. 1 is a first flow chart of the device control method according to an embodiment of the present application. As shown in FIG. 1, the flow may include the following.

Step 101: The terminal obtains the program code used to control the operation of the first controlled device through the local agent program; In the embodiments of this application, the first controlled device may be an electronic device such as a smart car, an embedded development device, or a smart robot; the first controlled device may include a sensor, a camera, etc., and the terminal may provide human-computer interaction interface. In the embodiment of the present application, the first controlled device may be a separate electronic device or an integrated electronic device.

In practical applications, a local agent program can be installed in the terminal. The local agent program is at least used to collect the code submitted by the user. Here, the code submitted by the user can be used to control the work of the first controlled device. Program code, in this way, by running the local agent program, the program code used to control the operation of the first controlled device can be collected.

In some embodiments of the present application, the program code submitted by the user based on the WEB page can be obtained through the local agent program, that is, the user can submit the code for controlling the work of the first controlled device through the WEB page of the terminal. Code, when the local agent is running, the local agent can collect the corresponding code; it can be seen that the user can submit the code more conveniently based on the WEB page.

In the embodiments of the present application, the type of the above-mentioned program code is not limited, and the type of the above-mentioned program code can be predetermined according to actual application requirements. For example, the above-mentioned program code may be python code or other program codes.

Step 102: The terminal sends the program code to the first controlled device through the local agent program.

In practical applications, a communication connection between the terminal and the first controlled device can be established in advance. The embodiment of this application does not limit the connection mode of the communication connection between the terminal and the first controlled device. For example, the terminal and the first controlled device are connected. The equipment can conduct data interaction through wired connection or various wireless connection methods.

In some embodiments of the present application, the above-mentioned local agent program can be used to establish a communication connection between the terminal and the first controlled device. For example, when the above-mentioned local agent program is running, the terminal can issue an address in the local area network by broadcasting. Parse the address resolution protocol (ARP) data packet, the first controlled device in the local area network will reply the corresponding data packet upon receiving the ARP data packet, and the above-mentioned local agent can reply to the data packet of the first controlled device Perform analysis to obtain the Internet Protocol (IP) address of the first controlled device. In this way, a communication connection between the terminal and the first controlled device can be established; In the case of multiple controlled devices, if the above-mentioned local agent receives data packets from multiple controlled devices, it can generate a smart device list representing multiple controlled devices. The user can log in to multiple controlled devices In the list of smart devices, select at least one controlled device among multiple controlled devices; a communication connection between the terminal and the selected controlled device can be established based on the local agent program.

In some embodiments of the present application, after the communication connection between the terminal and the first controlled device is established, the communication connection between the terminal and the first controlled device can also be monitored to learn about the communication between the terminal and the first controlled device Connection status; for example, based on the above-mentioned local agent, the terminal can continue to send ARP data packets in the local area network by broadcasting. In this way, the terminal can determine the communication connection between the terminal and the first controlled device based on the response to the ARP data packet Status; for example, after the terminal sends an ARP data packet to the first controlled device, if it does not receive a reply data packet for the ARP data packet within the set time period, it can be considered that the communication connection between the terminal and the first controlled device is interrupted ; If the reply data packet for the ARP data packet is received within the set time, it can be considered that the terminal and the first controlled device maintain a communication connection; the set time can be set according to actual needs, for example, the set time can be 1 to 3 seconds.

In the embodiment of the present application, the terminal may send the above-mentioned program code to the first controlled device according to the pre-established communication connection between the terminal and the first controlled device.

Step 103: The first controlled device receives and runs the above-mentioned program code.

In practical applications, the first controlled device can run the uploaded program code to generate corresponding control instructions, and the first controlled device can execute the control instructions; in this way, since the control instructions are generated based on the program code, the terminal can pass The above-mentioned code realizes the control of the first controlled device.

For example, when the first controlled device includes a smart car, by running the above-mentioned program code, a control command can be generated, and the control command can indicate the motion state of the smart car.

In practical applications, steps 101 to 102 can be implemented based on the processor of the terminal, and step 103 can be implemented based on the processor of the first controlled device. The aforementioned processor can be an Application Specific Integrated Circuit (ASIC), Digital Signal Processor (DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field Programmable Gate Array (Field Programmable Gate Array, At least one of FPGA, Central Processing Unit (CPU), controller, microcontroller, and microprocessor. It is understandable that, for different terminals or controlled devices, the electronic devices used to implement the foregoing processor functions may also be other, which is not specifically limited in the embodiment of the present application.

It can be seen that using the technical solution of the embodiment of the present application, the program code can be obtained and pushed based on the local agent program, and then the control of the first controlled device can be realized based on the program code, and the program code can be flexibly edited. , Can control the first controlled device more flexibly.

In some embodiments of the present application, the first controlled device runs the program code to generate feedback information, and then the feedback information can be sent to the terminal.

In the embodiment of the present application, the feedback information may be used to indicate the feedback on the running status of the code. For example, the feedback information may include the execution result of the above-mentioned code.

It can be seen that by sending the feedback information to the terminal, the terminal can be informed of the operation of the above-mentioned program code, which is convenient for processing the program code. For example, when the operation of the program code does not meet expectations, the program code can be modified.

In some embodiments of the present application, after the terminal receives the feedback information sent by the first controlled device, it can load the feedback information on the terminal and/or display the feedback information on the display interface of the terminal.

It can be seen that by loading and/or displaying the feedback information locally on the terminal, it is convenient for the user to intuitively know the operation of the above-mentioned code.

In the embodiments of the present application, the implementation manner of loading the feedback information by the terminal is not limited. In some embodiments of the present application, the terminal loads the feedback information in a synchronous or asynchronous loading manner.

In some embodiments of the present application, the terminal may load and/or display the feedback information on the WEB front end, so that the user can intuitively know the running status of the above-mentioned code through the WEB front end.

In some embodiments of the present application, the first controlled device may generate a control instruction of the second controlled device by running the program code, wherein the first controlled device and the second controlled device form a communication connection; In the embodiment of this application, one second controlled device or multiple second controlled devices may be set; the second controlled device may be an electronic device such as a Raspberry Pi; the second controlled device may include a sensor , Camera and other devices; the second controlled device and the first controlled device can be of the same type or different.

After the first controlled device generates the control instruction of the second controlled device, it can send the control instruction of the second controlled device to the second controlled device; the second controlled device can execute the control instruction of the second controlled device , Get the instruction execution result.

The second controlled device may send the instruction execution result to the first controlled device; the first controlled device may generate the control instruction of the first controlled device according to the instruction execution result, and execute the control instruction of the first controlled device.

It can be seen that the embodiments of the present application provide a cooperative control scheme for the first controlled device and the second controlled device. In some embodiments of the present application, the first controlled device and the second controlled device can be realized based on the above-mentioned code. Cooperative control of the second controlled device.

In some embodiments of the present application, the first controlled device and the second controlled device are connected through a wired connection, for example, the first controlled device and the second controlled device are connected through a serial port; in this way, the first controlled device can be ensured The reliability of communication between a controlled device and a second controlled device.

In some embodiments of the present application, the first controlled device may also obtain working mode switching information; the working mode switching information is used to instruct the first controlled device and the second controlled device to switch the current working mode to the target working mode; In this way, the first controlled device can control the first controlled device to switch the working mode according to the working mode switching information; the first controlled device can also send the working mode switching information to the second controlled device; the second controlled device is in After receiving the work mode switching information, the work mode can be switched based on the work mode switching information.

That is to say, in the embodiment of the present application, for each controlled device, multiple working modes can be set, and when in different working modes, the working mode of the controlled device is different. It can be seen that the embodiments of the present application can realize synchronous switching of the working modes of the first controlled device and the second controlled device.

In some embodiments of the present application, the control instruction of the second controlled device is an image detection instruction, and the execution result of the instruction is the image detection result; at this time, the first controlled device may generate the image detection result according to the received image detection result. Human body tracking instruction; then, according to the human body tracking instruction, the movement state of the first controlled device can be controlled to realize human body tracking.

It can be seen that, in the embodiment of the present application, human body tracking can be realized on the basis of the coordinated control of the first controlled device and the second controlled device.

In some embodiments of the present application, in response to the image detection result indicating that the human body becomes smaller, the first controlled device generates a control instruction for controlling the advancement of the first controlled device; in response to the image The image detection result indicates that the human body has become larger, and a control instruction for controlling the first controlled device to remain still is generated; in response to the image detection result indicating that the human body is located on the left side of the first controlled device, Generate a control instruction for controlling the first controlled device to turn left; in response to the image detection result indicating that the human body is on the right side of the first controlled device, generate a control instruction for controlling the first controlled device Control instructions for turning the device to the right.

It can be seen that, in the embodiment of the present application, human body tracking can be accurately achieved by controlling the motion state of the first controlled device.

The application will be further explained below in conjunction with an application scenario.

In this application scenario, the first controlled device can include EV3 smart cars, motors, and related sensors; the EV3 smart car can drive related sensors to move through the motors; the second controlled device can include Raspberry Pi, Motors, camera heads and other devices; Figure 2 is a schematic diagram of the connection relationship between the EV3 smart car and the Raspberry Pi in an embodiment of the application. As shown in Figure 2, the Raspberry Pi 201 can pass through the Universal Serial Bus (USB) The connection method is connected to the camera 202, which can collect surrounding video or image information in real time; the Raspberry Pi 201 can also drive the camera to rotate through a motor; the Raspberry Pi 201 can be connected to the EV3 smart car 203 through the serial port adapter; EV3 smart car 203 can also be connected to the related sensor 204, the first drive wheel 205 and the second drive wheel 206; in one example, the related sensor 204 can be a touch sensor, which is generated when the touch sensor is touched. The trigger signal can be used to synchronously modify the functional modes of the Raspberry Pi 201 and the EV3 smart car 203; the EV3 smart car 203 can also drive the first drive wheel 205 and the second drive wheel 206 to work; in some embodiments of this application , The touch sensor can generate a trigger signal to the directly connected EV3 smart car 203 when it is touched, and then change the function mode flag bit of the EV3 smart car 203, and send the flag bit to the tree through the serial port. The Raspberry Pi 201 in turn triggers the change of the function mode flag bit of the Raspberry Pi 201, so as to realize the synchronous switching of the function modes of the Raspberry Pi 201 and the EV3 smart car 203.

In an example, the corresponding relationship between the connection lines of the Raspberry Pi 201 and the EV3 smart car 203 can be as shown in Table 1. From Table 1, the corresponding relationship between the interface of the Raspberry Pi 201 and the color of the connection line can be seen. Table 1 Connection relationship between Raspberry Pi 201 and EV3 smart car 203 Raspberry Pi, with a secure digital memory card (Secure Digital Memory Card, SD card) slot starting from the general-purpose input/output (GPIO) port on the outside Connection line color (robotbit line) the fourth Blue the fifth yellow the second green The third Red Remark Black and white do not need to be connected to other GPIO ports

The above-mentioned local agent program can be installed in the terminal; Figure 3 is a schematic diagram of the connection relationship between the EV3 smart car and the terminal in an embodiment of this application. As shown in Figure 3, the EV3 smart car 203 can be connected to the terminal 301 through a wireless connection. In this way, after the local agent program of the terminal 301 obtains the program code, the program code can be pushed to the EV3 smart car 203 in real time. In order to realize the wireless connection between the EV3 smart car 203 and the terminal 301, an external wireless network card can be connected to the USB interface of the EV3 smart car 203; In some embodiments of the present application, the EV3 smart car 203 and the terminal 301 can be in the same network segment. In this way, the stability of the wireless network connection and the communication reliability between the EV3 smart car 203 and the terminal 301 can be ensured.

FIG. 4 is a second flowchart of the device control method according to an embodiment of the application. As shown in FIG. 4, the process may include the following.

Step 401: Connect the EV3 smart car 203 and the Raspberry Pi 201, and connect the EV3 smart car 203 and the terminal 301.

The implementation of this step has been described in the aforementioned content, and will not be repeated here.

Step 402: On the terminal side, the program code collection of the WEB front-end is implemented based on the local agent program, and the collected program code is pushed to the EV3 smart car 203.

Here, the python code submitted by the user can be collected based on the local agent program. After the python code is pushed to the EV3 smart car 203, the EV3 smart car 203 can be made to work based on the python code, that is to say, the smart EV3 can be realized based on the python code. The remote control of the car 203, in this way, can control the EV3 smart car 203 and other controlled equipment more flexibly and diversely; in the educational scene, students can continue to trial and error and verify novel control schemes, which can cultivate students' programming process thinking.

In order to realize the connection between the EV3 smart car 203 and the terminal 301, the User Datagram Protocol (UDP) service needs to be opened on the side of the EV3 smart car 203, and the implementation of the local agent program needs to be opened by the UDP of the EV3 smart car 203 Service-based.

FIG. 5 is a schematic diagram of the functional flow of the agent program in an embodiment of the application. Referring to FIG. 5, the flow may include the following.

Step A1: Obtain a list of smart cars in the same network segment of the terminal 301 by broadcasting.

In some embodiments of the present application, when running the local agent program, the terminal 301 can issue an ARP data packet in the local area network by broadcasting, and the EV3 smart car 203 in the local area network will reply with the corresponding data upon receiving the ARP data packet. The above-mentioned local agent program can parse the data packet returned by the EV3 smart car 203 to obtain the IP address of the EV3 smart car 203; when the IP addresses of multiple EV3 smart cars 203 are obtained, the terminal 301 can be generated under the same network segment EV3 smart car list.

Step A2: Select the EV3 smart car 203 and establish a connection.

In some embodiments of the present application, a specific smart car can be selected from the above-mentioned EV3 smart car list, and then a UDP connection with the corresponding smart car can be created.

Step A3: Push the program code to the EV3 smart car 203, and receive the feedback information of the EV3 smart car 203.

In some embodiments of this application, at the WEB front end on the terminal side, the user can submit the code. When the user clicks the submit button, the local agent can collect the code submitted by the user, and then can push the code To the selected EV3 smart car 203; the EV3 smart car 203 can run the program code, generate feedback information, and send the feedback information to the terminal 301.

Step A4: Load feedback information on the front end of the WEB through asynchronous loading.

Step A5: After the program code is executed, the connection between the terminal 301 and the EV3 smart car 203 can be disconnected, and resources can be recovered.

In some embodiments of the present application, after receiving or loading the feedback information, the program code can be considered to be executed. At this time, by disconnecting the terminal 301 and the EV3 smart car 203, the terminal 301 and the EV3 smart car 203 can be released. The network transmission resources between the terminals 301 can also release corresponding hardware resources and/or software resources (for example, WEB front-end resources).

Step 403: The EV3 smart car 203 receives and runs the program code, and pushes the image detection instruction to the Raspberry Pi 201.

In some embodiments of this application, the EV3 smart car 203 activates the corresponding UDP service, which can continuously monitor the information of the fixed port. After the local agent pushes the code to the EV3 smart car 203, the EV3 smart car 203 can run The received program code (can be encapsulated in a data package) to get a control instruction; if the control instruction involves image processing tasks, it can generate an image inspection instruction, start the corresponding service mode, and push the image inspection instruction to the tree The Raspberry Pi 201 instructs the Raspberry Pi 201 to perform an image detection task, so that the image detection result can be obtained from the Raspberry Pi 201.

In some embodiments of the present application, the EV3 smart car 203 and the Raspberry Pi 201 may have multiple working modes. Table 2 illustrates several working modes of the EV3 smart car 203 and the Raspberry Pi 201 by way of example. Table 2 Working mode table of EV3 Smart Car 203 and Raspberry Pi 201 Raspberry Pi working mode Data results of EV3 smart car Face Detection Face ID (Identity Document, ID) and location coordinates Gesture classification Gesture types Body tracking Human body ID and coordinates Ball detection etc. Sphere color and position coordinates

Step 404: The Raspberry Pi 201 executes the image detection command, and transmits the image detection result (also referred to as the image processing result) to the EV3 smart car 203, and the EV3 smart car 203 executes the corresponding control command according to the image detection result.

In some embodiments of the present application, the image detection command can be encapsulated in a data packet and sent. The Raspberry Pi 201 receives the data packet from the EV3 smart car 203, parses it to find its own working mode, and then executes the corresponding image The task is detected, and the image detection result is sent to the EV3 smart car 203. In the same working mode, the EV3 smart car 203 and the Raspberry Pi 201 cooperate to perform specific tasks.

Fig. 6 is a schematic diagram of the processing flow of the EV3 smart car 203 and the Raspberry Pi 201 in the human tracking mode in the embodiment of the application. As shown in Fig. 6, the EV3 smart car 203 can be explained from the image processing stage, the detection data processing stage, and the instruction execution stage. And the processing flow of the Raspberry Pi 201; in the image processing stage, the EV3 smart car 203 can push the image detection instruction to trigger. Human body coordinates; the data processing stage mainly realizes human body ID recognition and position coordinate processing; the result of data processing is sent to the EV3 smart car 203. The EV3 smart car 203 can control the motor operation according to the logic shown in Figure 6, in this way. Realize the basic human body tracking function; referring to Figure 6, when it is determined that the human body becomes smaller, the EV3 smart car 203 is driven forward by the motor; when the human body is determined to be larger, the EV3 smart car 203 is controlled to stand still by the motor driving method; when the human body is determined to be on the left side , The motor drives the EV3 smart car 203 to turn left; when it is determined that the human body is on the right side, the motor drives the EV3 smart car 203 to turn right.

Step 405: The EV3 smart car 203 collects feedback information and sends the feedback information to the terminal 301.

Here, based on steps 401 to 405, remote control of the EV3 smart car 203 based on the WEB front end has been implemented, but a complete feedback process needs to be designed to ensure the integrity of the two-way information flow.

Figure 7 is a schematic diagram of the processing flow for feedback information in an embodiment of this application. The python interpreter completes the conversion of the original code and the byte code, and then converts it into machine code to facilitate the execution of instructions. The execution result of the program code can be redirected to a text file. When the UDP communication module is started on the EV3 side, the communication connection between the EV3 smart car 203 and the terminal 301 can be established based on the UDP communication module; the UDP communication module can be detected in real time Whether the above text file has been updated, after the text information is updated, the content (ie feedback information) will be read; then the read feedback information will be actively pushed to the local agent program of the terminal 301 through the established communication connection; local agent The program is based on the JAVA framework, and the feedback information can be loaded into the WEB front-end by asynchronous loading. The WEB front-end will return the information in the designated area after a series of renderings.

It can be seen that in the embodiment of this application, a complete remote control solution based on EV3 smart car 203 is proposed. The program code can be input through the WEB terminal and then transmitted to the lower computer (ie EV3 smart car) in real time. The lower computer responds to feedback information; further, through the local agent program, it can support the completion of the collection of the web front-end python code, and push it to the lower computer side to execute the code based on the UDP connection; through the local agent program, the terminal 301 and EV3 smart car can be realized 203’s information interaction, transmission is efficient and reliable; further, a connection scheme between the terminal, EV3 smart car 203, Raspberry Pi 201 and related peripherals is designed to ensure the efficient feasibility of the connection, and it is compatible with most embedded systems. Development equipment.

In related technologies, it is usually for independent control of EV3 smart cars and Raspberry Pi, and no collaborative control scheme for EV3 smart cars and Raspberry Pi is given; and, for the realization of a single working mode control for EV3 smart cars or Raspberry Pi, It is not possible to switch between different working modes for EV3 smart cars or Raspberry Pi.

In the embodiment of this application, a complete implementation scheme is given for the connection between the EV3 smart car and the Raspberry Pi, as well as the control of the EV3 smart car and the Raspberry Pi; moreover, different implementations can be achieved for the EV3 smart car and the Raspberry Pi. The synchronous switching mechanism of working modes can ensure the consistency of information interaction in different working modes.

Based on the content recorded in the foregoing embodiment, the following describes a device control method according to an embodiment of the present application from the perspective of a terminal.

FIG. 8 is the third flow chart of the device control method according to the embodiment of the application. As shown in FIG. 8, the flow may include the following.

Step 801: Obtain the program code for controlling the operation of the first controlled device through the local agent program; In the embodiment of the present application, the first controlled device may be an electronic device such as a smart car or an embedded development device; the first controlled device may include a sensor, a camera, and other devices, and the terminal may provide a human-computer interaction interface. In the embodiment of the present application, the first controlled device may be a single electronic device, or may integrate multiple electronic devices.

In practical applications, a local agent can be installed in the terminal. The local agent is at least used to collect the code submitted by the user. Here, the code submitted by the user can be the code used to control the operation of the first controlled device. In this way, by running the local agent program, the code used to control the operation of the first controlled device can be collected.

In the embodiments of the present application, the type of the above-mentioned program code is not limited, and the type of the above-mentioned program code can be predetermined according to actual application requirements. For example, the above-mentioned program code may be python code or other program codes.

Step 802: Send the program code to the first controlled device through the local agent program, so that the first controlled device runs the program code.

In practical applications, a communication connection between the terminal and the first controlled device can be established in advance. The embodiment of this application does not limit the connection mode of the communication connection between the terminal and the first controlled device. For example, the terminal and the first controlled device are connected. The equipment can conduct data interaction through wired connection or various wireless connection methods.

In practical applications, the first controlled device can run the uploaded program code to generate corresponding control instructions, and the first controlled device can execute the control instructions; in this way, since the control instructions are generated based on the program code, the terminal can pass The above-mentioned code realizes the control of the first controlled device.

In practical applications, step 801 to step 802 can be implemented based on the processor of the terminal, and the aforementioned processor can be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. It is understandable that, for different terminals or controlled devices, the electronic devices used to implement the foregoing processor functions may also be other, which is not specifically limited in the embodiment of the present application.

It can be seen that using the technical solution of the embodiment of the present application, the program code can be obtained and pushed based on the local agent program, and then the control of the first controlled device can be realized based on the program code, and the program code can be flexibly edited. , Can control the first controlled device more flexibly.

In some embodiments of the present application, the method further includes: After the program code is sent to the first controlled device, the feedback information of the first controlled device is received, and the feedback information is generated by the first controlled device after running the program code.

In some embodiments of the present application, the feedback information includes the execution result of the program code.

It can be seen that by sending the feedback information to the control device, the terminal can be informed of the operation of the above-mentioned code, so that the code can be processed easily. For example, when the operation of the code does not meet expectations, the code can be modified .

In some embodiments of the present application, the method further includes: After receiving the feedback information of the first controlled device, the feedback information is loaded and/or displayed on the terminal where the local agent program is located.

It can be seen that by loading and/or displaying the feedback information locally on the terminal, it is convenient for the user to intuitively know the operation of the above-mentioned code.

In some embodiments of the present application, the obtaining the program code for controlling the operation of the controlled device through the local agent program includes: The program code submitted by the user based on the WEB page is obtained through the local agent program.

It can be seen that the user can submit the code more conveniently based on the WEB page, which in turn facilitates the local agent program to collect the code submitted by the user.

Based on the content recorded in the foregoing embodiment, the following describes another device control method of the embodiment of the present application from the perspective of the first controlled device.

FIG. 9 is a fourth flowchart of the device control method according to an embodiment of the application. As shown in FIG. 9, the process may include the following.

Step 901: A program code for controlling the operation of the first controlled device sent by a terminal through a local agent program is received; the program code is collected by the local agent program.

In the embodiment of the present application, the first controlled device may be an electronic device such as a smart car or an embedded development device; the first controlled device may include a sensor, a camera, and other devices, and the terminal may provide a human-computer interaction interface. In the embodiment of the present application, the first controlled device may be a single electronic device, or may integrate multiple electronic devices.

In practical applications, a local agent can be installed in the terminal. The local agent is at least used to collect the code submitted by the user. Here, the code submitted by the user can be the code used to control the operation of the first controlled device. In this way, by running the local agent program, the code used to control the operation of the first controlled device can be collected.

In the embodiments of the present application, the type of the above-mentioned program code is not limited, and the type of the above-mentioned program code can be predetermined according to actual application requirements. For example, the above-mentioned program code may be python code or other program codes.

In practical applications, a communication connection between the terminal and the first controlled device can be established in advance. The embodiment of this application does not limit the connection mode of the communication connection between the terminal and the first controlled device. For example, the terminal and the first controlled device are connected. The equipment can conduct data interaction through wired connection or various wireless connection methods.

Step 902: Run the program code.

In practical applications, the first controlled device can run the uploaded program code to generate corresponding control instructions, and the first controlled device can execute the control instructions; in this way, since the control instructions are generated based on the program code, the terminal can pass The above-mentioned code realizes the control of the first controlled device.

It can be seen that using the technical solution of the embodiment of the present application, the program code can be obtained and pushed based on the local agent program, and then the control of the first controlled device can be realized based on the program code, and the program code can be flexibly edited. , Can control the first controlled device more flexibly.

In some embodiments of the present application, the method further includes: Run the program code to generate feedback information, and send the feedback information to the terminal.

In some embodiments of the present application, the feedback information includes the execution result of the program code.

It can be seen that by sending the feedback information to the control device, the terminal can be informed of the operation of the above-mentioned code, so that the code can be processed easily. For example, when the operation of the code does not meet expectations, the code can be modified .

In some embodiments of the present application, the method further includes: By running the program code, a control instruction of the second controlled device is generated, wherein the first controlled device and the second controlled device form a communication connection; Sending the control instruction of the second controlled device to the second controlled device, so that the second controlled device executes the control instruction of the second controlled device; Receive the instruction execution result sent by the second controlled device, generate the control instruction of the first controlled device according to the instruction execution result, and execute the control instruction of the first controlled device; wherein, the instruction The execution result is obtained by the second controlled device after executing the control instruction of the second controlled device.

It can be seen that the embodiments of the present application provide a cooperative control scheme for the first controlled device and the second controlled device. In some embodiments of the present application, the first controlled device and the second controlled device can be realized based on the above-mentioned code. Cooperative control of the second controlled device.

In some embodiments of the present application, the method further includes: Acquiring work mode switching information; the work mode switching information is used to instruct the first controlled device and the second controlled device to switch the current working mode to the target working mode; According to the work mode switching information, control the first controlled device to switch the work mode; send the work mode switch information to the second controlled device so that the second controlled device is based on the work mode switch information Switch working mode.

That is to say, in the embodiment of the present application, for each controlled device, multiple working modes can be set, and when in different working modes, the working mode of the controlled device is different. It can be seen that the embodiments of the present application can realize synchronous switching of the working modes of the first controlled device and the second controlled device.

In some embodiments of the present application, the control instruction of the second controlled device is an image detection instruction, and the execution result of the instruction is an image detection result; The generating the control instruction of the first controlled device according to the instruction execution result, and executing the control instruction of the first controlled device includes: Generating a control instruction of the first controlled device according to the image detection result, and the control instruction of the first controlled device is a human tracking instruction; According to the human body tracking instruction, the movement state of the first controlled device is controlled.

It can be seen that, in the embodiment of the present application, human body tracking can be realized on the basis of the coordinated control of the first controlled device and the second controlled device.

In some embodiments of the present application, the generating a control instruction of the first controlled device according to the image detection result includes: In response to the image detection result indicating that the human body has become smaller, generating a control instruction for controlling the advancement of the first controlled device; In response to the image detection result indicating that the human body becomes larger, generating a control instruction for controlling the first controlled device to remain stationary; In response to the image detection result indicating that the human body is located on the left side of the first controlled device, generating a control instruction for controlling the first controlled device to turn left; In response to the image detection result indicating that the human body is located on the right side of the first controlled device, a control instruction for controlling the first controlled device to turn right is generated.

It can be seen that, in the embodiment of the present application, human body tracking can be accurately achieved by controlling the motion state of the first controlled device.

In some embodiments of the present application, the first controlled device and the second controlled device are connected by a wired connection; in this way, the communication between the first controlled device and the second controlled device can be ensured reliability.

Those skilled in the art can understand that in the above-mentioned methods of the specific implementation, the writing order of the steps does not mean a strict execution order but constitutes any limitation on the implementation process. The specific execution order of each step should be based on its function and possibility. The inner logic is determined.

On the basis of the device control method proposed in the foregoing embodiment, the embodiment of the present application proposes a terminal.

FIG. 10 is a schematic diagram of the composition structure of a terminal according to an embodiment of the application. As shown in FIG. 10, the device includes an acquisition module 1001 and a first processing module 1002, wherein, The obtaining module 1001 is configured to obtain a program code for controlling the operation of the first controlled device through a local agent program; The first processing module 1002 is configured to send the program code to the first controlled device through the local agent program, so that the first controlled device runs the program code.

In one embodiment, the first processing module 1002 is further configured to receive feedback information from the first controlled device after sending the program code to the first controlled device, and the feedback The information is generated after the first controlled device runs the program code.

In one embodiment, the first processing module 1002 is further configured to load the feedback information on the terminal where the local agent program is located after receiving the feedback information of the first controlled device And/or display.

In one embodiment, the feedback information includes the execution result of the program code.

In one embodiment, the obtaining module 1001 is configured to obtain the program code submitted by the user based on the WEB page through the local agent program.

Both the acquisition module 1001 and the first processing module 1002 can be implemented by a processor located in a terminal. The processor is one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. At least one.

In addition, the functional modules in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be realized either in the form of hardware or in the form of software functional modules.

If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the essence of the technical solution of the embodiment of the application is The above or the part that contributes to the existing technology or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions to make a computer device ( It may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. The aforementioned storage media include: U disk, removable hard disk, read-only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks or optical disks and other various types of programs that can store code medium.

Specifically, the computer program instructions corresponding to a device control method in the embodiments of the present application can be stored on storage media such as optical disks, hard disks, and USB flash drives. When the storage medium contains computer program instructions corresponding to a device control method When read or executed by a terminal, any device control method applied to the terminal in the foregoing embodiments is implemented.

Based on the same technical concept of the foregoing embodiment, refer to FIG. 11, which shows another terminal provided by an embodiment of the present application, which may include: a first memory 1101 and a first processor 1102; wherein, The first memory 1101 is configured to store computer programs and data; The first processor 1102 is configured to execute a computer program stored in the first memory to implement any device control method applied to the terminal in the foregoing embodiments.

In practical applications, the above-mentioned first memory 1101 may be a volatile memory (volatile memory), such as RAM; or a non-volatile memory (non-volatile memory), such as ROM, flash memory (flash memory). ), a hard disk (Hard Disk Drive, HDD) or a solid-state drive (Solid-State Drive, SSD); or a combination of the above types of memory, and provides instructions and data to the first processor 1102.

The above-mentioned first processor 1102 may be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. It is understandable that, for different devices, the electronic devices used to implement the above-mentioned processor functions may also be other, which is not specifically limited in the embodiment of the present application.

On the basis of another device control method proposed in the foregoing embodiment, an embodiment of the present application proposes a controlled device.

FIG. 12 is a schematic diagram of the composition structure of a first controlled device according to an embodiment of the application. As shown in FIG. 12, the device includes a receiving module 1201 and a second processing module 1202, wherein, The receiving module 1201 is configured to receive a program code for controlling the operation of the first controlled device sent by the terminal through a local agent program; the program code is collected by the local agent program; The second processing module 1202 is configured to run the program code.

In one embodiment, the second processing module 1202 is further configured to run the program code to generate feedback information, and send the feedback information to the terminal.

In one embodiment, the feedback information includes the execution result of the program code.

In one embodiment, the second processing module 1202 is further configured to: By running the program code, a control instruction of the second controlled device is generated, wherein the first controlled device and the second controlled device form a communication connection; Sending the control instruction of the second controlled device to the second controlled device, so that the second controlled device executes the control instruction of the second controlled device; Receive the instruction execution result sent by the second controlled device, generate the control instruction of the first controlled device according to the instruction execution result, and execute the control instruction of the first controlled device; wherein, the instruction The execution result is obtained by the second controlled device after executing the control instruction of the second controlled device.

In one embodiment, the second processing module 1202 is further configured to obtain work mode switching information; according to the work mode switching information, control the first controlled device to switch the work mode; switch the work mode The information is sent to the second controlled device, so that the second controlled device switches the working mode based on the working mode switching information; the working mode switching information is used to instruct the first controlled device and the second controlled device The control device switches the current working mode to the target working mode.

In one embodiment, the control instruction of the second controlled device is an image detection instruction, and the execution result of the instruction is an image detection result; The second processing module 1202 is configured to generate a control instruction of the first controlled device according to the image detection result, and the control instruction of the first controlled device is a human body tracking instruction; The tracking instruction controls the motion state of the first controlled device.

In one embodiment, the second processing module 1202 is configured to generate a control instruction for controlling the advancement of the first controlled device in response to the image detection result indicating that the human body becomes smaller; The image detection result indicates that the human body becomes larger, and a control instruction for controlling the first controlled device to remain still is generated; in response to the image detection result, the human body is located on the left side of the first controlled device In the case of the first controlled device, a control instruction for controlling the first controlled device to turn left is generated; in response to the image detection result indicating that the human body is located on the right side of the first controlled device, a control instruction for controlling the first controlled device is generated A control instruction for a controlled device to turn right.

In an embodiment, the first controlled device and the second controlled device are connected through a wired connection.

Both the receiving module 1201 and the second processing module 1202 can be implemented by a processor located in the first controlled device. The processor is ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, micro At least one of the processors.

In addition, the functional modules in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be realized either in the form of hardware or in the form of software functional modules.

If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the essence of the technical solution of the embodiment of the application is The above or the part that contributes to the existing technology or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions to make a computer device ( It may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. The aforementioned storage media include: U disk, removable hard disk, read-only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks or optical disks and other various types of programs that can store code medium.

Specifically, the computer program instructions corresponding to another device control method in this embodiment of the present application can be stored on storage media such as optical disks, hard disks, and U disks. When the storage medium contains a computer corresponding to another device control method When the program instructions are read or executed by an electronic device, any device control method applied to the first controlled device in the foregoing embodiments is implemented.

Based on the same technical concept of the foregoing embodiment, refer to FIG. 13, which shows an electronic device provided by an embodiment of the present application, which may include: a second memory 1301 and a second processor 1302; wherein, The second memory 1301 is configured to store computer programs and data; The second processor 1302 is configured to execute a computer program stored in the second memory to implement any device control method applied to the first controlled device in the foregoing embodiments.

In practical applications, the above-mentioned second memory 1301 may be a volatile memory, such as RAM; or a non-volatile memory, such as ROM, flash memory, HDD or SSD; or a combination of the above types of memory , And provide instructions and data to the second processor 1302.

The aforementioned second processor 1302 may be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. It can be understood that, for different electronic devices, the electronic devices used to implement the above-mentioned processor functions may also be other, which is not specifically limited in the embodiment of the present application.

In some embodiments, the functions or modules included in the device provided in the embodiments of the present application can be used to execute the methods described in the above method embodiments. For specific implementation, refer to the description of the above method embodiments. For brevity, I won't repeat it here.

The above description of the various embodiments tends to emphasize the differences between the various embodiments, and the same or similarities can be referred to each other. For the sake of brevity, the details are not repeated herein.

The methods disclosed in the method embodiments provided in this application can be combined arbitrarily without conflict to obtain new method embodiments.

The features disclosed in the product embodiments provided in this application can be combined arbitrarily without conflict to obtain new product embodiments.

The features disclosed in each method or device embodiment provided in this application can be combined arbitrarily without conflict to obtain a new method embodiment or device embodiment.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be achieved by hardware, but in many cases the former is Better implementation. Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) ) Includes several instructions to make a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present application.

The embodiments of the application are described above with reference to the accompanying drawings, but the application is not limited to the above-mentioned specific embodiments. The above-mentioned specific embodiments are only illustrative and not restrictive. Those of ordinary skill in the art are Under the enlightenment of this application, many forms can be made without departing from the purpose of this application and the protection scope of the patent application, and these are all within the protection of this application.

Industrial applicability The embodiment of the application discloses a device control method, electronic device, and medium. The method includes: obtaining a program code for controlling the operation of a first controlled device through a local agent program; and sending the program code through the local agent program To the first controlled device to enable the first controlled device to run the program code. The technical solution of the embodiment of the present application can obtain and push the program code based on the local agent program, and then can realize the control of the first controlled device based on the program code, and the program code can be flexibly edited, so that it can be more flexible Control the first controlled device.

1001: Obtain the module 1002: The first processing module 1101: first memory 1102: the first processor 1201: receiving module 1202: second processing module 1301: second memory 1302: second processor

The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments that conform to the application, and are used together with the specification to illustrate the technical solutions of the embodiments of the application. FIG. 1 is a first flowchart of a device control method according to an embodiment of the application; Figure 2 is a schematic diagram of the connection relationship between the EV3 smart car and the Raspberry Pi in an embodiment of the application; FIG. 3 is a schematic diagram of the connection relationship between the EV3 smart car and the terminal in an embodiment of the application; FIG. 4 is a second flowchart of a device control method according to an embodiment of the application; FIG. 5 is a schematic diagram of the functional flow of the agent program in an embodiment of the application; FIG. 6 is a schematic diagram of the processing flow of the EV3 smart car and the Raspberry Pi in the human tracking mode in the embodiment of the application; FIG. 7 is a schematic diagram of a processing flow for feedback information in an embodiment of the application; FIG. 8 is a third flowchart of a device control method according to an embodiment of the application; FIG. 9 is a fourth flowchart of a device control method according to an embodiment of the application; FIG. 10 is a schematic diagram of the composition structure of a terminal according to an embodiment of the application; FIG. 11 is a schematic structural diagram of another terminal according to an embodiment of the application FIG. 12 is a schematic diagram of the composition structure of a first controlled device according to an embodiment of the application; FIG. 13 is a schematic structural diagram of an electronic device according to an embodiment of the application.

101: steps

102: Step

103: Step

Claims (14)

A device control method includes: obtaining a program code for controlling the operation of a first controlled device through a local agent program; sending the program code to the first controlled device through the local agent program, so that the first controlled device A controlled device runs the program code; the method further includes: the first controlled device runs the program code to generate a control instruction for a second controlled device, wherein the first controlled device and the The second controlled device forms a communication connection; the first controlled device sends the control instruction of the second controlled device to the second controlled device, so that the second controlled device executes the second controlled device. The first controlled device receives the instruction execution result sent by the second controlled device, generates the control instruction of the first controlled device according to the instruction execution result, and executes the first controlled device A control instruction of a controlled device; wherein the instruction execution result is obtained by the second controlled device after executing the control instruction of the second controlled device. The method according to claim 1, further comprising: after sending the program code to the first controlled device, receiving feedback information from the first controlled device, and the feedback information is generated by the first controlled device. The first controlled device is generated after running the program code. According to the method of claim 2, the method further includes: after receiving the feedback information of the first controlled device, loading and/or displaying the feedback information on the terminal where the local agent program is located . The method according to claim 2 or 3, wherein the feedback information includes an execution result of the program code. The method according to any one of claim items 1 to 3, wherein the obtaining the code used to control the operation of the controlled device through a local agent program includes: obtaining a user-based web page through the local agent program The submitted code. A device control method, applied to a first controlled device, the method comprising: receiving a program code sent by a terminal through a local agent program for controlling the operation of the first controlled device; the program code is generated by the Collected by a local agent program; running the program code: the method further includes: generating a control instruction for a second controlled device by running the program code, wherein the first controlled device and the second controlled device Control device to form a communication connection; send the control instruction of the second controlled device to the second controlled device so that the second controlled device executes the control instruction of the second controlled device; receive the second controlled device According to the instruction execution result sent by the controlled device, the control instruction of the first controlled device is generated according to the instruction execution result, and the control instruction of the first controlled device is executed; wherein, the instruction execution result is the Obtained by the second controlled device after executing the control instruction of the second controlled device. The method according to claim 6, the method further comprising: Run the program code to generate feedback information, and send the feedback information to the terminal. The method according to claim 7, wherein the feedback information includes an execution result of the program code. The method according to claim 6, the method further comprising: obtaining work mode switching information; the work mode switching information is used to instruct the first controlled device and the second controlled device to switch the current working mode Is the target working mode; controlling the first controlled device to switch the working mode according to the working mode switching information; sending the working mode switching information to the second controlled device so that the second controlled device is based on all The work mode switching information switches the work mode. The method according to claim 6, wherein the control instruction of the second controlled device is an image detection instruction, and the instruction execution result is an image detection result; and the instruction execution result is used to generate the The control instruction of the first controlled device to execute the control instruction of the first controlled device includes: generating the control instruction of the first controlled device according to the image detection result, and the first controlled device The control instruction of is a human body tracking instruction; according to the human body tracking instruction, the motion state of the first controlled device is controlled. The method according to claim 10, wherein the generating a control instruction of the first controlled device according to the image detection result includes: In response to the image detection result indicating that the human body has become smaller, a control instruction for controlling the advancement of the first controlled device is generated; in response to the image detection result indicating that the human body has become larger, a control command is generated for control A control instruction for the first controlled device to remain stationary; in response to the image detection result indicating that the human body is located on the left side of the first controlled device, a command for controlling the first controlled device to turn left is generated A control instruction; in response to the image detection result indicating that the human body is located on the right side of the first controlled device, a control instruction for controlling the first controlled device to turn right is generated. The method according to any one of Claims 6 to 11, wherein the first controlled device and the second controlled device are connected through a wired connection. An electronic device, comprising a processor and a memory configured to store a computer program that can run on the processor; wherein the processor is configured to execute any one of request items 1 to 5 when the computer program is running , Or execute the method described in any one of Claims 6 to 12. A computer storage medium has a computer program stored thereon, and when the computer program is executed by a processor, the method described in any one of claim items 1 to 5 or the method described in any one of claim items 6 to 12 is implemented.

Images