WO2023030518A1 - 基于机器人的细胞操作任务处理方法、装置、设备及介质 - Google Patents

基于机器人的细胞操作任务处理方法、装置、设备及介质 Download PDF

Info

Publication number
WO2023030518A1
WO2023030518A1 PCT/CN2022/116998 CN2022116998W WO2023030518A1 WO 2023030518 A1 WO2023030518 A1 WO 2023030518A1 CN 2022116998 W CN2022116998 W CN 2022116998W WO 2023030518 A1 WO2023030518 A1 WO 2023030518A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
task
cell
robot
actual
Prior art date
Application number
PCT/CN2022/116998
Other languages
English (en)
French (fr)
Inventor
陈亮
邓新宇
刘友桃
宋五星
陈静山
梁国龙
Original Assignee
深圳太力生物技术有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202111039293.0A external-priority patent/CN113733087B/zh
Priority claimed from CN202111040562.5A external-priority patent/CN113771030B/zh
Priority claimed from CN202111040555.5A external-priority patent/CN113821287B/zh
Application filed by 深圳太力生物技术有限责任公司 filed Critical 深圳太力生物技术有限责任公司
Publication of WO2023030518A1 publication Critical patent/WO2023030518A1/zh

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00Manipulators not otherwise provided for
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/32Micromanipulators structurally combined with microscopes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt

Definitions

  • the present application relates to the field of biotechnology, in particular to a robot-based cell manipulation task processing method, device, equipment and medium.
  • the current cell manipulation task processing technology needs to rely on the operator to control the robot on the computer equipment according to different cell manipulation tasks. Operational tasks are executed accurately.
  • a robot-based cell manipulation task processing method device, computer equipment, computer-readable storage medium and computer program product are provided.
  • An embodiment of the present application provides a robot-based cell manipulation task processing method, which is executed by a task execution terminal, including:
  • the robot is controlled to perform the cell operation task; the cell operation task can be stopped by the task assistance terminal.
  • An embodiment of the present application provides a robot-based cell manipulation task processing method, which is executed by a task assistance terminal, including:
  • the monitoring screen is used to monitor the task execution terminal to control the robot to perform cell operation tasks according to the actual operation information; the actual operation information is input on the cell operation interface of the task execution terminal;
  • the robot When a stop-execution command is received, the robot is controlled to stop performing the cell manipulation task.
  • the embodiment of the present application provides a robot-based cell manipulation task processing method, which is executed by a terminal, including:
  • the area to be configured is the cell operation task execution area corresponding to the layout mode selected by the user;
  • the operation information is used to control the cell manipulation robot to move the pipette from the origin to the actual position;
  • the control information of the virtual position point is configured according to the operation information; the control information is used to control the cell operation robot to move the pipette to the actual position point when the virtual position point is triggered.
  • the embodiment of the present application provides a robot-based cell manipulation task processing method, which is executed by a terminal, including:
  • An embodiment of the present application provides a robot-based cell manipulation task processing device, including:
  • An assistance request sending module configured to send an assistance request for cell operation tasks to the task assistance terminal
  • the simulated operation display module is used to display the simulated operation information from the task assistance terminal and aimed at the cell operation task;
  • the actual operation acquisition module is used to acquire the actual operation information input on the cell operation interface of the task execution terminal;
  • the operation task execution module is used to control the robot to perform the cell operation task according to the actual operation information; the cell operation task can be stopped by the task assistance terminal.
  • An embodiment of the present application provides a robot-based cell manipulation task processing device, including:
  • An assistance request receiving module configured to receive an assistance request for cell operation tasks sent by the task execution terminal
  • the auxiliary interface display module is used to display the operation auxiliary interface for the cell operation task according to the assistance request;
  • the simulation operation processing module is used to obtain the simulation operation information input in the operation assistance interface, and send the simulation operation information to the task execution terminal for display by the task execution terminal;
  • the monitoring screen providing module is used to provide the monitoring screen; the monitoring screen is used for the monitoring task execution terminal to control the robot to perform the cell operation task according to the actual operation information; the actual operation information is input on the cell operation interface of the task execution terminal;
  • the stop instruction processing module is used to control the robot to stop executing the cell operation task when receiving the stop execution instruction.
  • An embodiment of the present application provides a robot-based cell manipulation task processing device, including:
  • the method provides a module, which is used to provide multiple optional layout methods of the cell operation task execution area;
  • the area display module is used to display the area to be configured according to the user's selection of multiple optional layout modes; the area to be configured is the cell operation task execution area corresponding to the layout mode selected by the user;
  • a position determination module configured to determine a virtual position point selected by the user on the area to be configured
  • the operation acquisition module is used to obtain the user's operation information on the cell operation robot; the operation information is used to control the cell operation robot to move the suction tube from the origin to the actual position;
  • the information configuration module is used to configure the control information of the virtual location point according to the operation information when receiving the user's confirmation information on the operation information; the control information is used to control the cell operation robot to move the suction tube when the virtual location point is triggered to the actual point.
  • An embodiment of the present application provides a robot-based cell manipulation task processing device, including:
  • a task acquisition module configured to acquire the cell operation task that the user instructs the cell operation robot to perform
  • the habit acquisition module is used to acquire the user's operating habit information under the cell operation task
  • the habit processing module is used to determine the moving trajectory and angle suitable for the cell manipulation task according to the operating habit information
  • the robot control module is used to control the cell manipulation robot to move the suction tube to the target position according to the movement trajectory;
  • the robot control module is also used to control the cell operation robot so that when the suction tube reaches the target position, it forms an angle with the preset plane.
  • the embodiments of the present application provide a computer device on the one hand, including one or more processors and a memory, the memory stores computer-readable instructions, and when one or more processors execute the computer-readable instructions, various embodiments of the present application are realized steps in the method.
  • the embodiments of the present application provide one or more computer-readable storage media, on which computer-readable instructions are stored.
  • the methods in the various embodiments of the present application are implemented. step.
  • Embodiments of the present application provide a computer program product on the one hand, where the computer program product includes computer-readable instructions, and when the computer-readable instructions are executed by one or more processors, the steps in the methods of the various embodiments of the present application are implemented.
  • Fig. 1 is an application scenario diagram of a robot-based cell manipulation task processing method in an embodiment
  • FIG. 2 is a schematic flowchart of a robot-based cell manipulation task processing method in an embodiment
  • Fig. 3 is a schematic flow chart of the steps of the actual operation information segment feedback processing in an embodiment
  • FIG. 4 is a schematic flowchart of a robot-based cell manipulation task processing method in another embodiment
  • Fig. 5 is a schematic flow chart of the steps of obtaining simulated operation information in an embodiment
  • FIG. 6 is an application environment diagram of a robot-based cell manipulation task processing method in another embodiment
  • FIG. 7 is a schematic flowchart of a robot-based cell manipulation task processing method in another embodiment
  • Fig. 8 is a schematic diagram of an area to be configured in an embodiment
  • Fig. 9 is a schematic flowchart of a robot-based cell manipulation task processing method in another embodiment.
  • Fig. 10 is a structural block diagram of a robot-based cell manipulation task processing device in an embodiment
  • Fig. 11 is a structural block diagram of a robot-based cell manipulation task processing device in another embodiment
  • Fig. 12 is a structural block diagram of a robot-based cell manipulation task processing device in another embodiment
  • Fig. 13 is a structural block diagram of a robot-based cell manipulation task processing device in another embodiment
  • Figure 14 is a diagram of the internal structure of a computer device in one embodiment.
  • the robot-based cell manipulation task processing method provided in this application can be applied to the application scenario shown in FIG. 1 , and the application scenario can include a robot, a task execution terminal 100 and a task assistance terminal 200 .
  • the robot may adopt a six-axis robot, and the robot may communicate with the task execution terminal 100 and the task assistance terminal 200 respectively, and perform cell operation tasks under the control of the task execution terminal 100 and the task assistance terminal 200, and the cell operation tasks may include But not limited to operational tasks such as cell grabbing, placement, and cleaning.
  • the task performance terminal 100 and the task assistance terminal 200 may include, but are not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices.
  • the user of the task execution terminal 100 may be called the operator 10, and the user of the task assistance terminal 200 may be called the assistant 20, and the operator 10 may use the task execution terminal 100 in the laboratory to control the robot to perform cell operations.
  • the task when the operator 10 encounters a cell operation task that requires assistance, the task execution terminal 100 can send an assistance request for the cell operation task to the task assistance terminal 200 .
  • the assistant 20 usually uses the task assistance terminal 200 outside the laboratory.
  • the task assistance terminal 200 can also be called a remote assistance terminal. That is, in this application, the local task execution terminal 100 may request the remote task assistance terminal 200 to assist in processing one or some cell operation tasks.
  • a method for processing a robot cell manipulation task is provided. Taking the application of the method to the task execution terminal 100 in FIG. 1 as an example for illustration, the method includes the following steps:
  • Step S201 sending an assistance request for the cell manipulation task to the task assistance terminal.
  • the operator 10 when the operator 10 encounters a cell operation task that needs assistance, he can request assistance from the assistant 20 on the task assistance terminal 110.
  • the assistant 20 usually has more operations than the operator 10 in the operation of the cell operation task. A more experienced user assumes the role.
  • the operator 10 can send an assistance request for the cell operation task to the assistant 20's task assistance terminal 200 through the task assistance terminal 110, and the assistance request can include the specific content of the cell operation task that requires assistance, for example What kind of cells need to be grabbed where, what kind of cells need to be placed where, etc.
  • Step S202 displaying simulated operation information for the cell operation task from the task assistance terminal.
  • the assistant 20 can provide simulated operation information for the cell operation task requiring assistance on the task assistance terminal 200 .
  • the simulated operation information is the operation information input by the assistant 20 on the task assistance terminal 200 to perform the cell operation task and needs to be input by the operator 10 on the task execution terminal 100, but because the operation information is not actually used to control the operation of the robot information, so it is called simulated operation information.
  • the simulated operation information may specifically include clicking several controls in a certain order on the cell operation interface of the task execution terminal 100 .
  • clicking several controls in a certain order on the cell operation interface of the task execution terminal 100 can control the robot to perform corresponding actions in a certain order, such as controlling the robot to move to a certain place and place a cell, and then move to another place. waiting.
  • the task assistance terminal 200 can feed back to the task execution terminal 100; after the task execution terminal 100 receives the simulated operation information, it can provide a simulated operation information display window, and the simulated operation information
  • the display window is used to display the simulated operation information for the operator 10 to view, learn and imitate.
  • Step S203 acquiring actual operation information input on the cell operation interface of the task execution terminal.
  • the task execution terminal 100 also provides a cell operation interface, which is used to assist the operator 10 in controlling the robot, and the operator 10 can input actual operation information on the cell operation interface.
  • the actual operation information is information actually used to control the robot to perform corresponding operations.
  • the operator 10 can imitate the simulated operation information on the cell operation interface provided by the task execution terminal 100 to input corresponding actual operation information, so that the task execution terminal 100 can obtain the actual operation information.
  • Action information After viewing and learning the simulated operation information, the operator 10 can imitate the simulated operation information on the cell operation interface provided by the task execution terminal 100 to input corresponding actual operation information, so that the task execution terminal 100 can obtain the actual operation information. Action information.
  • Step S204 according to the actual operation information, control the robot to perform the cell operation task.
  • the task execution terminal 100 can directly control the robot to perform the cell operation task according to the actual operation information, or conditionally control the robot to perform the cell operation task according to the actual operation information.
  • directly controlling the robot to perform the cell operation task means that the task execution terminal 100 can directly control the robot to perform the cell operation task according to the actual operation information after obtaining the actual operation information; Before the operation information control robot executes the cell operation task, certain conditions need to be met. The condition may be confirmed by the task assistance terminal 200, or it may be that the task execution terminal 100 needs to detect whether the robot is in a controllable mode, etc. However, direct control execution or conditional control execution must be carried out under the supervision of assistant 20.
  • the task assistance terminal 200 can obtain and display the monitoring screen when the robot performs the cell operation task through the monitoring camera deployed at the location of the robot, so that the assistant 20 can judge whether there is any abnormality in the execution process of the task based on the monitoring screen Stopping the robot from performing the task means that the cell operation task can be stopped by the task assistance terminal 200 at any time.
  • the task assistance terminal 200 can provide an entry that triggers the stop execution command, so that when the assistant 20 judges that an abnormality occurs according to the monitoring screen, he can send a stop execution instruction to the task assistance terminal 200 by clicking on the entry.
  • the task assistance terminal 200 detects the stop execution instruction
  • the robot can be directly controlled to stop performing cell manipulation tasks.
  • the task execution terminal 100 may also send the actual operation information to the task assistance terminal 200, and then receive the feedback information of the actual operation information from the task assistance terminal 200.
  • This embodiment discloses one of the conditional control execution schemes. After the task execution terminal 100 obtains the actual operation information input by the operator 10, it needs to first send it to the task assistance terminal 200, and the task assistance terminal 200 displays it for future use.
  • the assistant 20 can check whether it conforms to the operation specification and input the feedback information of the actual operation information to the task assistance terminal 200 .
  • step S204 may include: when the feedback information indicates that the actual operation information conforms to the operation specifications of the cell operation task, the task execution terminal 100 controls the robot to perform the cell operation task according to the actual operation information.
  • the task execution terminal 100 can further control the robot to perform the cell operation task according to the actual operation information, so as to ensure Cell manipulation tasks are performed accurately. This can effectively avoid the problem that the operator 10 fails to execute the cell operation task due to incorrect control of the robot due to reasons such as the operator 10 not accurately imitating the simulated operation information.
  • the task execution terminal 100 can prompt the operator 10 to re-input the actual operation information according to the simulated operation information, and send it to the task assistance terminal 200 again for future use.
  • the assistant 20 makes judgments until the operation specifications of the cell operation task are met.
  • the task execution terminal 100 sends an assistance request for the cell manipulation task to the task assistance terminal 200, and the task execution terminal 100 displays the simulated operation information for the cell manipulation task from the task assistance terminal 200, and the task execution The terminal 100 acquires the actual operation information input on the cell operation interface, controls the robot to perform the aforementioned cell operation task according to the actual operation information, and the cell operation task can be stopped by the task assistance terminal 200 .
  • the task execution terminal 100 requests the task assistance terminal 200 to assist in performing the cell operation task, obtains the actual operation information input by the operator with the assistance of the simulated operation information provided by the task assistance terminal 200, and controls the robot to perform the cell operation task accordingly, And the execution of the cell operation task can be stopped by the task assistance terminal 200 at any time, so as to avoid problems such as execution errors that may exist during the execution of the cell operation task, and ensure that the cell operation task of the task execution terminal 100 can be assisted by the task assistance terminal 200 , can be executed accurately and reliably.
  • the simulation operation information in step S202 may include a simulation operation demonstration animation
  • the simulation operation demonstration animation may include each demonstration animation segment corresponding to each operation link of the aforementioned cell operation task.
  • step S202 may include: playing each demonstration animation segment of the simulated operation demonstration animation according to the time sequence corresponding to each operation link of the cell operation task.
  • the simulated operation information can be provided to the operator 10 through a simulated operation demonstration animation, and the simulated operation demonstration animation can be composed of various demonstration animation segments corresponding to each operation link of the cell operation task.
  • a complex cell operation task can be divided into multiple operation links in sequence, and each operation link corresponds to a demonstration animation segment, which is beneficial to help the operator 10 form actual operation information by watching each segment, thereby ensuring the cell operation task Can be performed accurately and reliably.
  • the task execution terminal 100 may display the simulated operation demonstration animation, so that each demonstration animation segment in the simulated operation demonstration animation is played according to the time sequence corresponding to each operation link.
  • the adjacent demo animation clips have a playback transition duration, that is, after the previous demo animation clip is played, the next demo animation clip will be played after the playback transition duration, and the playback transition duration must meet the preset playback transition duration threshold
  • the playback transition duration threshold can be set by the assistant 20 according to factors such as the difficulty of each operation and the required operation duration.
  • the playback transition duration must at least reach the playback transition duration threshold before the task execution terminal 100 plays the next demonstration animation segment, thereby sequentially simulating and operating the demonstration animations in the demonstration animation The segment has finished playing.
  • step S203 specifically includes: acquiring each segment of actual operation information input on the cell operation interface, and combining each segment of actual operation information to obtain actual operation information.
  • the operator 10 can synchronously input the actual operation information corresponding to the simulated operation demonstrated in the corresponding demonstration animation segment on the cell operation interface during the playback of each demonstration animation segment on the task execution terminal 100, and the operator 10 corresponds to each demonstration animation
  • the actual operation information synchronously input by the simulated operation demonstrated in the segment is called the actual operation information segment, so each actual operation information segment corresponds to the simulated operation demonstrated in each demonstration animation segment.
  • the operator 10 can input corresponding actual operation information segments on the cell operation interface within the playback transition time corresponding to each demonstration animation segment, and the task execution terminal 100 combines the received actual operation information segments into actual operation information.
  • the operator 10 is provided with the method of sequentially inputting the actual operation information segments corresponding to each operation link to obtain the actual operation information, so as to avoid the problem that the operator 10 is difficult to input accurate actual operation information at one time due to the complexity of the cell operation task. Problem with task execution failure.
  • the above method may further include the following steps:
  • Step S301 sending the actual operation information to the task assistance terminal.
  • the task execution terminal 100 sends the actual operation information combined by each actual operation information segment to the task assistance terminal 200, so that the assistant 20 can judge whether the actual operation information conforms to the operation specification.
  • Step S302 receiving the feedback information of each actual operation information segment in the actual operation information from the task assistance terminal.
  • the task assistance terminal 200 can sequentially display each actual operation information segment. Click several controls etc. in a certain order on the interface, for the assistant 20 to judge whether each actual operation information segment displayed by the task assistance terminal 200 conforms to the operation specification, and then input the correct information for each actual operation on the task assistance terminal 200. For the feedback information of the information segment, the task assistance terminal 200 sends the feedback information to the task execution terminal 100 .
  • Step S303 when the feedback information indicates that there is an abnormal actual operation information segment in each actual operation information segment, play the demonstration animation segment corresponding to the abnormal actual operation information segment, and obtain the corresponding actual operation information segment re-input on the cell operation interface .
  • the abnormal actual operation information segment is the actual operation information segment marked by the assistant 20 on the task assistance terminal 200 as not conforming to the operation specification of the cell operation task among the actual operation information segments.
  • the task execution terminal 100 plays the demonstration animation segment corresponding to the abnormal actual operation information segment, and at the same time, the task execution terminal 100 can prompt the operator 10
  • the corresponding actual operation information segment is re-input on the cell operation interface, and the task execution terminal 100 acquires the corresponding actual operation information segment re-input by the operator 10 on the cell operation interface.
  • step S304 after replacing the abnormal actual operation information segment in the actual operation information with the re-input actual operation information, the replaced actual operation information is sent to the task assistance terminal again.
  • the replaced actual operation information refers to the actual operation information obtained after replacing the abnormal actual operation information in the original actual operation information with the re-input actual operation information.
  • the task execution terminal 100 replaces the abnormal actual operation information segment in the actual operation information with the corresponding actual operation information segment re-input by the operator 10 on the cell operation interface. Then, the task execution terminal 100 resends the replaced actual operation information segment to the task assistance terminal 200 for the assistant 20 to judge whether it conforms to the operation specification. If there are still abnormal actual operation information segments, the operator 10 needs to re-input the actual operation information on the cell operation interface of the task execution terminal 100, and submit the actual operation information to the task assistance terminal 200 until the task assistance terminal 200 returns The feedback information of the submitted actual operation information indicates that each segment of the actual operation information conforms to the operation specification.
  • the solution of this embodiment can form the actual operation information in a multi-segment combination, and provide it to the assistant 20 of the task assistance terminal 200 for segment review, so that the operator 10 only needs to re-enter the actual operation information that does not meet the specifications. Operation information segments do not need to re-input all actual operation information, reducing the possibility of operator 10 making mistakes again, ensuring the accuracy and reliability of actual operation information, and improving the formation efficiency of operation information.
  • the above method may further include the following steps: during the process of the robot performing the cell operation task, if the task execution terminal 100 receives the task execution stop information from the task assistance terminal 200, the task execution terminal 100 is limited to the cell operation interface.
  • the task execution terminal 100 detects that the robot has reached a predetermined position under the control of the task assistance terminal 200, the task execution terminal 100 releases the restriction on the input of the cell operation interface.
  • the assistant 20 can monitor the task execution process on the task assistance terminal 200.
  • the task assisting terminal 200 sends task stop execution information to the task execution terminal 100 and controls the robot to stop executing the cell operation task.
  • the task execution terminal 100 After the task execution terminal 100 receives the task stop execution information, it can restrict the input of the operator 10 on the cell operation interface, that is, the task execution terminal 100 may temporarily not allow the operator 10 to input operation information on the robot on the cell operation interface to prevent The robot may perform more erroneous actions under the operation of the operator 10 .
  • the robot is directly controlled by the task assistance terminal 200.
  • the task assistance terminal 200 can control the robot to move from the current position to a predetermined position.
  • the predetermined position can be the preset initial safe position of the robot, or called the zero position of the robot.
  • the task assistance terminal 200 can send a release instruction to the task execution terminal 100, and the task execution terminal 100 will confirm that the robot has arrived at the scheduled location under the control of the task assistance terminal 200 after receiving the release instruction from the task execution terminal 100. Then, the task execution terminal 100 releases the restriction on the input of the cell operation interface, and the operator 10 can re-input the corresponding operation information on the cell operation interface to control the robot, thereby improving the reliability of the cell operation task execution.
  • FIG. 4 there is also provided a robot-based cell manipulation task processing method, as shown in FIG. 4 , which is illustrated by taking the application of the method to the task assistance terminal 200 in FIG. 1 as an example, including the following steps:
  • Step S401 receiving an assistance request for a cell operation task sent by a task execution terminal.
  • the task assistance terminal 200 may receive an assistance request for a cell operation task initiated by the operator 10 on the task execution terminal 100 .
  • Step S402 according to the assistance request, display an operation assistance interface for the cell operation task.
  • the task assistance terminal 200 displays an operation assistance interface for the cell operation task according to the assistance request sent by the task execution terminal 100 , and the operation assistance interface is used for the assistant 20 to input simulation operation information.
  • the operation assistance interface can be the same as the cell operation interface of the task execution terminal 100, so that the simulated operation information input by the assistant 20 on the operation assistance interface can facilitate the operator 10 to simulate and input the corresponding actual operation information on the cell operation interface of the task execution terminal 100.
  • Action information is the same as the cell operation interface of the task execution terminal 100, so that the simulated operation information input by the assistant 20 on the operation assistance interface can facilitate the operator 10 to simulate and input the corresponding actual operation information on the cell operation interface of the task execution terminal 100.
  • Step S403 obtaining the simulated operation information input on the operation assistance interface, and sending the simulated operation information to the task execution terminal for display by the task execution terminal.
  • the assistant 20 can input simulated operation information in the operation assistance interface according to the cell operation task that needs assistance, and the task assistance terminal 200 obtains the simulated operation information, and the assistant 20 confirms the operation information.
  • the task assistance terminal 200 sends the simulated operation information to the task execution terminal 100, and the task execution terminal 100 can display the simulated operation information for the operator 10 to watch, learn and imitate after receiving the simulated operation information.
  • Step S404 providing a monitoring screen for the monitoring task execution terminal to control the robot to perform the cell operation task according to the actual operation information.
  • the task execution terminal 100 receives and displays simulated operation information, and provides a cell operation interface for the operator 10, and the task execution terminal 100 receives the actual operation information input by the operator 10 on the cell operation interface, and controls the Robots perform cell manipulation tasks.
  • the task assistance terminal 200 provides the assistant 20 with a monitoring screen for monitoring the task execution terminal 100 to control the robot to perform the cell operation task according to the actual operation information, so that the assistant 20 can judge whether there is an abnormality in the execution process of the task according to the monitoring screen. Stop the robot from performing the task, and the monitoring picture can be obtained by the task assistance terminal 200 through the monitoring camera deployed at the location of the robot.
  • Step S405 when the task assistance terminal 200 receives the stop execution instruction, control the robot to stop executing the cell operation task.
  • the task assistance terminal 200 can provide an entry that triggers the stop execution instruction.
  • the assistant 20 judges that an abnormality occurs according to the monitoring screen, he can click on this entry to send a stop execution instruction to the task assistance terminal 200, and the task assistance terminal 200 receives the instruction. After the instruction is stopped, the robot can be directly controlled to stop performing the aforementioned cell manipulation tasks.
  • the task assistance terminal 200 can receive the assistance request for the cell manipulation task sent by the task execution terminal 100, display an operation assistance interface for the cell manipulation task according to the assistance request, and obtain the operation status of the assistant 20.
  • the simulated operation information input by the auxiliary interface is then sent to the task execution terminal 100 for display.
  • the task assistance terminal 200 also provides information for monitoring the task execution terminal 100 according to the actual data input by the operator 10 on the cell operation interface.
  • the operation information controls the monitoring screen of the robot performing the cell manipulation task.
  • the task assistance terminal 200 receives a stop execution instruction, it can directly control the robot to stop performing the aforementioned cell manipulation task. This method can avoid problems such as execution errors that may exist during the execution of the cell operation task, and ensure that the cell operation task of the task execution terminal 100 can be accurately and reliably performed with the assistance of the task assistance terminal 200 .
  • the acquisition of simulated operation information input on the operation assistance interface in step S403 may specifically include:
  • Step S501 obtaining the simulated operation input on the operation assistance interface.
  • the simulation operation corresponds to each operation link of the cell operation task.
  • the assistant 20 can input simulated operations corresponding to each operation link of the cell operation task on the operation assistance interface provided by the task assistance terminal 200 , and the task assistance terminal 200 acquires these simulated operations.
  • Step S502 according to the simulated operation of each operation link corresponding to the cell operation task, each demonstration animation segment corresponding to each operation link is acquired respectively.
  • the task assistance terminal 200 generates corresponding demonstration animation segments according to the simulated operations corresponding to each operation link of the cell operation task input by the assistant 20 on the operation assistance interface, and each demonstration animation segment corresponds to each Operation link.
  • Step S503 according to the preset playback transition duration threshold and the timing corresponding to each operation link, combine each demonstration animation segment to obtain a simulated operation demonstration animation;
  • the task assistance terminal 200 can further obtain the playback transition duration threshold value set by the assistant 20 according to factors such as the operation difficulty and operation time corresponding to each operation link, and then the task assistance terminal 200 can perform the playback transition according to the playback transition duration threshold.
  • the duration threshold and the corresponding timing of each operation link in the cell operation task combine each demonstration animation clip into a simulated operation demonstration animation.
  • the playback transition duration of adjacent demonstration animation segments in the simulated operation demonstration animation satisfies the aforementioned playback transition duration threshold.
  • step S504 the simulated operation demonstration animation is used as the simulated operation information.
  • the task assistance terminal 200 can send the simulated operation demonstration animation as simulated operation information to the task execution terminal 100 for display, so that the operator 10 can watch the operation corresponding to each segment in the simulated operation demonstration animation and then The task execution terminal 100 forms actual operation information to ensure that the cell operation task is performed accurately and reliably.
  • a robot-based cell manipulation task processing method is also provided, which can be applied to the application environment shown in FIG. , fine-tuning mechanism 104, fine-tuner 105, automatic homing device 106, suction pump 107, suction pipe 108, suction needle 109, microscope 110, microscope lens 111, container box 112 and small material box 113.
  • the terminal 101 can communicate with the cell manipulation robot 103 to control the cell manipulation robot 103 .
  • the terminal 101 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers and portable wearable devices.
  • the cell manipulation robot 103 can adopt a six-axis robot; the automatic homing device 106 can communicate with the terminal 101, and can automatically homing the cell manipulation robot 103 under the instruction of the terminal 101; the fine-tuning mechanism 104, the fine-tuning mechanism 104 is also called a suction tube Fine-tuning mechanism, fine-tuning mechanism 104 can be installed on the end flange of cell manipulation robot 103; 104; on the microscope 110, a container box 112 can be placed at the center below the microscope lens 111, and the cell fluid can be placed in the container box 112; the fine-tuning device 105 can include three fine-tuning handwheels, which can be used to control the fine-tuning mechanism 104 on the X-axis, Y-axis and Z-axis movement; the small material box 113 can adopt specifications such as 96 holes and 60 holes
  • a robot-based cell manipulation task processing method is provided.
  • the method is applied to the terminal 101 in FIG. 6 as an example for illustration, including the following steps:
  • Step S701 providing various optional layout modes of the cell operation task execution area.
  • the terminal 101 presents the user with multiple optional layouts for the cell operation task execution area.
  • the various cell operation task execution areas include at least one of the liquid extraction area, liquid placement area, or cleaning area.
  • Different cell operation task execution areas generally have different layout methods.
  • the same cell operation task execution area The layout can also be different.
  • the liquid extraction area generally adopts a circular layout to correspond to the shape of the container box 112
  • the liquid storage area can adopt a rectangular layout to correspond to the shape of the small material box 113 wait.
  • different rectangular layouts can be adopted to correspond to the shapes of the small magazines 113 with specifications such as 96 holes and 60 holes.
  • the terminal 101 can provide multiple optional layout modes for the cell operation task execution area, so that users can quickly select a layout mode that meets their needs.
  • Step S702 according to the user's selection of multiple optional layout modes, display the area to be configured.
  • the user can select a variety of optional layout methods, for example, select one of the layout methods, and the layout method selected by the user is called the user-selected layout method, and the terminal 101 can select multiple optional layout methods according to the user's selection.
  • Method selection determine the layout method selected by the user among the various optional layout methods provided, so as to obtain the cell operation task execution area corresponding to the layout method selected by the user as the area to be configured, and then display the area to be configured .
  • Step S703 determining the virtual position point selected by the user on the area to be configured.
  • the area to be configured 800 is displayed for the user by the terminal 101, and the user can select any one or more virtual location points on the area to be configured 800 displayed by the terminal 101, for example, select the virtual location point P0, wherein, the virtual position point is not a point in the real space, but a point displayed on the area 800 to be configured of the terminal 101 .
  • Step S704 acquiring the user's operation information on the cell operation robot.
  • the user can control the cell manipulation robot 103 to move the pipette 108 from the origin (or zero point) to the actual position point, and the terminal 101 can acquire and record the data used to control the cell manipulation robot.
  • the actual position point is a point in the real space, that is, the user controls the cell manipulation robot 103 to move the suction tube 108 from the origin to the position point in the real space.
  • Step S705 when receiving the confirmation information of the operation information from the user, configure the control information of the virtual location point according to the operation information.
  • the terminal 101 may prompt the user whether to confirm that the operation information is correct, for example, prompt the user whether to control the cell operation robot 103 to move the suction tube 108 from the origin to the desired position. If yes, the terminal 101 can receive the confirmation message of the operation information sent by the user; if not, the terminal 101 can control the cell manipulation robot 103 to return the suction tube 108 to the original point, prompting the user to re-operate the cell manipulation robot 103 until the operation information is confirmed correct.
  • the terminal 101 can configure the control information of the virtual location point according to the operation information, and the control information can be used to control the cell operation robot 103 to move the suction tube 108 to the corresponding actual location point when the virtual location point is triggered.
  • configuring the control information of the virtual location point according to the operation information in step S705 may include: obtaining the coordinate information of the actual location point relative to the origin according to the operation information; and obtaining the control information according to the coordinate information.
  • the terminal 101 can obtain the coordinate information of the actual location point relative to the origin according to the operation information confirmed by the user. Assuming that the coordinates of the origin are (0,0,0), the terminal 101 can calculate the actual location according to the operation information confirmed by the user.
  • the coordinates of the point relative to the origin such as (x, y, z), so that the terminal 101 can obtain the control information of the virtual position point according to the coordinate information, and the control information can be used to control the cell operation robot 103 to move the suction tube 108 to the The spatial position basis of the actual position point.
  • the following step may be further included: in response to the user's trigger operation on the aforementioned virtual location point, according to the current location point of the pipette relative to the The coordinate information of the origin and the aforementioned control information control the cell manipulation robot to move the pipette from the current position to the actual position.
  • the user can send a trigger operation on the virtual location point P0 to the terminal 101 by clicking on the terminal 101, and the terminal 101
  • the coordinate information (x0, y0, z0) of the current position of the suction tube 108 relative to the origin can be obtained, so that according to the coordinate information (x0, y0, z0), and the configured virtual position point
  • the coordinate information (x, y, z) of the actual position point relative to the origin point controls the cell manipulation robot 103 to move the pipette 108 from the current position point to the actual position point, so that the virtual
  • the mobile control relationship between the location point and the actual location point is effectively applied, realizing the flexible control of the cell operation robot in the actual scene where the layout of the cell operation task execution area is changeable.
  • the robot-based cell manipulation task processing method is mainly used to configure the control information of the cell manipulation robot.
  • the terminal 101 provides multiple optional layout modes of the cell manipulation task execution area. According to the user's selection of the multiple optional layout modes, Display the area to be configured; the area to be configured is the cell operation task execution area corresponding to the layout mode selected by the user; then the terminal 101 determines the virtual position point selected by the user on the area to be configured, and obtains the user's information about the cell operation robot 103
  • the operation information is used to control the cell operation robot 103 to move the suction tube 108 from the origin to the actual position point; when receiving the user's confirmation information on the aforementioned operation information, the terminal 101 configures the aforementioned virtual position according to the operation information point control information; this control information can be used for terminal 101 to control cell manipulation robot 103 to move pipette 108 to the actual point when the virtual point is triggered.
  • This application can provide users with a variety of optional layout methods for the cell operation task execution area. After the layout method is selected, it can further provide users with virtual location points and actual location points that can be established according to actual scene requirements in this layout method. After the movement control relationship between the virtual position point and the actual position point is established, the user can control the cell manipulation robot to move the suction tube to the actual position point by triggering the virtual position point, thereby improving the control of the cell manipulation robot.
  • the flexibility of control can meet the needs of users to flexibly control the cell manipulation robot in the actual scene where the layout of the cell manipulation task execution area is changeable. in,
  • determining the virtual position point selected by the user on the area to be configured in step S703 may include: providing block feature points of each job position block in the area to be configured as optional virtual position points; Select the selection information of the virtual location point to determine the virtual location point selected by the user on the area to be configured.
  • the area to be configured 800 may be formed by splicing a plurality of working position blocks, for example, the area to be configured 800 may be formed by combining working position blocks K1 and K2 .
  • Each working position block can correspond to a certain working area in the cell operation task execution area.
  • a working position block in the area to be configured 800 can correspond to, for example, 96 wells, 60 wells, etc.
  • a hole position of the small material box 113 of the standard, etc., wherein, a hole position of the small material box 113 can be regarded as a liquid storage area.
  • Each working position block in the area to be configured 800 has feature points, and the block feature points may include corner points, center points, and the like.
  • the block feature points of the working position block K1 may be the corner point P1 and the center point P2
  • the block feature points of the working position block K2 may be the corner point P3, and so on.
  • the terminal 101 may display the block feature points of each working position block in the area to be configured 800 as optional virtual position points. That is to say, the terminal 101 can directly provide the block feature points of each job location block to the user for selection, so that the user can quickly select the desired virtual location point. Then, the terminal 101 can obtain the user's selection information on the optional virtual location point, and determine the virtual location point selected by the user on the area 800 to be configured according to the selection information, such as the corner point P1, thereby improving the efficiency of location point selection.
  • the number of virtual location points is multiple; each virtual location point corresponds to a job location block; the above-mentioned method may also include the following steps: in response to a user's trigger operation on a job location block, a job location One or more virtual position points corresponding to the block are enlarged and displayed; in response to the user's trigger operation on the one or more virtual position points displayed by the enlargement, the cell manipulation robot is controlled to move the pipette to the corresponding actual position point.
  • the number of virtual position points is multiple, such as virtual position point P4 and virtual position point P5, etc.
  • each virtual position point corresponds to a job position block, such as virtual position point P4 corresponding to the job position block K3
  • the virtual position point P5 can also correspond to the working position block K3, that is, one working position block can correspond to multiple virtual position points, and one virtual position point corresponds to one working position block, so that the suction pipe 108 can be moved to a working area.
  • the control requirements of different positions are multiple, such as virtual position point P4 and virtual position point P5, etc.
  • the terminal 101 can first obtain the trigger operation of the user on the work position block K3, and then enlarge and display the work position block K3 as a whole, such as the work position block K30, so that the work position block K3 corresponds to
  • the virtual location point P4 and the virtual location point P5 are also correspondingly amplified into the virtual location point P40 and the virtual location point P50.
  • the terminal 101 further obtains the user's trigger operation on the virtual position point P40 and the virtual position point P50, and then controls the cell manipulation robot 103 to move the suction tube 108 to the corresponding actual position point.
  • the terminal 101 may control the cell manipulation robot 103 to move the pipette 108 to the actual position point corresponding to the virtual position point P40.
  • the terminal 101 can cancel the aforementioned enlarged display effect and restore the original display effect.
  • the number of virtual position points is multiple; a working position block corresponds to a virtual position point; the above method may also include the following steps: in response to a user’s trigger operation on a working position block, the control cell operation robot will The suction tube moves to the corresponding actual position point.
  • the number of virtual position points is multiple, such as virtual position point P1 and virtual position point P3, etc.
  • each work position block corresponds to a virtual position point
  • such as work position block K1 corresponds to virtual position point
  • the position point P1 and the working position block K2 correspond to the virtual position point P3, which can meet the control requirement of moving the suction pipe 108 to the position of a working area more quickly.
  • the user can directly select the working position block K1 on the terminal 101, and the terminal 101 controls the cell manipulation robot 103 to move the suction tube 108 to the actual position corresponding to the virtual position point P1 in response to the trigger operation on the working position block K1 Points are directly selected by selecting blocks, which further improves the efficiency of position point selection and robot control efficiency.
  • the present application also provides a robot-based cell manipulation task processing method, which can be applied in the application environment as shown in FIG. 6 .
  • the robot-based cell manipulation task processing method provided in the present application will be described below based on the application scenario shown in FIG. 6 in combination with corresponding embodiments.
  • a robot-based cell manipulation task processing method is provided.
  • the application of the method to the terminal 101 in FIG. 6 is used as an example for illustration, including the following steps:
  • Step S901 acquiring the cell manipulation task that the user instructs the cell manipulation robot to perform.
  • the terminal 101 may receive a cell manipulation task from a user instructing the cell manipulation robot 103 to perform, and the cell manipulation task includes at least one of a liquid extraction operation, a liquid placement operation, or a cleaning operation.
  • Step S902 acquiring user's operation habit information under the cell operation task.
  • the terminal 101 acquires the user's operating habit information under the cell manipulation task.
  • the operation information of each cell operation task can be obtained through statistics, or it can be obtained by the user's active setting for each cell operation task.
  • Step S903 according to the operation habit information, determine the moving trajectory and angle suitable for the cell operation task.
  • the terminal 101 determines, according to the operation habit information, the movement trajectory and angle suitable for the current cell operation task and in line with the user's operation habit.
  • the moving track refers to the track where the cell manipulation robot 103 moves the suction tube 108 from the current position to the target position, and the target position can be obtained directly from the operating habit information, and the target position can be understood as the user using the cell manipulation robot 103 to perform the task.
  • the angle refers to the angle formed between the suction tube 108 and the preset plane when it reaches the target position
  • the preset plane can include a horizontal plane and a vertical plane.
  • the angle Angles with the horizontal and vertical planes, respectively, may be included.
  • Step S904 controlling the cell manipulation robot to move the suction tube to the target position according to the aforementioned movement track.
  • Step S905 controlling the cell manipulation robot so that the suction tube forms the aforementioned angle with the preset plane when it reaches the target position.
  • the terminal 101 can send corresponding control instructions to the cell manipulation robot 103 to instruct the cell manipulation robot 103 to move the suction tube 103 from the current position to the target position according to the aforementioned movement trajectory.
  • the terminal 101 can also control the cell manipulation robot 103 to make the suction tube 130 reach the target position to form the aforementioned angle with the preset plane, so that the cell manipulation robot 103 automatically moves the suction tube 103 to meet the requirements of the cell manipulation task, And the target position conforms to the user's operating habits, and the angle of the suction tube 103 is also automatically adjusted to meet the needs of the cell operation task and meet the user's operating habits.
  • the user can directly operate the cell manipulation robot 103 to perform specific cell manipulation tasks, such as controlling the cell manipulation robot 103 to perform at least one cell manipulation such as taking liquid, placing liquid, or cleaning based on the target position and angle. tasks, without the need for repetitive and frequent position and angle adjustments every time a task is performed, in order to improve operational efficiency.
  • specific cell manipulation tasks such as controlling the cell manipulation robot 103 to perform at least one cell manipulation such as taking liquid, placing liquid, or cleaning based on the target position and angle. tasks, without the need for repetitive and frequent position and angle adjustments every time a task is performed, in order to improve operational efficiency.
  • the above robot-based cell manipulation task processing method is mainly used to control the cell manipulation robot 103, the terminal 101 acquires the cell manipulation task that the user instructs the cell manipulation robot 103 to perform, and the terminal 101 acquires the user's operating habit information under the cell manipulation task, The terminal 101 determines the trajectory and angle suitable for the cell manipulation task according to the operation habit information, and then the terminal 101 controls the cell manipulation robot 103 to move the suction tube 108 to the target position according to the movement trajectory and controls the cell manipulation robot 103 to make the suction tube 108 forms the aforementioned angle with the preset plane when reaching the target position.
  • This solution can automatically acquire the user's operating habits under the current cell operation task to be performed, so as to determine the mobile trajectory and angle suitable for the cell operation task according to the user's operating habits according to the operation habit, and automatically control the cell operation robot 103 Move the suction tube 108 to the target position according to the movement track and make the suction tube 108 reach the target position to form the aforementioned angle with the preset plane, so that the user does not need to perform repeated and frequent adjustment operations on the cell manipulation robot 103 and improves the cell manipulation efficiency. , and also helps to reduce the probability of operating errors.
  • obtaining the operation habit information of the user under the cell operation task in step S902 may include: obtaining the operation information of the user for the cell operation task within a historical period; obtaining the operation habit information according to the statistics of the operation information .
  • the terminal 101 can make statistics on the user's previous operation information under the cell operation task, and obtain the operation habit information according to the statistical results.
  • the terminal 101 can obtain the operation information of the user on the cell operation task in the historical period.
  • the historical period can be a certain period in the near future, such as the past 1 month, the past 3 months, etc., and the user's habits may change. As at least one factor such as its operating skills or proficiency changes, obtaining its recent operating information is conducive to more accurately determining its operating habits, thereby helping to automatically control the cell operation robot 103 to operate in a manner consistent with its habits.
  • the terminal 101 After acquiring the operation information of the user on the cell operation task in the historical period, the terminal 101 obtains the operation habit information of the user under the cell operation task according to the statistics of the operation information.
  • the operation information may specifically be that when performing the cell operation task, the terminal 101 controls the cell operation robot 103 to move the suction tube 108 to a certain or certain positions, adjust the suction tube 108 to a certain or certain angles, etc.
  • the statistics can specifically be frequency statistics of certain positions moved to and certain angles adjusted.
  • the following describes in detail how to obtain the operation habit information in the case of the cell operation tasks being the liquid taking operation, the liquid placing operation and the cleaning operation respectively in the manner of an embodiment.
  • the cell operation task includes a liquid extraction operation;
  • the operation information includes liquid extraction operation position information for controlling the cell operation robot 103 to move the pipette 108 to a corresponding liquid extraction position, and for controlling the cell operation robot 103 to use
  • the suction tube 108 arrives at the corresponding liquid-taking position, the liquid-taking operation angle information that forms a corresponding angle with the preset plane;
  • the position information and the liquid-taking operation angle information determine the high-frequency liquid-taking position that satisfies the frequency condition of the liquid-taking operation position, and the high-frequency liquid-taking angle that satisfies the frequency condition of the liquid-taking operation angle at the high-frequency liquid taking position;
  • the position of taking liquid and the angle of taking liquid at high frequency can be used to obtain the information of operating habits.
  • the operation information may include the position information of the liquid extraction operation and the angle information of the liquid extraction operation.
  • the terminal 101 can perform frequency statistics on the corresponding liquid-taking positions and liquid-taking angles, and determine the high-frequency liquid-taking positions that meet the frequency conditions of the liquid-taking operation positions and the high-frequency liquid-taking positions at the high-frequency The high-frequency liquid-taking angle that satisfies the frequency condition of the liquid-taking operation angle under the liquid-taking position.
  • the frequency condition of the liquid-taking operation position may be the highest frequency used by the user among all the liquid-taking positions counted
  • the frequency condition of the liquid-taking operation angle may be a liquid-taking position that satisfies the frequency condition of the liquid-taking operation position, That is, at the position of high-frequency liquid extraction, the angle of liquid extraction that is most frequently used by users is the angle of high-frequency liquid extraction.
  • the cell manipulation task includes a liquid placement operation;
  • the operation information includes liquid placement operation position information for controlling the cell manipulation robot 103 to move the pipette 108 to a corresponding liquid placement position, and for controlling the cell manipulation robot 103 to use
  • the suction tube 108 reaches the corresponding liquid placement position, the liquid placement operation angle information that forms a corresponding angle with the preset plane; and, according to the statistics of the operation information in the above embodiment, the operation habit information is obtained, specifically including: according to the liquid placement operation position information and liquid placement operation angle information, determine the high-frequency liquid placement position that satisfies the frequency condition of the liquid placement operation position, and the high-frequency liquid placement angle that satisfies the frequency condition of the liquid placement operation angle at the high-frequency liquid placement position; Liquid placement position and high-frequency liquid placement angle to obtain operating habit information.
  • the operation information may include liquid placement operation position information and liquid placement operation angle information, which respectively represent the user's
  • the terminal 101 can perform frequency statistics on the corresponding liquid placement position and liquid placement angle, and determine the high-frequency liquid placement position that satisfies the frequency condition of the liquid placement operation position and the high-frequency liquid placement position at the high frequency.
  • the high-frequency liquid placement angle that satisfies the frequency condition of the liquid placement operation angle under the liquid placement position.
  • the frequency condition of the liquid placement operation position may be the most frequently used by the user among all the counted liquid placement positions
  • the frequency condition of the liquid placement operation angle may be the liquid placement position that satisfies the frequency condition of the liquid placement operation position, That is, the high-frequency liquid placement position is the most frequently used liquid placement angle by users, that is, the high-frequency liquid placement angle.
  • the terminal 101 can also use the high-frequency liquid placement position and high-frequency liquid placement angle as the operation habit information.
  • the cell operation task includes a cleaning operation;
  • the operation information includes cleaning operation position information for controlling the cell operation robot 103 to move the suction tube 108 to a corresponding cleaning position, and for controlling the cell operation robot 103 to make the suction tube 108 108.
  • the operation habit information that forms a corresponding angle with the preset plane when arriving at the corresponding cleaning position; and, according to the statistics of the operation information in the above embodiment, the operation habit information is obtained, specifically including: according to the cleaning operation position information and the cleaning operation angle Information, determine the high-frequency cleaning position that meets the frequency condition of the cleaning operation position, and the high-frequency cleaning angle that meets the frequency condition of the cleaning operation angle under the high-frequency cleaning position; according to the high-frequency cleaning position and high-frequency cleaning angle, the operation habit information is obtained .
  • the operation information may include the cleaning operation position information and the cleaning operation angle information, and the cleaning operation position information and the cleaning operation angle information represent the user's
  • control the cell manipulation robot 103 to move the suction tube 108 to which cleaning position or positions, and control the cell manipulation robot 103 to make the suction tube 108 reach the corresponding cleaning position and which cleaning angle or angles it forms with the preset plane .
  • the terminal 101 can perform frequency statistics on the corresponding cleaning positions and cleaning angles, and determine the high-frequency cleaning position that meets the frequency conditions of the cleaning operation position and the high-frequency cleaning position that satisfies the cleaning operation requirements.
  • the cleaning operation position frequency condition may be the highest frequency used by the user among all the cleaning positions counted
  • the cleaning operation angle frequency condition may be a cleaning position that satisfies the cleaning operation position frequency condition, that is, a high-frequency cleaning position
  • the cleaning angle with the highest frequency used by users that is, the high-frequency cleaning angle.
  • the terminal 101 may also use the high-frequency cleaning position and the high-frequency cleaning angle as operation habit information.
  • the user's operation habit information under the cell operation task is acquired, including at least one of the following:
  • the user can actively set the operation habit information of all or part of the cell operation task
  • the cell operation task can include at least one of the liquid extraction operation, liquid placement operation or cleaning operation, that is, the user can actively set Operation habit information of one or more cell operation tasks in liquid taking operation, liquid setting operation and cleaning operation.
  • the terminal 101 can acquire the position information of the liquid extraction operation and the angle information of the liquid extraction operation set by the user for the liquid extraction operation, and the terminal 101 can also acquire the high-frequency liquid placement position and the high-frequency angle information set by the user for the liquid placement operation.
  • the terminal 101 can also obtain the high-frequency cleaning position and high-frequency cleaning angle set by the user for the cleaning operation, and then the terminal 101 can collect the liquid-taking operation position information, the liquid-taking operation angle information, the high-frequency liquid setting position and The high-frequency liquid placement angle, and at least one of the high-frequency cleaning position and the high-frequency cleaning angle are used as operation habit information.
  • the terminal 101 when the user actively sets the corresponding operation habit information for the current cell operation task to be performed, the terminal 101 can preferentially use the operation information actively set by the user. Habit information.
  • the terminal 101 can acquire the operation habit information obtained through statistical analysis.
  • the terminal 101 can actively prompt the user to actively set the operation habit information and automatically control the The cell manipulation robot 103 moves.
  • the terminal 101 can first control the movement of the cell manipulation robot 103 according to the system's default movement trajectory and angle, and continuously record the user's operation information, so that it can learn the user's operation habits after the operation information that can be statistically analyzed is formed. information to meet the needs of actual scenarios.
  • determining the movement trajectory and angle suitable for the cell operation task according to the operation habit information in step S903 specifically includes: determining the target position suitable for the cell operation task according to the operation habit information and angle; according to the current position and the target position of the pipette, a moving trajectory suitable for the cell manipulation task is obtained.
  • the operation habit information may specifically include at least one of the target position or angle under the cell operation task.
  • the target position and angle can be described in conjunction with the liquid extraction operation, liquid placement operation and cleaning operation.
  • the target position can correspond to the high-frequency liquid taking position, and the angle can correspond to the high-frequency liquid taking angle
  • the target position can correspond to the high-frequency liquid placement position, and the angle can correspond to the high-frequency liquid placement Angle
  • the target position may correspond to the high-frequency cleaning position, and the angle may correspond to the high-frequency cleaning angle.
  • the terminal 101 can obtain a movement trajectory suitable for the cell operation task currently to be performed.
  • the movement trajectory can be a straight line, broken line or at least one of curves and the like.
  • the terminal 101 can obtain a movement trajectory and an angle that are suitable for the cell operation task and conform to the user's operation habit.
  • a robot-based cell manipulation task processing device is provided.
  • the device 1000 is executed by a task execution terminal 100, including:
  • the simulated operation display module 1002 is used to display the simulated operation information from the task assistance terminal and aimed at the cell operation task;
  • An actual operation acquisition module 1003, configured to acquire actual operation information input on the cell operation interface of the task execution terminal;
  • the operation task execution module 1004 is used to control the robot to perform the cell operation task according to the actual operation information; the cell operation task can be stopped by the task assistance terminal.
  • the device 1000 further includes: a first information feedback unit, configured to send actual operation information to the task assistance terminal; receive feedback information from the task assistance terminal on the actual operation information; an operation task execution module 1004, for When the feedback information indicates that the actual operation information conforms to the operation specifications of the cell operation task, the robot is controlled to perform the cell operation task according to the actual operation information.
  • a first information feedback unit configured to send actual operation information to the task assistance terminal; receive feedback information from the task assistance terminal on the actual operation information
  • an operation task execution module 1004 for When the feedback information indicates that the actual operation information conforms to the operation specifications of the cell operation task, the robot is controlled to perform the cell operation task according to the actual operation information.
  • the simulated operation information includes a simulated operation demonstration animation; the simulated operation demonstration animation includes various demonstration animation fragments; each demonstration animation fragment corresponds to each operation link of the cell operation task; the simulated operation display module 1002 is used to The timing corresponding to each operation link of the operation task is to play each demonstration animation segment of the simulated operation demonstration animation; the playback transition duration of adjacent demonstration animation segments meets the preset playback transition duration threshold; the actual operation acquisition module 1003 is used to acquire Each actual operation information segment input on the operation interface; each actual operation information segment corresponds to the simulated operation demonstrated in each demonstration animation segment; the actual operation information is obtained by combining each actual operation information segment.
  • the device 1000 further includes: a second information feedback unit, configured to send the actual operation information to the task assistance terminal; receive feedback information from the task assistance terminal on each actual operation information segment in the actual operation information; If there is an abnormal actual operation information segment in each actual operation information segment, play the demonstration animation segment corresponding to the abnormal actual operation information segment, and obtain the corresponding actual operation information segment re-input on the cell operation interface; the abnormal actual operation information The segment is the actual operation information segment that does not conform to the operation specification of the cell operation task; after replacing the abnormal actual operation information segment in the actual operation information with the re-input actual operation information, send the replaced actual operation information to the task assistance terminal again .
  • a second information feedback unit configured to send the actual operation information to the task assistance terminal; receive feedback information from the task assistance terminal on each actual operation information segment in the actual operation information; If there is an abnormal actual operation information segment in each actual operation information segment, play the demonstration animation segment corresponding to the abnormal actual operation information segment, and obtain the corresponding actual operation information segment re-input on the cell operation interface;
  • the device 1000 further includes: a restriction input unit, configured to restrict the input on the cell operation interface when receiving the task stop execution information from the task assistance terminal during the robot's execution of the cell operation task; When it is detected that the robot arrives at a predetermined position under the control of the task assisting terminal, the restriction on the input of the cell operation interface is released.
  • a restriction input unit configured to restrict the input on the cell operation interface when receiving the task stop execution information from the task assistance terminal during the robot's execution of the cell operation task.
  • a robot-based cell manipulation task processing device is provided.
  • the device 1100 is executed by the task assistance terminal 200, including:
  • An assistance request receiving module 1101, configured to receive an assistance request for cell operation tasks sent by the task execution terminal;
  • An auxiliary interface display module 1102 configured to display an operation auxiliary interface for cell operation tasks according to the assistance request;
  • the simulated operation processing module 1103 is used to obtain simulated operation information input in the operation assistance interface, and send the simulated operation information to the task execution terminal for display by the task execution terminal;
  • the monitoring screen providing module 1104 is used to provide the monitoring screen; the monitoring screen is used for the monitoring task execution terminal to control the robot to perform the cell operation task according to the actual operation information; the actual operation information is input on the cell operation interface of the task execution terminal;
  • the stop instruction processing module 1105 is configured to control the robot to stop executing the cell operation task when receiving the stop execution instruction.
  • the simulated operation processing module 1103 is configured to obtain the simulated operation input on the operation assistance interface; the simulated operation corresponds to each operation link of the cell operation task; according to the simulated operation corresponding to each operation link of the cell operation task, Obtain each demonstration animation segment corresponding to each operation link respectively; according to the preset playback transition duration threshold and the timing corresponding to each operation link, combine each demonstration animation segment to obtain a simulated operation demonstration animation; adjacent demonstration animations in the simulated operation demonstration animation The playback transition duration of the clip meets the playback transition duration threshold; the simulation operation demonstration animation is used as the simulation operation information.
  • the apparatus 1100 may further include: a feedback processing unit, configured to receive actual operation information sent by the task execution terminal, obtain feedback information on the actual operation information, and send the feedback information to the task execution terminal.
  • a feedback processing unit configured to receive actual operation information sent by the task execution terminal, obtain feedback information on the actual operation information, and send the feedback information to the task execution terminal.
  • the stop command processing module 1105 is further configured to send task stop execution information to the task execution terminal, control the robot to move to a predetermined position, and send a restriction release instruction to the task execution terminal.
  • a robot-based cell manipulation task processing device is provided, and the device 1200 may include:
  • the area display module 1202 is used to display the area to be configured according to the user's selection of multiple optional layout modes; the area to be configured is the cell operation task execution area corresponding to the layout mode selected by the user;
  • a position determination module 1203, configured to determine a virtual position point selected by the user on the area to be configured
  • the operation acquisition module 1204 is used to acquire the user's operation information on the cell manipulation robot; the operation information is used to control the cell manipulation robot to move the suction tube from the origin to the actual position;
  • the information configuration module 1205 is used to configure the control information of the virtual location point according to the operation information when receiving the confirmation information from the user on the operation information; the control information is used to control the cell operation robot to suck the tube when the virtual location point is triggered. Move to actual location point.
  • the information configuration module 1205 is configured to obtain coordinate information of the actual location point relative to the origin according to the operation information; obtain control information according to the coordinate information.
  • the device 1200 further includes: a first control unit, configured to control the cell manipulation robot according to the coordinate information and control information of the current position point of the pipette relative to the origin in response to the user's trigger operation on the virtual position point Move the sipper tube from the current position point to the actual position point.
  • a first control unit configured to control the cell manipulation robot according to the coordinate information and control information of the current position point of the pipette relative to the origin in response to the user's trigger operation on the virtual position point Move the sipper tube from the current position point to the actual position point.
  • the area to be configured is composed of multiple job location blocks; the location determination module 1203 is used to provide block feature points of each job location block in the area to be configured as optional virtual location points; The selection information of the optional virtual location point determines the virtual location point selected by the user on the area to be configured.
  • the number of virtual location points is multiple; each virtual location point corresponds to a job location block; the device 1200 also includes: a second control unit, configured to respond to a user's trigger operation on a job location block , to enlarge and display one or more virtual position points corresponding to a working position block; in response to the user's trigger operation on one or more virtual position points that are enlarged and displayed, control the cell manipulation robot to move the pipette to the corresponding actual position point.
  • a second control unit configured to respond to a user's trigger operation on a job location block , to enlarge and display one or more virtual position points corresponding to a working position block; in response to the user's trigger operation on one or more virtual position points that are enlarged and displayed, control the cell manipulation robot to move the pipette to the corresponding actual position point.
  • the number of virtual location points is multiple; a working location block corresponds to a virtual location point; the device 1200 further includes: a third control unit, configured to respond to a user's trigger operation on a working location block, Control the cell manipulation robot to move the pipette to the corresponding actual position.
  • the cell operation task execution area is selected from the group consisting of a liquid extraction area, a liquid placement area and a cleaning area.
  • a robot-based cell manipulation task processing device is provided, and the device 1300 may include:
  • a task acquisition module 1301, configured to acquire the cell operation task that the user instructs the cell operation robot to perform;
  • Habit processing module 1303, configured to determine the moving trajectory and angle suitable for the cell manipulation task according to the manipulation habit information
  • the robot control module 1304 is used to control the cell manipulation robot to move the suction tube to the target position according to the movement trajectory, and is also used to control the cell manipulation robot to make the suction tube form an angle with the preset plane when reaching the target position.
  • the habit acquisition module 1302 is configured to acquire the operation information of the user on the cell operation task within a historical period; and obtain the operation habit information according to the statistics of the operation information.
  • the cell operation task includes a liquid extraction operation;
  • the operation information includes liquid extraction operation position information and liquid extraction operation angle information;
  • the liquid extraction operation position information is used to control the cell operation robot to move the pipette to the corresponding liquid extraction position;
  • the liquid-taking operation angle information is used to control the cell operation robot to form a corresponding angle with the preset plane when the pipetting tube is moved to the corresponding liquid-taking position;
  • the custom acquisition module 1302 is used to, according to the liquid-taking operation position information and the liquid-taking operation angle information, Determine the high-frequency liquid-taking position that satisfies the frequency condition of the liquid-taking operation position and the high-frequency liquid-taking angle that meets the frequency condition of the liquid-taking operation angle at the high-frequency liquid-taking position; according to the high-frequency liquid-taking position and the high-frequency liquid-taking angle, the operation Habit information.
  • the cell manipulation task includes a liquid placement operation;
  • the operation information includes liquid placement operation position information and liquid placement operation angle information;
  • the liquid placement operation position information is used to control the cell manipulation robot to move the suction tube to the corresponding liquid placement position;
  • the liquid placement operation angle information is used to control the cell operation robot to form a corresponding angle with the preset plane when the suction tube is moved to the corresponding liquid placement position;
  • the custom acquisition module 1302 is used to, according to the liquid placement operation position information and the liquid placement operation angle information, Determine the high-frequency liquid placement position that satisfies the frequency condition of liquid placement operation position and the high-frequency liquid placement angle that satisfies the frequency condition of liquid placement operation angle under the high-frequency liquid placement position; according to the high-frequency liquid placement position and high-frequency liquid placement angle, the operation Habit information.
  • the cell operation task includes cleaning operation;
  • the operation information includes cleaning operation position information and cleaning operation angle information;
  • the cleaning operation position information is used to control the cell operation robot to move the suction tube to the corresponding cleaning position;
  • the cleaning operation angle information is used to When controlling the cell operation robot to move the suction tube to the corresponding cleaning position, it forms a corresponding angle with the preset plane;
  • the habit acquisition module 1302 is used to determine the high frequency condition that meets the cleaning operation position frequency condition according to the cleaning operation position information and the cleaning operation angle information. The high-frequency cleaning position and the high-frequency cleaning angle satisfying the frequency condition of the cleaning operation angle under the high-frequency cleaning position; according to the high-frequency cleaning position and the high-frequency cleaning angle, the operation habit information is obtained.
  • the cell operation task is selected from the group consisting of liquid taking operation, liquid placing operation and cleaning operation;
  • the habit acquisition module 1302 is used to obtain the high-frequency liquid taking position and high-frequency The angle of taking liquid, according to the high-frequency liquid taking position and the high-frequency liquid taking angle, obtains the operation habit information; obtains the high-frequency liquid placement position and the high-frequency liquid placement angle set by the user for the liquid placement operation, and obtains the high-frequency liquid placement position according to the high-frequency liquid placement position and high-frequency liquid placement angle to obtain operating habit information; obtain the high-frequency cleaning position and high-frequency cleaning angle set by the user for the cleaning operation, and obtain operating habit information according to the high-frequency cleaning position and high-frequency cleaning angle.
  • the habit processing module 1303 is configured to determine the target position and angle suitable for the cell manipulation task according to the manipulation habit information; and obtain the movement track suitable for the cell manipulation task according to the current position and target position of the pipette.
  • Each module in the robot-based cell manipulation task processing device can be fully or partially realized by software, hardware and a combination thereof.
  • the above-mentioned modules can be embedded in or independent of one or more processors in the computer device in the form of hardware, and can also be stored in one or more memories in the computer device in the form of software, so that the one or more processors can Call to execute the operations corresponding to the above modules.
  • a computer device is provided.
  • the computer device may be a terminal, and its internal structure may be as shown in FIG. 14 .
  • the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Wherein, the processor of the computer device is used to provide calculation and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system and computer readable instructions.
  • the internal memory provides an environment for the execution of the operating system and computer readable instructions in the non-volatile storage medium.
  • the communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be realized through WIFI, an operator network, NFC (Near Field Communication) or other technologies.
  • the computer readable instructions when executed by the processor, implement a robot-based cell manipulation task processing method.
  • the display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covered on the display screen, or a button, a trackball or a touch pad provided on the casing of the computer device , and can also be an external keyboard, touchpad, or mouse.
  • Figure 14 is only a block diagram of a partial structure related to the solution of this application, and does not constitute a limitation on the computer equipment on which the solution of this application is applied.
  • the specific computer equipment can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.
  • a computer device including one or more processors and a memory, where computer-readable instructions are stored in the memory, and when one or more processors execute the computer-readable instructions, the implementation of the above-mentioned methods is implemented. steps in the example.
  • one or more computer-readable storage media are provided, on which computer-readable instructions are stored, and when the computer-readable instructions are executed by one or more processors, the steps in the foregoing method embodiments are implemented.
  • Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory or optical memory, etc.
  • Volatile memory can include Random Access Memory (RAM) or external cache memory.
  • RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)

Abstract

本申请提供了一种基于机器人的细胞操作任务处理方法、装置、设备及介质,该方法包括:向任务协助终端发送针对细胞操作任务的协助请求(步骤201),显示来自任务协助终端的,且针对细胞操作任务的模拟操作信息(步骤202),获取在任务执行终端的细胞操作界面输入的实际操作信息(步骤203),根据该实际操作信息控制机器人执行前述细胞操作任务(步骤204),该细胞操作任务可被任务协助终端停止执行。

Description

基于机器人的细胞操作任务处理方法、装置、设备及介质
本申请要求于2021年09月06日提交中国专利局,申请号为2021110405555、发明名称为“基于机器人的细胞操作任务处理方法、装置、设备和介质”,申请号为2021110392930、发明名称为“细胞操作机器人的控制信息配置方法、装置、设备和介质”以及申请号为2021110405625、发明名称为“细胞操作机器人的控制方法、装置、设备和存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及生物技术领域,特别是涉及一种基于机器人的细胞操作任务处理方法、装置、设备及介质。
背景技术
随着计算机技术以及控制技术的发展,相关用户可借助计算机设备在机器人的协助下执行如细胞抓取、放置和清洗等细胞操作任务。具体地,用户将计算机设备连接至机器人,利用人机交互软件即可在计算机设备上控制机器人执行相应的细胞操作任务。
目前的细胞操作任务处理技术,需要依赖于操作员根据不同的各种细胞操作任务自行在计算机设备上对机器人进行控制,但细胞操作任务种类繁多且步骤繁琐,使得这种技术难以确保各种细胞操作任务得到准确执行。
发明内容
根据本申请提供的各种实施例,提供一种基于机器人的细胞操作任务处理方法、装置、计算机设备、计算机可读存储介质和计算机程序产品。
本申请实施例一方面提供了一种基于机器人的细胞操作任务处理方法,该方法由任务执行终端执行,包括:
向任务协助终端发送针对细胞操作任务的协助请求;
显示来自任务协助终端的,且针对细胞操作任务的模拟操作信息;
获取在任务执行终端的细胞操作界面输入的实际操作信息;
根据实际操作信息控制机器人执行细胞操作任务;细胞操作任务可被任务协助终端停止执行。
本申请实施例一方面提供了一种基于机器人的细胞操作任务处理方法,该方法由任务协助终端执行,包括:
接收任务执行终端发送的针对细胞操作任务的协助请求;
根据协助请求,显示针对细胞操作任务的操作辅助界面;
获取在操作辅助界面输入的模拟操作信息;
将模拟操作信息发送至任务执行终端,以供任务执行终端进行展示;
提供监控画面;监控画面用于监控任务执行终端根据实际操作信息,控制机器人执行细胞操作任务;实际操作信息是在任务执行终端的细胞操作界面输入的;
当接收到停止执行指令时,控制机器人停止执行细胞操作任务。
本申请实施例一方面提供了一种基于机器人的细胞操作任务处理方法,该方法由终端执行,包括:
提供细胞操作任务执行区域的多种可选布局方式;
根据用户对多种可选布局方式的选择,展示待配置区域;待配置区域为与用户所选布局方式相对应的细胞操作任务执行区域;
确定待配置区域上被用户选择的虚拟位置点;
获取用户对细胞操作机器人的操作信息;操作信息,用于控制细胞操作机器人将吸取管从原点运动到实际位置点;
当接收到用户对操作信息的确认信息时,根据操作信息配置虚拟位置点的控制信息;控制信息,用于当虚拟位置点被触发时,控制细胞操作机器人将吸取管移动至实际位置点。
本申请实施例一方面提供了一种基于机器人的细胞操作任务处理方法,该方法由终端执行,包括:
获取用户指示细胞操作机器人执行的细胞操作任务;
获取用户在细胞操作任务下的操作习惯信息;
根据操作习惯信息,确定适用于细胞操作任务的移动轨迹和角度;
控制细胞操作机器人按照移动轨迹将吸取管移动至目标位置;
控制细胞操作机器人使吸取管到达目标位置时,与预设平面形成角度。
本申请实施例一方面提供了一种基于机器人的细胞操作任务处理装置,包括:
协助请求发送模块,用于向任务协助终端发送针对细胞操作任务的协助请求;
模拟操作显示模块,用于显示来自任务协助终端的,且针对细胞操作任务的模拟操作信息;
实际操作获取模块,用于获取在任务执行终端的细胞操作界面输入的实际操作信息;
操作任务执行模块,用于根据实际操作信息控制机器人执行细胞操作任务;细胞操作任务可被任务协助终端停止执行。
本申请实施例一方面提供了一种基于机器人的细胞操作任务处理装置,包括:
协助请求接收模块,用于接收任务执行终端发送的针对细胞操作任务的协助请求;
辅助界面显示模块,用于根据协助请求,显示针对细胞操作任务的操作辅助界面;
模拟操作处理模块,用于获取在操作辅助界面输入的模拟操作信息,将模拟操作信息发送至任务执行终端,以供任务执行终端进行展示;
监控画面提供模块,用于提供监控画面;监控画面用于监控任务执行终端根据实际操作信息,控制机器人执行细胞操作任务;实际操作信息是在任务执行终端的细胞操作界面输入的;
停止指令处理模块,用于当接收到停止执行指令时,控制机器人停止执行细胞操作任务。
本申请实施例一方面提供了一种基于机器人的细胞操作任务处理装置,包括:
方式提供模块,用于提供细胞操作任务执行区域的多种可选布局方式;
区域展示模块,用于根据用户对多种可选布局方式的选择,展示待配置区域;待配置区域为与用户所选布局方式相对应的细胞操作任务执行区域;
位置确定模块,用于确定待配置区域上被用户选择的虚拟位置点;
操作获取模块,用于获取用户对细胞操作机器人的操作信息;操作信息,用于控制细胞操作机器人将吸取管从原点运动到实际位置点;
信息配置模块,用于当接收到用户对操作信息的确认信息时,根据操作信息配置虚拟位置点的控制信息;控制信息,用于当虚拟位置点被触发时,控制细胞操作机器人将吸取管移动至实际位置点。
本申请实施例一方面提供了一种基于机器人的细胞操作任务处理装置,包括:
任务获取模块,用于获取用户指示细胞操作机器人执行的细胞操作任务;
习惯获取模块,用于获取用户在细胞操作任务下的操作习惯信息;
习惯处理模块,用于根据操作习惯信息,确定适用于细胞操作任务的移动轨迹和角度;
机器人控制模块,用于控制细胞操作机器人按照移动轨迹将吸取管移动至目标位置;
机器人控制模块,还用于控制细胞操作机器人使吸取管到达目标位置时,与预设平面形成角度。
本申请实施例一方面提供了一种计算机设备,包括一个或多个处理器及存储器,存储器存储有计算机可读指令,一个或多个处理器执行计算机可读指令时,实现本申请各实施例方法中的步骤。
本申请实施例一方面提供了一个或多个计算机可读存储介质,其上存储有计算机可读指令,计算机可读指令被一个或多个处理器执行时,实现本申请各实施例方法中的步骤。
本申请实施例一方面提供了一种计算机程序产品,该计算机程序产品包括计算机可读指令,计算机可读指令被一个或多个处理器执行时,实现本申请各实施例方法中的步骤。
本申请的一个或多个实施例的细节在下面的附图和描述中提出。本申请的其他特征、目的和优点将从说明书、附图以及权利要求书变得明显。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为一个实施例中基于机器人的细胞操作任务处理方法的应用场景图;
图2为一个实施例中基于机器人的细胞操作任务处理方法的流程示意图;
图3为一个实施例中实际操作信息段反馈处理的步骤的流程示意图;
图4为另一个实施例中基于机器人的细胞操作任务处理方法的流程示意图;
图5为一个实施例中获取模拟操作信息的步骤的流程示意图;
图6为另一个实施例中基于机器人的细胞操作任务处理方法的应用环境图;
图7为另一个实施例中基于机器人的细胞操作任务处理方法的流程示意图;
图8为一个实施例中待配置区域的示意图;
图9为另一个实施例中基于机器人的细胞操作任务处理方法的流程示意图;
图10为一个实施例中基于机器人的细胞操作任务处理装置的结构框图;
图11为另一个实施例中基于机器人的细胞操作任务处理装置的结构框图;
图12为另一个实施例中基于机器人的细胞操作任务处理装置的结构框图;
图13为另一个实施例中基于机器人的细胞操作任务处理装置的结构框图;
图14为一个实施例中计算机设备的内部结构图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请提供的基于机器人的细胞操作任务处理方法,可以应用于如图1所示的应用场景中,该应用场景可以包括机器人、任务执行终端100和任务协助终端200。其中,机器人可以采用六轴机器人,该机器人可以分别与任务执行终端100和任务协助终端200通信连接,并在任务执行终端100和任务协助终端200的控制下执行细胞操作任务,细胞操作任务可以包括但不限于是细胞抓取、放置、清洗等操作任务。任务执行终端100和任务协助终端200可以包括但不限于是各种个人计算机、笔记本电脑、智能手机、平板电脑和便携式可穿戴设备。
具体应用中,任务执行终端100的使用者可称为操作员10,任务协助终端200的使用者可称为协助员20,操作员10可在实验室中使用任务执行终端100控制机器人执行细胞操作任务,操作员10遇到需要协助的细胞操作任务时,任务执行终端100可向任务协助终端200发送针对该细胞操作任务的协助请求。协助员20通常在实验室外使用任务协助终端200,相对任务执行终端100而言,该任务协助终端200也可称为远程协助终端。即本申请中,本地的任务执行终端100可向远程的任务协助终端200请求协助处理某项或某些细胞操作任务。
以下部分将基于如图1所示的应用场景,结合相应实施例和附图对本申请提供的基于机器人的细胞操作任务处理方法进行说明。
在一个实施例中,如图2所示,提供了一种机器人的细胞操作任务处理方法,以该方法应用于图1中的任务执行终端100为例进行说明,包括以下步骤:
步骤S201,向任务协助终端发送针对细胞操作任务的协助请求。
其中,操作员10遇到需要协助的细胞操作任务时,可在任务协助终端110上向协助员20请求协助,该协助员20通常由在该细胞操作任务的操作上,比操作员10的操作经验更丰富的用户担任。
具体地,操作员10可通过任务协助终端110,向该协助员20的任务协助终端200发送针对细胞操作任务的协助请求,该协助请求中可以包含所需协助的细胞操作任务的具体内容,例如需要在何处抓取何种细胞、需要将何种细胞放置到何处等。
步骤S202,显示来自任务协助终端的,且针对细胞操作任务的模拟操作信息。
其中,对于任务协助终端200来说,在接收到任务协助请求后,可由协助员20在任务协助终端200上提供针对所需协助的细胞操作任务的模拟操作信息。该模拟操作信息是协助员20在任务协助终端200上输入的为执行细胞操作任务而需要操作员10在任务执行终端100上输入的操作信息,但因该操作信息并非实际用于控制机器人的操作信息,故将其称为模拟操作信息。
具体地,该模拟操作信息具体可以是在任务执行终端100的细胞操作界面上按照一定的顺序点击若干个控件等。在具体应用中,在任务执行终端100的细胞操作界面上按照一定的顺序点击若干个控件, 可以控制机器人按照一定顺序执行相应动作,如控制机器人移动到某处后放置细胞,然后移动到另一处等。
具体地,任务协助终端200获得协助员20提供的模拟操作信息后,可反馈至任务执行终端100;任务执行终端100接收到模拟操作信息后,可提供一个模拟操作信息显示窗口,该模拟操纵信息显示窗口用于显示该模拟操作信息,以供操作员10查看、学习并模仿。
步骤S203,获取在任务执行终端的细胞操作界面输入的实际操作信息。
其中,任务执行终端100还提供细胞操作界面,该细胞操作界面用于辅助操作员10控制机器人,操作员10可在细胞操作界面输入实际操作信息。对于模拟操作信息而言,该实际操作信息是实际用于控制机器人执行相应操作的信息。
具体地,操作员10可在查看和学习模拟操作信息后,在任务执行终端100提供的细胞操作界面上,模仿该模拟操作信息以输入相应的实际操作信息,从而使任务执行终端100获取该实际操作信息。
步骤S204,根据实际操作信息,控制机器人执行细胞操作任务。
在一些实施例中,任务执行终端100在获得实际操作信息后,可直接根据实际操作信息直接控制机器人执行细胞操作任务,也可以根据实际操作信息有条件控制机器人执行细胞操作任务。其中,直接控制机器人执行细胞操作任务指的是任务执行终端100在获得实际操作信息后,可直接根据该实际操作信息控制机器人执行细胞操作任务;有条件控制机器人执行细胞操作任务是指在根据实际操作信息控制机器人执行细胞操作任务前,还需满足一定条件,该条件可以是需要得到任务协助终端200的确认,也可以是需要由任务执行终端100自行检测机器人是否处于可控模式等。但直接控制执行或有条件控制执行均需在协助员20的监督下进行。
具体地,任务协助终端200可通过部署于机器人所在位置的监控摄像头获取机器人执行细胞操作任务时的监控画面并展示,以供协助员20依据该监控画面判断该任务的执行过程是否出现异常而需停止机器人执行该任务,即该细胞操作任务可被任务协助终端200随时停止执行。任务协助终端200可提供触发停止执行指令的入口,以供协助员20依据监控画面判断出现异常时,通过点击该入口向任务协助终端200发送停止执行指令,任务协助终端200当检测到停止执行指令时,可直接控制机器人停止执行细胞操作任务。
在其中一些实施例中,步骤S204之前,任务执行终端100还可以将该实际操作信息发送至任务协助终端200,然后接收任务协助终端200对该实际操作信息的反馈信息。
本实施例公开的是其中一种有条件控制执行的方案,任务执行终端100在获得操作员10输入的实际操作信息后,需要先发送到任务协助终端200,任务协助终端200将其进行展示以供协助员20可对其是否符合操作规范进行核查并向任务协助终端200输入对该实际操作信息的反馈信息。
在一些实施例中,步骤S204可包括:在该反馈信息表征实际操作信息符合细胞操作任务的操作规范的情况下,任务执行终端100根据实际操作信息控制机器人执行细胞操作任务。
具体地,当反馈信息表征实际操作信息符合细胞操作任务的操作规范时,则说明实际操作信息得到协助员20的确认,任务执行终端100可进一步根据实际操作信息控制机器人执行细胞操作任务,以确保细胞操作任务得到准确执行。这样能够有效避免由于操作员10未准确模仿模拟操作信息等原因,而错误控制机器人所导致细胞操作任务执行失败的问题。但是,在反馈信息表征实际操作信息不符合细胞操作任务的操作规范的情况下,任务执行终端100可提示操作员10根据模拟操作信息重新输入实际操作信息,并再次发送至任务协助终端200以供协助员20进行判断,直至符合细胞操作任务的操作规范。
上述基于机器人的细胞操作任务处理方法,任务执行终端100向任务协助终端200发送针对细胞操作任务的协助请求,任务执行终端100显示来自任务协助终端200的针对细胞操作任务的模拟操作信息,任务执行终端100获取在细胞操作界面输入的实际操作信息,根据该实际操作信息控制机器人执行前述细胞操作任务,且该细胞操作任务可被任务协助终端200停止执行。该方法能够由任务执行终端100请求任务协助终端200协助执行细胞操作任务,获得操作员在任务协助终端200提供的模拟操作信息的协助下输入的实际操作信息并据此控制机器人执行细胞操作任务,且该细胞操作任务的执行可随时被任务协助终端200所停止,以避免细胞操作任务执行过程中可能存在的执行出错等问题,确保任务执行终端100的细胞操作任务可在任务协助终端200的协助下,能够准确且可靠的执行。
在一些实施例中,步骤S202中的模拟操作信息可以包括模拟操作演示动画,该模拟操作演示动画可以包括与前述细胞操作任务的各操作环节相对应的各演示动画片段。
在一些实施例中,步骤S202可以包括:按照细胞操作任务的各操作环节对应的时序,播放模拟操作演示动画的各演示动画片段。
本实施例中,模拟操作信息可以通过模拟操作演示动画的方式提供给操作员10,且该模拟操作演示动画可由与细胞操作任务的各操作环节相对应的各演示动画片段组合而成。这样可以将一个复杂的细胞操作任务依序划分成多个操作环节,每个操作环节对应一个演示动画片段,从而有利于帮助操作员10通过观看每个片段形成实际操作信息,从而确保细胞操作任务能够准确且可靠地执行。
具体地,任务执行终端100在接收到模拟操作演示动画之后,可以展示该模拟操作演示动画,以使模拟操作演示动画中各演示动画片段依各操作环节对应的时序播放。其中,相邻演示动画片段具有播放过渡时长,即播放完前一演示动画片段后间隔该播放过渡时长后再播放下一演示动画片段,且该播放过渡时长需满足预设的播放过渡时长阈值,该播放过渡时长阈值可由协助员20根据各操作环节各自的操作难度和所需操作时长等因素对应设定。任务执行终端100对前一演示动画片段播放完毕后,播放过渡时长需至少达到该播放过渡时长阈值,任务执行终端100才播放下一演示动画片段,从而依序将模拟操作演示动画中的演示动画片段播放完毕。
在一些实施例中,步骤S203具体包括:获取在细胞操作界面输入的各实际操作信息段,将各实际操作信息段组合得到实际操作信息。
本实施例中,操作员10可在任务执行终端100播放各演示动画片段过程中在细胞操作界面同步输入与相应演示动画片段中演示的模拟操作对应的实际操作信息,操作员10对应各演示动画片段中演示的模拟操作所同步输入的实际操作信息称为实际操作信息段,从而各实际操作信息段分别对应于各演示动画片段中演示的模拟操作。
在具体应用中,操作员10可在各演示动画片段对应的播放过渡时长内在细胞操作界面输入相应的实际操作信息段,任务执行终端100将接收的各实际操作信息段组合为实际操作信息。本实施例为操作员10提供依次输入与各操作环节对应的实际操作信息段的方式获取得到实际操作信息,避免引发因细胞操作任务过于复杂而操作员10难以一次性输入准确的实际操作信息导致任务执行失败的问题。
在一些实施例中,如图3所示,在步骤S204之前,上述方法还可以包括以下步骤:
步骤S301,将实际操作信息发送至任务协助终端。
具体地,任务执行终端100将各实际操作信息段组合成的实际操作信息发送至任务协助终端200,以供协助员20判断实际操作信息否符合操作规范。
步骤S302,接收任务协助终端对实际操作信息中,各实际操作信息段的反馈信息。
具体地,任务执行终端100将实际操作信息发送至任务协助终端200后,任务协助终端200可依序展示每一实际操作信息段,各实际操作信息段具体可以是在任务执行终端100的细胞操作界面上按照一定的顺序点击若干个控件等,以供协助员20对任务协助终端200所展示的每一实际操作信息段进行是否符合操作规范的判断后,在任务协助终端200输入对各实际操作信息段的反馈信息,任务协助终端200将反馈信息发送至任务执行终端100。
步骤S303,在反馈信息表征各实际操作信息段中存在异常实际操作信息段的情况下,播放异常实际操作信息段对应的演示动画片段,并获取在细胞操作界面重新输入的对应的实际操作信息段。
其中,异常实际操作信息段为各实际操作信息段中被协助员20在任务协助终端200标记为不符合细胞操作任务的操作规范的实际操作信息段。当任务协助终端200的反馈信息表征各实际操作信息段中存在异常实际操作信息段时,任务执行终端100播放该异常实际操作信息段对应的演示动画片段,同时任务执行终端100可以提示操作员10在细胞操作界面重新输入与之对应的实际操作信息段,任务执行终端100获取操作员10在细胞操作界面重新输入的对应的实际操作信息段。
步骤S304,将实际操作信息中的异常实际操作信息段替换为重新输入的实际操作信息后,再次将替换后的实际操作信息发送至任务协助终端。
其中,替换后的实际操作信息指的是,将原本的实际操作信息中的异常实际操作信息替换为重新输入的实际操作信息之后,所得到的实际操作信息。
具体地,任务执行终端100将实际操作信息中的异常实际操作信息段,替换为操作员10在细胞操作界面重新输入的对应的实际操作信息段。然后,任务执行终端100将替换后的实际操作信息段再次发送至任务协助终端200,供协助员20进行是否符合操作规范的判断。在仍存在异常实际操作信息段的情况下,则需操作员10在任务执行终端100的细胞操作界面重新输入实际操作信息,并将实际操作信息提交至任务协助终端200,直至任务协助终端200返回的反馈信息表征所提交的实际操作信息中,各实际操作信息段均符合操作规范。
在一些实施例中,本实施例的方案能够以多段组合的方式形成实际操作信息,并提供给任务协助终端200的协助员20分段审核,使操作员10只需重新输入不符合规范的实际操作信息段而无需重新输入全部实际操作信息,减少操作员10再次操作出错的可能,在确保实际操作信息准确可靠的同时,还能提高操作信息的形成效率。
在一个实施例中,上述方法还可以包括如下步骤:机器人执行细胞操作任务过程中,若任务执行终端100接收到来自任务协助终端200的任务停止执行信息,则任务执行终端100限制在细胞操作界面的输入;任务执行终端100检测到机器人在任务协助终端200的控制下到达预定位置时,任务执行终端100解除对细胞操作界面的输入的限制。
具体地,在机器人执行细胞操作任务过程中,协助员20可在任务协助终端200对任务执行过程进行监控,一旦发现机器人在任务执行过程出现异常,如执行了错误的动作等,协助员20可通过任务协助终端200向任务执行终端100发送任务停止执行信息以及控制机器人停止执行细胞操作任务。任务执行终端100接收到该任务停止执行信息后,可限制操作员10在细胞操作界面的输入,即任务执行终端100可暂时不允许操作员10在细胞操作界面输入对机器人的操作信息,以防止机器人可能在操作员10的操作下执行更多错误动作。机器人由任务协助终端200直接控制,任务协助终端200可控制该机器人从当前位置移动到达预定位置,该预定位置可以是预先设定的该机器人的初始安全位置,或者称为机器人的零点位置。当机器人到达预定位置后,任务协助终端200可向任务执行终端100发送解除指令,任务执行终端100接收到来自任务执行终端100的解除指令后即确认机器人已在任务协助终端200的控制下到达预定位置,任务执行终端100随即解除对细胞操作界面的输入的限制,操作员10可重新在细胞操作界面输入相应的操作信息控制机器人,由此提高细胞操作任务执行的可靠性。
在一个实施例中,还提供一种基于机器人的细胞操作任务处理方法,如图4所示,以该方法应用于图1中的任务协助终端200为例进行说明,包括以下步骤:
步骤S401,接收任务执行终端发送的针对细胞操作任务的协助请求。
具体地,任务协助终端200可接收操作员10在任务执行终端100发起的针对细胞操作任务的协助请求。
步骤S402,根据协助请求,显示针对细胞操作任务的操作辅助界面。
具体地,任务协助终端200根据任务执行终端100发送的协助请求,显示针对细胞操作任务的操作辅助界面,该操作辅助界面用于协助员20输入模拟操作信息。该操作辅助界面可以与任务执行终端100的细胞操作界面相同,由此协助员20在该操作辅助界面输入的模拟操作信息可便于操作员10在任务执行终端100的细胞操作界面模仿输入相应的实际操作信息。
步骤S403,获取在操作辅助界面输入的模拟操作信息,将模拟操作信息发送至任务执行终端,以供任务执行终端进行展示。
具体地,任务协助终端200提供操作辅助界面后,协助员20可根据需要协助的细胞操作任务,在操作辅助界面中输入模拟操作信息,任务协助终端200获取该模拟操作信息,在协助员20确认模拟操作信息输入完毕后,任务协助终端200将模拟操作信息发送至任务执行终端100,任务执行终端100接收到模拟操作信息后可将其进行展示以供操作员10观看、学习和模仿。
步骤S404,提供用于监控任务执行终端根据实际操作信息控制机器人执行细胞操作任务的监控画面。
在具体场景中,任务执行终端100接收并显示模拟操作信息,以及为操作员10提供细胞操作界面,任务执行终端100接收操作员10在细胞操作界面输入的实际操作信息,并根据实际操作信息控制机器人执行细胞操作任务。任务协助终端200为协助员20提供用于监控任务执行终端100根据实际操作信 息控制机器人执行细胞操作任务的监控画面,以供协助员20依据该监控画面判断该任务的执行过程是否出现异常而需停止机器人执行该任务,该监控画面可由任务协助终端200通过部署于机器人所在位置的监控摄像头获取得到。
步骤S405,当任务协助终端200接收到停止执行指令时,控制机器人停止执行细胞操作任务。
在具体应用中,任务协助终端200可提供触发停止执行指令的入口,协助员20依据监控画面判断出现异常时,可点击该入口向任务协助终端200发送停止执行指令,任务协助终端200接收到该停止执行指令后,可直接控制机器人停止执行前述细胞操作任务。
上述基于机器人的细胞操作任务处理方法,任务协助终端200可接收任务执行终端100发送的针对细胞操作任务的协助请求,根据协助请求显示针对细胞操作任务的操作辅助界面,并获取协助员20在操作辅助界面输入的模拟操作信息,然后将该模拟操作信息发送至任务执行终端100以供其进行展示,任务协助终端200还提供用于监控任务执行终端100根据操作员10在细胞操作界面输入的实际操作信息控制机器人执行细胞操作任务的监控画面,当任务协助终端200接收到停止执行指令时,可直接控制机器人停止执行前述细胞操作任务。该方法能够避免细胞操作任务执行过程中可能存在的执行出错等问题,确保任务执行终端100的细胞操作任务可在任务协助终端200的协助下得到准确且可靠的执行。
在一个实施例中,如图5所示,步骤S403中的获取在操作辅助界面输入的模拟操作信息,具体可以包括:
步骤S501,获取在操作辅助界面输入的模拟操作。
其中,模拟操作对应于细胞操作任务的各操作环节。
具体地,协助员20可在任务协助终端200提供的操作辅助界面上,输入对应于细胞操作任务的各操作环节的模拟操作,任务协助终端200获取这些模拟操作。
步骤S502,根据对应于细胞操作任务的各操作环节的模拟操作,分别获取与各操作环节对应的各演示动画片段。
具体地,任务协助终端200根据协助员20在操作辅助界面上输入的对应于细胞操作任务的各操作环节的模拟操作,生成与之对应的各演示动画片段,每一演示动画片段对应于每一操作环节。
步骤S503,根据预设的播放过渡时长阈值和各操作环节对应的时序,将各演示动画片段组合得到模拟操作演示动画;
具体地,任务协助终端200获得各演示动画片段后,可进一步获取协助员20依据各操作环节对应的操作难度、操作时间等因素设定的播放过渡时长阈值,然后任务协助终端200根据该播放过渡时长阈值和各操作环节在细胞操作任务当中对应的时序,将各演示动画片段组合成模拟操作演示动画。其中,该模拟操作演示动画中相邻演示动画片段的播放过渡时长满足前述播放过渡时长阈值。
步骤S504,将模拟操作演示动画作为模拟操作信息。
本实施例提供的方案,任务协助终端200可将模拟操作演示动画作为模拟操作信息发送至任务执行终端100进行展示,以供操作员10通过观看模拟操作演示动画中每个片段对应的操作并在任务执行终端100形成实际操作信息以确保细胞操作任务得到准确且可靠地执行。
在一些实施例中,还提供了基于机器人的细胞操作任务处理方法,可以应用于如图6所示的应用环境中,该应用场景中可以包括:终端101、减震平台102、细胞操作机器人103、微调机构104、微调器105、自动归位装置106、吸取泵107、吸取管108、吸取针头109、显微镜110、显微镜镜头111、容器盒112和小料盒113。具体地,终端101可与细胞操作机器人103通信连接以控制细胞操作机器人103。
其中,终端101可以但不限于是各种个人计算机、笔记本电脑、智能手机、平板电脑和便携式可穿戴设备。细胞操作机器人103可以采用六轴机器人;自动归位装置106可与终端101通信连接,并且可以在终端101的指令下使细胞操作机器人103自动归位;微调机构104,微调机构104也称吸取管微调机构,微调机构104可安装于细胞操作机器人103末端法兰盘上;细胞吸取机构总体上可以包括吸取泵107、吸取管108和吸取针头109,吸取管108和吸取针头109可安装于微调机构104上;显微镜110上显微镜镜头111下方中心位置可放置容器盒112,容器盒112内可放置细胞液;微调器105可包括三个微调手轮,可分别用于控制微调机构104在X轴、Y轴和Z轴运动;小料盒113可以采用96孔、60孔等规格。在具体应用中,小料盒113可通过料盒固定架支撑设于减震平台102上。
下面以图6所示应用场景为基础,结合相应实施例对本申请提供的基于机器人的细胞操作任务处理方法进行说明。
在一个实施例中,如图7所示,提供了一种基于机器人的细胞操作任务处理方法,以该方法应用于图6中的终端101为例进行说明,包括以下步骤:
步骤S701,提供细胞操作任务执行区域的多种可选布局方式。
具体地,终端101为用户展示针对细胞操作任务执行区域的多种可选布局方式。其中,各种的细胞操作任务执行区域包括取液区域、置液区域或清洗区域等中的至少一种,不同的细胞操作任务执行区域的布局方式一般是不同的,相同的细胞操作任务执行区域的布局方式也可以是不同的。
在一些实施例中,对于取液区域和置液区域,取液区域一般采用圆形布局方式,以对应容器盒112的形状,置液区域可采用矩形布局方式,以对应小料盒113的形状等。对于置液区域,可采用不同的矩形布局方式,以分别对应96孔、60孔等规格的小料盒113的形状等。终端101可针对细胞操作任务执行区域提供相应的多种可选布局方式,以便用户可快速选取到符合其需求的布局方式。
步骤S702,根据用户对多种可选布局方式的选择,展示待配置区域。
具体地,用户可对多种可选布局方式进行选择,例如选取其中一种布局方式,该种被用户选择的布局方式称为用户所选布局方式,终端101可根据用户对多种可选布局方式的选择,确定所提供的多种可选布局方式中的用户所选布局方式,从而获取与该用户所选布局方式相对应的细胞操作任务执行区域作为待配置区域,然后展示该待配置区域。
步骤S703,确定待配置区域上被用户选择的虚拟位置点。
具体地,如图8所示,待配置区域800由终端101为用户展示,用户可在终端101所展示的待配置区域800上选择任意一个或者多个虚拟位置点,例如选择虚拟位置点P0,其中,虚拟位置点并非真实空间中的点,而是显示在终端101的待配置区域800上的点。
步骤S704,获取用户对细胞操作机器人的操作信息。
具体地,用户可以在选择好虚拟位置点P0后,控制细胞操作机器人103将吸取管108从原点(或称为零点)运动到实际位置点,终端101可以获取并记录该用于控制细胞操作机器人103将吸取管108从原点运动到实际位置点的操作信息。其中,实际位置点是真实空间中的点,即用户此时控制细胞操作机器人103将吸取管108从原点运动到真实空间中的位置点。
步骤S705,接收到用户对操作信息的确认信息时,根据操作信息配置虚拟位置点的控制信息。
具体地,当终端101获取到操作信息后,可提示用户是否确认该操作信息无误,例如提示用户是否已经控制细胞操作机器人103将吸取管108从原点运动到其所需移动到的位置点。若是,则终端101可接收该用户发出的对操作信息的确认信息;若否,则终端101可控制细胞操作机器人103将吸取管108回归原点,提示用户重新操作细胞操作机器人103直至其确认操作信息无误。得到确认信息后,终端101可根据操作信息配置虚拟位置点的控制信息,该控制信息可用于虚拟位置点被触发时控制细胞操作机器人103将吸取管108移动至对应的实际位置点。
在一些实施例中,步骤S705中的根据操作信息配置虚拟位置点的控制信息,可以包括:根据操作信息,获取实际位置点相对于原点的坐标信息;根据坐标信息,得到控制信息。
具体地,终端101可根据用户确认的操作信息,获取实际位置点相对于原点的坐标信息,假设原点的坐标是(0,0,0),则终端101根据用户确认的操作信息可计算实际位置点相对于原点的坐标,例如(x,y,z),由此终端101可根据该坐标信息得到虚拟位置点的控制信息,该控制信息可作为控制细胞操作机器人103将吸取管108移动至该实际位置点的空间位置依据。
在一些实施例中,在执行步骤S705中的根据操作信息配置虚拟位置点的控制信息之后,还可以包括如下步骤:响应于用户对前述虚拟位置点的触发操作,根据吸取管当前位置点相对于原点的坐标信息以及前述控制信息,控制细胞操作机器人将吸取管从当前位置点移动至实际位置点。
本实施例中,如图8所示,在用户配置好虚拟位置点P0的控制信息后,用户可在终端101上通过点击等方式向终端101发送对该虚拟位置点P0的触发操作,终端101响应于该触发操作,可获取吸取管108当前所在位置点相对于原点的坐标信息(x0,y0,z0),从而根据该坐标信息(x0,y0,z0),以及已配置好的虚拟位置点P0的控制信息中的实际位置点相对于原点的坐标信息(x,y,z),控制细胞操作机器人 103将吸取管108从当前位置点移动至实际位置点,以使由用户自主配置的虚拟位置点与实际位置点的移动控制关系得到有效应用,实现了在细胞操作任务执行区域布局多变的实际场景下对细胞操作机器人进行灵活控制。
上述基于机器人的细胞操作任务处理方法,主要用于配置细胞操作机器人的控制信息,终端101提供细胞操作任务执行区域的多种可选布局方式,根据用户对该多种可选布局方式的选择,展示待配置区域;该待配置区域为与用户所选布局方式相对应的细胞操作任务执行区域;然后终端101确定该待配置区域上被用户选择的虚拟位置点,获取该用户对细胞操作机器人103的操作信息;该操作信息,用于控制细胞操作机器人103将吸取管108从原点运动到实际位置点;在接收到用户对前述操作信息的确认信息时,终端101根据该操作信息配置前述虚拟位置点的控制信息;该控制信息可用于虚拟位置点被触发时终端101控制细胞操作机器人103将吸取管108移动至实际位置点。本申请能够针对细胞操作任务执行区域为用户提供多种可选的布局方式,在选定布局方式后进一步为用户提供在该种布局方式下可根据实际场景需求来建立虚拟位置点与实际位置点的移动控制关系的功能,该虚拟位置点与实际位置点的移动控制关系建立后,用户便可通过触发虚拟位置点控制细胞操作机器人将吸取管移动至实际位置点,从而提高对细胞操作机器人进行控制的灵活性,能够满足在细胞操作任务执行区域布局多变的实际场景下用户对细胞操作机器人进行灵活控制的需求。其中,
在一个实施例中,步骤S703中的确定待配置区域上被用户选择的虚拟位置点,可以包括:提供待配置区域的各作业位置块的块特征点作为可选虚拟位置点;根据用户对可选虚拟位置点的选择信息,确定待配置区域上被用户选择的虚拟位置点。
如图8所示,待配置区域800可以由多个作业位置块拼接而成,例如,待配置区域800可以由作业位置块K1和K2拼接而成。每个作业位置块可以对应于细胞操作任务执行区域的某个作业区域,以置液区域的待配置区域800为例,待配置区域800的一个作业位置块可以对应于如96孔、60孔等规格的小料盒113的一个孔位等,其中,小料盒113的一个孔位可以看作一个置液区域。待配置区域800的各作业位置块均块特征点,该块特征点可以包括角点、中心点等。例如,作业位置块K1的块特征点可以是角点P1和中心点P2、作业位置块K2的块特征点可以是角点P3等。
本实施例中,终端101可将待配置区域800的各作业位置块的块特征点作为可选虚拟位置点进行展示。也就是说,终端101可将各作业位置块的块特征点直接提供给用户进行选择,以方便用户快速选取所需的虚拟位置点。然后,终端101便可获取用户对可选虚拟位置点的选择信息,并根据该选择信息确定待配置区域800上被用户选择的虚拟位置点,例如角点P1,从而提高位置点选取的效率。
在一些实施例中,虚拟位置点的数量为多个;每一虚拟位置点对应一作业位置块;上述方法还可以包括如下步骤:响应于用户对一作业位置块的触发操作,将一作业位置块对应的一个或多个虚拟位置点进行放大显示;响应于用户对放大显示的一个或多个虚拟位置点的触发操作,控制细胞操作机器人将吸取管移动至相应的实际位置点。
如图8,本实施例中,虚拟位置点的数量为多个,如虚拟位置点P4和虚拟位置点P5等,每一虚拟位置点对应一作业位置块,如虚拟位置点P4对应作业位置块K3,虚拟位置点P5也可以对应作业位置块K3,即一个作业位置块可对应多个虚拟位置点,而一虚拟位置点对应一作业位置块,这样可满足将吸取管108移动到一作业区域的不同位置的控制需求。为了便于用户选择虚拟位置点,终端101可先获取用户对如作业位置块K3的触发操作,然后将作业位置块K3整体放大显示,如放大显示为作业位置块K30,从而使得作业位置块K3对应的虚拟位置点P4和虚拟位置点P5也被相应放大为虚拟位置点P40和虚拟位置点P50。由此,终端101进一步获取用户对虚拟位置点P40和虚拟位置点P50的触发操作,然后控制细胞操作机器人103将吸取管108移动至相应的实际位置点,例如用户选择虚拟位置点P40,则终端101可以控制细胞操作机器人103将吸取管108移动至虚拟位置点P40对应的实际位置点。
在实际应用中,用户对虚拟位置点的选取完毕后,终端101可取消前述放大显示效果,恢复原来的显示效果。
在一些实施例中,虚拟位置点的数量为多个;一作业位置块对应一虚拟位置点;上述方法还可以包括如下步骤:响应于用户对一作业位置块的触发操作,控制细胞操作机器人将吸取管移动至相应的实际位置点。
如图8所示,本实施例中,虚拟位置点的数量为多个,如虚拟位置点P1和虚拟位置点P3等,每一作业位置块对应一虚拟位置点,如作业位置块K1对应虚拟位置点P1、作业位置块K2对应虚拟位置点P3,这样可以满足更快速将吸取管108移动到一作业区域所在位置的控制需求。
具体地,用户可直接在终端101上选择如作业位置块K1,终端101响应于该对作业位置块K1的触发操作,控制细胞操作机器人103将吸取管108移动至虚拟位置点P1对应的实际位置点,以选取块的方式直接选取点,进一步提高位置点的选取效率和机器人控制效率。
在一些实施例中,本申请还提供了基于机器人的细胞操作任务处理方法,可以应用于如图6所示的应用环境中。下面以图6所示应用场景为基础结合相应实施例对本申请提供的基于机器人的细胞操作任务处理方法进行说明。
在一个实施例中,如图9所示,提供了一种基于机器人的细胞操作任务处理方法,以该方法应用于图6中的终端101为例进行说明,包括以下步骤:
步骤S901,获取用户指示细胞操作机器人执行的细胞操作任务。
具体地,终端101可以接收用户指示细胞操作机器人103执行的细胞操作任务,该细胞操作任务包括取液操作、置液操作或清洗操作等中的至少一种。
步骤S902,获取用户在细胞操作任务下的操作习惯信息。
其中,不同用户对于相同或不同的细胞操作任务都会有其操作习惯,使用符合用户自身操作习惯的方式控制细胞操作机器人103执行相应的细胞操作任务,在一定程度上可以减少用户的操作出错概率,以提高操作效率。
具体地,终端101在确定用户指示细胞操作机器人103需执行的细胞操作任务后,获取该用户在该细胞操作任务下的操作习惯信息,该操作习惯信息可以是终端101根据对该用户以往在该项细胞操作任务下的操作信息进行统计得到,也可以由用户针对各项细胞操作任务进行主动设置得到。
步骤S903,根据操作习惯信息,确定适用于细胞操作任务的移动轨迹和角度。
具体地,终端101在得到用户在细胞操作任务下的操作习惯信息后,根据该操作习惯信息确定适用于该本次细胞操作任务、且符合用户操作习惯的移动轨迹和角度。其中,移动轨迹是指细胞操作机器人103将吸取管108从当前位置移动到目标位置的轨迹,该目标位置可直接从操作习惯信息获取得到,目标位置可以理解为用户利用细胞操作机器人103执行该项细胞操作任务时,习惯将吸取管108移动所至的位置;角度是指吸取管108到达目标位置时与预设平面形成的角度,该预设平面可包括水平面和垂直平面,相应地,该角度可包括分别与该水平面和垂直平面形成的角度。
步骤S904,控制细胞操作机器人按照前述移动轨迹将吸取管移动至目标位置。
步骤S905,控制细胞操作机器人使吸取管到达目标位置时与预设平面形成前述角度。
具体地,终端101得到移动轨迹和角度后,可向细胞操作机器人103发送对应的控制指令,以指示细胞操作机器人103按照前述移动轨迹将吸取管103从当前位置移动至目标位置。除位置移动外,终端101还可以控制细胞操作机器人103使吸取管130到达目标位置时与预设平面形成前述角度,从而使细胞操作机器人103将吸取管103自动移动到满足细胞操作任务的要求,且符合用户操作习惯的目标位置,并且吸取管103的角度也被自动被调整为满足细胞操作任务需要且符合用户操作习惯的角度。在位置到达且角度调整完毕后,用户可直接操作细胞操作机器人103执行具体地细胞操作任务,如基于该目标位置和角度控制细胞操作机器人103进行取液、置液或清洗等至少一种细胞操作任务,无需每次执行任务时都进行重复频繁的位置和角度调节,以提高操作效率。
上述基于机器人的细胞操作任务处理方法,主要用于控制细胞操作机器人103,终端101获取用户指示细胞操作机器人103执行的细胞操作任务,终端101获取该用户在该细胞操作任务下的操作习惯信息,终端101根据该操作习惯信息确定适用于该细胞操作任务的移动轨迹和角度,然后终端101控制细胞操作机器人103按照该移动轨迹将吸取管108移动至目标位置以及控制该细胞操作机器人103使吸取管108到达目标位置时与预设平面形成前述角度。该方案能够自动获取用户在当前待执行的细胞操作任务下的操作习惯,从而根据该操作习惯确定出适用于该细胞操作任务的符合用户操作习惯的移动轨迹和角度,并自动控制细胞操作机器人103按照移动轨迹将吸取管108移动至目标位置以及使吸取管108到达目标位置时与预设平面形成前述角度,实现无需用户对细胞操作机器人103进行重复、频繁的调节 操作,提高细胞操作效率的效果,还有利于降低其操作出错概率。
在一些实施例中,步骤S902中的获取用户在细胞操作任务下的操作习惯信息,可以包括:获取用户在历史时段内针对细胞操作任务的操作信息;根据对操作信息的统计,得到操作习惯信息。
本实施例中,终端101可以根据对该用户以往在该项细胞操作任务下的操作信息进行统计,并根据统计结果获取其操作习惯信息。
本实施例中,终端101可获取用户在历史时段内针对细胞操作任务的操作信息,该历史时段可以是近期的某个时段,如近1个月、近3个月等,用户的习惯可能会随着其操作技巧或熟练度等至少一种因素发生变化,获取其近期的操作信息有利于较为准确地确定其操作习惯,从而有利于自动控制细胞操作机器人103以符合其习惯的方式运作。终端101在获取用户在历史时段内针对细胞操作任务的操作信息后,根据对这些操作信息的统计,得到该用户在该细胞操作任务下的操作习惯信息。其中,该操作信息具体可以是在执行该细胞操作任务时,终端101控制细胞操作机器人103将吸取管108移动到某个或某些位置,将吸取管108调节至某个或某些角度等,统计则具体可以是对移动所至的某些位置、调节所至的某些角度进行频次统计。
以下分别以实施例的方式具体介绍在细胞操作任务分别为取液操作、置液操作和清洗操作的情况下,对操作习惯信息的具体获取方式。
在一个实施例中,细胞操作任务包括取液操作;操作信息包括用于控制细胞操作机器人103将吸取管108移动至相应取液位置的取液操作位置信息,以及用于控制细胞操作机器人103使吸取管108到达该相应取液位置时与预设平面形成相应角度的取液操作角度信息;以及,上述实施例中的根据对操作信息的统计,得到操作习惯信息,具体包括:根据取液操作位置信息和取液操作角度信息,确定满足取液操作位置频次条件的高频取液位置,以及在该高频取液位置下满足取液操作角度频次条件的高频取液角度;根据高频取液位置和高频取液角度,得到操作习惯信息。
具体地,对于取液操作这一细胞操作任务,操作信息可以包括取液操作位置信息和取液操作角度信息,取液操作位置信息和取液操作角度信息分别用于表征该用户在以往执行取液操作任务时,控制细胞操作机器人103将吸取管108移动至哪个或哪些取液位置,以及控制细胞操作机器人103使吸取管108到达该相应取液位置时与预设平面形成哪个或哪些取液角度。基于这些取液操作位置信息和取液操作角度信息,终端101可对相应的取液位置、取液角度进行频次统计,确定满足取液操作位置频次条件的高频取液位置以及在该高频取液位置下满足取液操作角度频次条件的高频取液角度。其中,取液操作位置频次条件可以是在所统计的所有取液位置中被用户使用的频次最高的,该取液操作角度频次条件可以是在满足该取液操作位置频次条件的取液位置,即高频取液位置上,被用户使用的频次最高的取液角度,即高频取液角度。在统计得到高频取液位置和高频取液角度之后,终端101可将该高频取液位置和高频取液角度作为操作习惯信息。
在一个实施例中,细胞操作任务包括置液操作;操作信息包括用于控制细胞操作机器人103将吸取管108移动至相应置液位置的置液操作位置信息,以及用于控制细胞操作机器人103使吸取管108到达该相应置液位置时与预设平面形成相应角度的置液操作角度信息;以及,上述实施例中的根据对操作信息的统计,得到操作习惯信息,具体包括:根据置液操作位置信息和置液操作角度信息,确定满足置液操作位置频次条件的高频置液位置,以及在该高频置液位置下满足置液操作角度频次条件的高频置液角度;根据高频置液位置和高频置液角度,得到操作习惯信息。
具体地,与取液操作类似,对于置液操作这一细胞操作任务,操作信息可包括置液操作位置信息和置液操作角度信息,置液操作位置信息和置液操作角度信息分别表征该用户在以往执行置液操作任务时,控制细胞操作机器人103将吸取管108移动至哪个或哪些置液位置,以及控制细胞操作机器人103使吸取管108到达该相应置液位置时与预设平面形成哪个或哪些置液角度。基于该置液操作位置信息和置液操作角度信息,终端101可对相应的置液位置、置液角度进行频次统计,确定满足置液操作位置频次条件的高频置液位置以及在该高频置液位置下满足置液操作角度频次条件的高频置液角度。其中,置液操作位置频次条件可以是在所统计的所有置液位置中被用户使用的频次最高的,该置液操作角度频次条件可以是在满足该置液操作位置频次条件的置液位置,即高频置液位置上,被用户使用的频次最高的置液角度,即高频置液角度。在统计得到高频置液位置和高频置液角度后,终端101也可将该高频置液位置 和高频置液角度作为操作习惯信息。
在其中一个实施例中,细胞操作任务包括清洗操作;操作信息包括用于控制细胞操作机器人103将吸取管108移动至相应清洗位置的清洗操作位置信息,以及用于控制细胞操作机器人103使吸取管108到达相应清洗位置时与预设平面形成相应角度的清洗操作角度信息;以及,上述实施例中的根据对操作信息的统计,得到操作习惯信息,具体包括:根据清洗操作位置信息和清洗操作角度信息,确定满足清洗操作位置频次条件的高频清洗位置,以及在该高频清洗位置下满足清洗操作角度频次条件的高频清洗角度;根据高频清洗位置和高频清洗角度,得到操作习惯信息。
具体地,与取液操作和置液操作类似,对于清洗操作这一细胞操作任务,操作信息可包括清洗操作位置信息和清洗操作角度信息,清洗操作位置信息和清洗操作角度信息分别表征该用户在以往执行清洗操作任务时,控制细胞操作机器人103将吸取管108移动至哪个或哪些清洗位置,以及控制细胞操作机器人103使吸取管108到达该相应清洗位置时与预设平面形成哪个或哪些清洗角度。基于该清洗操作位置信息和清洗操作角度信息,终端101可对相应的清洗位置、清洗角度进行频次统计,确定满足清洗操作位置频次条件的高频清洗位置以及在该高频清洗位置下满足清洗操作角度频次条件的高频清洗角度。其中,清洗操作位置频次条件可以是在所统计的所有清洗位置中被用户使用的频次最高的,该清洗操作角度频次条件可以是在满足该清洗操作位置频次条件的清洗位置,即高频清洗位置上,被用户使用的频次最高的清洗角度,即高频清洗角度。在统计得到高频清洗位置和高频清洗角度后,终端101也可将该高频清洗位置和高频清洗角度作为操作习惯信息。
在一些实施例中,获取用户在细胞操作任务下的操作习惯信息,包括以下至少一种:
获取由用户针对取液操作设定的高频取液位置和高频取液角度,根据高频取液位置和高频取液角度,得到操作习惯信息;
获取由用户针对置液操作设定的高频置液位置和高频置液角度,根据高频置液位置和高频置液角度,得到操作习惯信息;
获取由用户针对清洗操作设定的高频清洗位置和高频清洗角度,根据高频清洗位置和高频清洗角度,得到操作习惯信息。
本实施例中,可以由用户主动设置全部或部分细胞操作任务的操作习惯信息,该细胞操作任务可以包括取液操作、置液操作或清洗操作中的至少一种,也即用户可以主动设定取液操作、置液操作和清洗操作中的一个或者多个细胞操作任务的操作习惯信息。
具体地,终端101可获取由用户针对取液操作设定的取液操作位置信息和取液操作角度信息,终端101也可获取由用户针对置液操作设定的高频置液位置和高频置液角度,终端101还可获取由用户针对清洗操作设定的高频清洗位置和高频清洗角度,然后终端101可以将取液操作位置信息和取液操作角度信息、高频置液位置和高频置液角度,以及高频清洗位置和高频清洗角度中的至少一种,作为操作习惯信息。
综合如上两组获取操作习惯信息的实施例,在具体应用中,当用户针对当前待执行的细胞操作任务主动设定了相应的操作习惯信息时,终端101可优先使用由用户主动设定的操作习惯信息。当用户针对当前待执行的细胞操作任务未主动设定相应的操作习惯信息时,终端101可获取经统计分析得到的操作习惯信息。当用户针对当前待执行的细胞操作任务未主动设定相应的操作习惯信息,且暂未形成可进行统计分析的操作信息时,终端101可主动提示用户主动设定操作习惯信息并据此自动控制细胞操作机器人103运动。或者,终端101也可先按照系统默认的移动轨迹和角度,控制细胞操作机器人103运动并持续记录该用户的操作信息,以供其在可进行统计分析的操作信息形成后,获知用户的操作习惯信息,以满足实际场景的使用需求。
对于移动轨迹和角度,在一些实施例中,步骤S903中的根据操作习惯信息,确定适用于细胞操作任务的移动轨迹和角度,具体包括:根据操作习惯信息,确定适用于细胞操作任务的目标位置和角度;根据吸取管的当前位置和目标位置,得到适用于细胞操作任务的移动轨迹。
本实施例中,操作习惯信息具体可以包括细胞操作任务下的目标位置或角度中的至少一种。其中,可结合取液操作、置液操作和清洗操作对目标位置和角度进行说明。对于取液操作,目标位置可对应为高频取液位置,角度可对应为高频取液角度;对于置液操作,目标位置可对应为高频置液位置,角度可 对应为高频置液角度;对于清洗操作,目标位置可对应为高频清洗位置,角度可对应为高频清洗角度。然后,终端101可根据吸取管108的当前位置和所获取的目标位置,得到适用于当前待执行的细胞操作任务的移动轨迹,该移动轨迹具体可以是从当前位置指向目标位置的直线、折线或曲线等中的至少一种。由此,终端101可获得适用于细胞操作任务且符合用户操作习惯的移动轨迹和角度。
应该理解的是,虽然如上流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,如上流程图中的至少一部分步骤可以包括多个步骤或者多个阶段,这些步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤中的步骤或者阶段的至少一部分轮流或者交替地执行。
在一个实施例中,如图10所示,提供了一种基于机器人的细胞操作任务处理装置,该装置1000由任务执行终端100执行,包括:
协助请求发送模块1001,用于向任务协助终端发送针对细胞操作任务的协助请求;
模拟操作显示模块1002,用于显示来自任务协助终端的,并针对细胞操作任务的模拟操作信息;
实际操作获取模块1003,用于获取在任务执行终端的细胞操作界面输入的实际操作信息;
操作任务执行模块1004,用于根据实际操作信息控制机器人执行细胞操作任务;细胞操作任务可被任务协助终端停止执行。
在一个实施例中,该装置1000还包括:第一信息反馈单元,用于将实际操作信息发送至任务协助终端;接收任务协助终端对实际操作信息的反馈信息;操作任务执行模块1004,用于在反馈信息表征实际操作信息符合细胞操作任务的操作规范的情况下,根据实际操作信息,控制机器人执行细胞操作任务。
在一个实施例中,模拟操作信息包括模拟操作演示动画;模拟操作演示动画包括各演示动画片段;各演示动画片段与细胞操作任务的各操作环节相对应;模拟操作显示模块1002,用于按照细胞操作任务的各操作环节对应的时序,播放模拟操作演示动画的各演示动画片段;相邻演示动画片段的播放过渡时长满足预设的播放过渡时长阈值;实际操作获取模块1003,用于获取在细胞操作界面输入的各实际操作信息段;各实际操作信息段分别对应于各演示动画片段中演示的模拟操作;将各实际操作信息段组合得到实际操作信息。
在一个实施例中,该装置1000还包括:第二信息反馈单元,用于将实际操作信息发送至任务协助终端;接收任务协助终端对实际操作信息中各实际操作信息段的反馈信息;在反馈信息表征各实际操作信息段中存在异常实际操作信息段的情况下,播放异常实际操作信息段对应的演示动画片段,并获取在细胞操作界面重新输入的对应的实际操作信息段;异常实际操作信息段为不符合细胞操作任务的操作规范的实际操作信息段;将实际操作信息中的异常实际操作信息段替换为重新输入的实际操作信息后,再次将替换后的实际操作信息发送至任务协助终端。
在一个实施例中,该装置1000还包括:限制输入单元,用于在机器人执行细胞操作任务过程中,当接收到来自任务协助终端的任务停止执行信息时,则限制在细胞操作界面的输入;当检测到机器人在任务协助终端的控制下到达预定位置时,解除对细胞操作界面的输入的限制。
在一个实施例中,如图11所示,提供了一种基于机器人的细胞操作任务处理装置,该装置1100由任务协助终端200执行,包括:
协助请求接收模块1101,用于接收任务执行终端发送的针对细胞操作任务的协助请求;
辅助界面显示模块1102,用于根据协助请求,显示针对细胞操作任务的操作辅助界面;
模拟操作处理模块1103,用于获取在操作辅助界面输入的模拟操作信息,将模拟操作信息发送至任务执行终端,以供任务执行终端进行展示;
监控画面提供模块1104,用于提供监控画面;监控画面用于监控任务执行终端根据实际操作信息,控制机器人执行细胞操作任务;实际操作信息是在任务执行终端的细胞操作界面输入的;
停止指令处理模块1105,用于当接收到停止执行指令时,控制机器人停止执行细胞操作任务。
在一个实施例中,模拟操作处理模块1103,用于获取在操作辅助界面输入的模拟操作;模拟操作 对应于细胞操作任务的各操作环节;根据对应于细胞操作任务的各操作环节的模拟操作,分别获取与各操作环节对应的各演示动画片段;根据预设的播放过渡时长阈值和各操作环节对应的时序,将各演示动画片段组合得到模拟操作演示动画;模拟操作演示动画中相邻演示动画片段的播放过渡时长满足播放过渡时长阈值;将模拟操作演示动画作为模拟操作信息。
在一个实施例中,该装置1100还可以包括:反馈处理单元,用于接收任务执行终端发送的实际操作信息,获取对实际操作信息的反馈信息,将反馈信息发送至任务执行终端。
在一个实施例中,停止指令处理模块1105,还用于向任务执行终端发送任务停止执行信息,控制机器人移动到达预定位置,向任务执行终端发送限制解除指令。
在一个实施例中,如图12所示,提供了一种基于机器人的细胞操作任务处理装置,该装置1200可以包括:
方式提供模块1201,用于提供细胞操作任务执行区域的多种可选布局方式;
区域展示模块1202,用于根据用户对多种可选布局方式的选择,展示待配置区域;待配置区域为与用户所选布局方式相对应的细胞操作任务执行区域;
位置确定模块1203,用于确定待配置区域上被用户选择的虚拟位置点;
操作获取模块1204,用于获取用户对细胞操作机器人的操作信息;操作信息,用于控制细胞操作机器人将吸取管从原点运动到实际位置点;
信息配置模块1205,用于当接收到用户对操作信息的确认信息时,根据操作信息配置虚拟位置点的控制信息;控制信息,用于当虚拟位置点被触发时,控制细胞操作机器人将吸取管移动至实际位置点。
在一个实施例中,信息配置模块1205,用于根据操作信息,获取实际位置点相对于原点的坐标信息;根据坐标信息,得到控制信息。
在一个实施例中,该装置1200还包括:第一控制单元,用于响应于用户对虚拟位置点的触发操作,根据吸取管当前位置点相对于原点的坐标信息以及控制信息,控制细胞操作机器人将吸取管从当前位置点移动至实际位置点。
在一个实施例中,待配置区域由多个作业位置块拼接而成;位置确定模块1203,用于提供待配置区域的各作业位置块的块特征点,作为可选虚拟位置点;根据用户对可选虚拟位置点的选择信息,确定待配置区域上被用户选择的虚拟位置点。
在一个实施例中,虚拟位置点的数量为多个;每一虚拟位置点对应一作业位置块;该装置1200还包括:第二控制单元,用于响应于用户对一作业位置块的触发操作,将一作业位置块对应的一个或多个虚拟位置点进行放大显示;响应于用户对放大显示的一个或多个虚拟位置点的触发操作,控制细胞操作机器人将吸取管移动至相应的实际位置点。
在一个实施例中,虚拟位置点的数量为多个;一作业位置块对应一虚拟位置点;该装置1200还包括:第三控制单元,用于响应于用户对一作业位置块的触发操作,控制细胞操作机器人将吸取管移动至相应的实际位置点。
在一个实施例中,细胞操作任务执行区域,选自取液区域、置液区域和清洗区域构成的组。
在一个实施例中,如图13所示,提供了一种基于机器人的细胞操作任务处理装置,该装置1300可以包括:
任务获取模块1301,用于获取用户指示细胞操作机器人执行的细胞操作任务;
习惯获取模块1302,用于获取用户在细胞操作任务下的操作习惯信息;
习惯处理模块1303,用于根据操作习惯信息,确定适用于细胞操作任务的移动轨迹和角度;
机器人控制模块1304,用于控制细胞操作机器人按照移动轨迹将吸取管移动至目标位置,还用于控制细胞操作机器人使吸取管到达目标位置时与预设平面形成角度。
在一个实施例中,习惯获取模块1302,用于获取用户在历史时段内针对细胞操作任务的操作信息;根据对操作信息的统计,得到操作习惯信息。
在一个实施例中,细胞操作任务包括取液操作;操作信息包括取液操作位置信息和取液操作角度信息;取液操作位置信息用于控制细胞操作机器人将吸取管移动至相应取液位置;取液操作角度信息用于控制细胞操作机器人将吸取管移动至相应取液位置时,与预设平面形成相应角度;习惯获取模块1302, 用于根据取液操作位置信息和取液操作角度信息,确定满足取液操作位置频次条件的高频取液位置以及高频取液位置下满足取液操作角度频次条件的高频取液角度;根据高频取液位置和高频取液角度,得到操作习惯信息。
在一个实施例中,细胞操作任务包括置液操作;操作信息包括置液操作位置信息和置液操作角度信息;置液操作位置信息用于控制细胞操作机器人将吸取管移动至相应置液位置;置液操作角度信息用于控制细胞操作机器人将吸取管移动至相应置液位置时,与预设平面形成相应角度;习惯获取模块1302,用于根据置液操作位置信息和置液操作角度信息,确定满足置液操作位置频次条件的高频置液位置以及高频置液位置下满足置液操作角度频次条件的高频置液角度;根据高频置液位置和高频置液角度,得到操作习惯信息。
在一个实施例中,细胞操作任务包括清洗操作;操作信息包括清洗操作位置信息和清洗操作角度信息;清洗操作位置信息用于控制细胞操作机器人将吸取管移动至相应清洗位置;清洗操作角度信息用于控制细胞操作机器人将吸取管移动至相应清洗位置时,与预设平面形成相应角度;习惯获取模块1302,用于根据清洗操作位置信息和清洗操作角度信息,确定满足清洗操作位置频次条件的高频清洗位置以及高频清洗位置下满足清洗操作角度频次条件的高频清洗角度;根据高频清洗位置和高频清洗角度,得到操作习惯信息。
在一个实施例中,细胞操作任务选自取液操作、置液操作和清洗操作构成的组;习惯获取模块1302,用于获取由用户针对取液操作设定的高频取液位置和高频取液角度,根据高频取液位置和高频取液角度,得到操作习惯信息;获取由用户针对置液操作设定的高频置液位置和高频置液角度,根据高频置液位置和高频置液角度,得到操作习惯信息;获取由用户针对清洗操作设定的高频清洗位置和高频清洗角度,根据高频清洗位置和高频清洗角度,得到操作习惯信息。
在一个实施例中,习惯处理模块1303,用于根据操作习惯信息,确定适用于细胞操作任务的目标位置和角度;根据吸取管的当前位置和目标位置,得到适用于细胞操作任务的移动轨迹。
在一个实施例中,关于基于机器人的细胞操作任务处理装置的具体限定可以参见上文中对于基于机器人的细胞操作任务处理方法的限定。上述基于机器人的细胞操作任务处理装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的一个或多个处理器中,也可以以软件形式存储于计算机设备中的一个或多个存储器中,以便于一个或多个处理器调用执行以上各个模块对应的操作。
在一个实施例中,提供了一种计算机设备,该计算机设备可以是终端,其内部结构图可以如图14所示。该计算机设备包括通过系统总线连接的处理器、存储器、通信接口、显示屏和输入装置。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机可读指令。该内存储器为非易失性存储介质中的操作系统和计算机可读指令的运行提供环境。该计算机设备的通信接口用于与外部的终端进行有线或无线方式的通信,无线方式可通过WIFI、运营商网络、NFC(近场通信)或其他技术实现。该计算机可读指令被处理器执行时以实现一种基于机器人的细胞操作任务处理方法。该计算机设备的显示屏可以是液晶显示屏或者电子墨水显示屏,该计算机设备的输入装置可以是显示屏上覆盖的触摸层,也可以是计算机设备外壳上设置的按键、轨迹球或触控板,还可以是外接的键盘、触控板或鼠标等。
本领域技术人员可以理解,图14中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。
在一个实施例中,还提供了一种计算机设备,包括一个或多个处理器及存储器,存储器中存储有计算机可读指令,一个或多个处理器执行计算机可读指令时实现上述各方法实施例中的步骤。
在一个实施例中,提供了一个或多个计算机可读存储介质,其上存储有计算机可读指令,计算机可读指令被一个或多个处理器执行时实现上述各方法实施例中的步骤。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机可读指令来指令相关的硬件来完成,所述的计算机可读指令可存储于一非易失性计算机可读取存储介质中,该计算机可读指令在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所 使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和易失性存储器中的至少一种。非易失性存储器可包括只读存储器(Read-Only Memory,ROM)、磁带、软盘、闪存或光存储器等。易失性存储器可包括随机存取存储器(Random Access Memory,RAM)或外部高速缓冲存储器。作为说明而非局限,RAM可以是多种形式,比如静态随机存取存储器(Static Random Access Memory,SRAM)或动态随机存取存储器(Dynamic Random Access Memory,DRAM)等。
以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。
以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。

Claims (28)

  1. 一种基于机器人的细胞操作任务处理方法,其特征在于,由任务执行终端执行,所述方法包括:
    向任务协助终端发送针对细胞操作任务的协助请求;
    显示来自所述任务协助终端的,且针对所述细胞操作任务的模拟操作信息;
    获取在所述任务执行终端的细胞操作界面输入的实际操作信息;
    根据所述实际操作信息控制机器人执行所述细胞操作任务;所述细胞操作任务可被所述任务协助终端停止执行。
  2. 根据权利要求1所述的方法,其特征在于,在所述根据所述实际操作信息控制机器人执行所述细胞操作任务之前,所述方法还包括:
    将所述实际操作信息发送至所述任务协助终端;
    接收所述任务协助终端对所述实际操作信息的反馈信息;
    所述根据所述实际操作信息控制机器人执行所述细胞操作任务,包括:
    在所述反馈信息表征所述实际操作信息符合所述细胞操作任务的操作规范的情况下,根据所述实际操作信息控制机器人执行所述细胞操作任务。
  3. 根据权利要求1所述的方法,其特征在于,所述模拟操作信息包括模拟操作演示动画;所述模拟操作演示动画包括各演示动画片段;所述各演示动画片段与所述细胞操作任务的各操作环节相对应;
    所述显示来自所述任务协助终端的,且针对所述细胞操作任务的模拟操作信息,包括:
    按照所述细胞操作任务的各操作环节对应的时序,播放所述模拟操作演示动画的各演示动画片段;相邻演示动画片段的播放过渡时长满足预设的播放过渡时长阈值;
    所述获取在所述任务执行终端的细胞操作界面输入的实际操作信息,包括:
    获取在所述细胞操作界面输入的各实际操作信息段;所述各实际操作信息段分别对应于所述各演示动画片段中演示的模拟操作;
    将所述各实际操作信息段组合得到实际操作信息。
  4. 根据权利要求3所述的方法,其特征在于,在所述根据所述实际操作信息控制机器人执行所述细胞操作任务之前,所述方法还包括:
    将所述实际操作信息发送至所述任务协助终端;
    接收所述任务协助终端对所述实际操作信息中各实际操作信息段的反馈信息;
    在所述反馈信息表征所述各实际操作信息段中存在异常实际操作信息段的情况下,播放所述异常实际操作信息段对应的演示动画片段,并获取在所述细胞操作界面重新输入的对应的实际操作信息段;所述异常实际操作信息段为不符合所述细胞操作任务的操作规范的实际操作信息段;
    将所述实际操作信息中的异常实际操作信息段替换为重新输入的实际操作信息后,再次将替换后的实际操作信息发送至所述任务协助终端。
  5. 根据权利要求1至4任一项所述的方法,其特征在于,所述方法还包括:
    在所述机器人执行细胞操作任务过程中,当接收到来自所述任务协助终端的任务停止执行信息时,则限制所述细胞操作界面的输入;
    当检测到所述机器人在所述任务协助终端的控制下到达预定位置时,解除对所述细胞操作界面的输入的限制。
  6. 一种基于机器人的细胞操作任务处理方法,其特征在于,由任务协助终端执行,所述方法包括:
    接收任务执行终端发送的针对细胞操作任务的协助请求;
    根据所述协助请求,显示针对所述细胞操作任务的操作辅助界面;
    获取在所述操作辅助界面输入的模拟操作信息,将所述模拟操作信息发送至所述任务执行终端,以供所述任务执行终端进行展示;
    提供监控画面;所述监控画面用于监控所述任务执行终端根据实际操作信息,控制机器人执行所述细胞操作任务;所述实际操作信息是在所述任务执行终端的细胞操作界面输入的;
    当接收到停止执行指令时,控制所述机器人停止执行所述细胞操作任务。
  7. 根据权利要求6所述的方法,其特征在于,所述获取在所述操作辅助界面输入的模拟操作信息,包括:
    获取在所述操作辅助界面输入的模拟操作;所述模拟操作对应于所述细胞操作任务的各操作环节;
    根据所述对应于所述细胞操作任务的各操作环节的模拟操作,分别获取与所述各操作环节对应的各演示动画片段;
    根据预设的播放过渡时长阈值和所述各操作环节对应的时序,将所述各演示动画片段组合得到模拟操作演示动画;所述模拟操作演示动画中相邻演示动画片段的播放过渡时长满足所述播放过渡时长阈值;
    将所述模拟操作演示动画作为所述模拟操作信息。
  8. 一种基于机器人的细胞操作任务处理方法,其特征在于,由终端执行,所述方法包括:
    提供细胞操作任务执行区域的多种可选布局方式;
    根据用户对所述多种可选布局方式的选择,展示待配置区域;所述待配置区域为与用户所选布局方式相对应的细胞操作任务执行区域;
    确定所述待配置区域上被所述用户选择的虚拟位置点;
    获取所述用户对细胞操作机器人的操作信息;所述操作信息,用于控制所述细胞操作机器人将吸取管从原点运动到实际位置点;
    当接收到所述用户对所述操作信息的确认信息时,根据所述操作信息配置所述虚拟位置点的控制信息;所述控制信息,用于当所述虚拟位置点被触发时控制所述细胞操作机器人将所述吸取管移动至所述实际位置点。
  9. 根据权利要求8所述的方法,其特征在于,所述根据所述操作信息配置所述虚拟位置点的控制信息,包括:
    根据所述操作信息,获取所述实际位置点相对于所述原点的坐标信息;
    根据所述坐标信息,得到所述控制信息。
  10. 根据权利要求8或9所述的方法,其特征在于,在所述根据所述操作信息配置所述虚拟位置点的控制信息之后,所述方法还包括:
    响应于所述用户对所述虚拟位置点的触发操作,根据所述吸取管当前位置点相对于所述原点的坐标信息和所述控制信息,控制所述细胞操作机器人将所述吸取管从所述当前位置点移动至所述实际位置点。
  11. 根据权利要求8所述的方法,其特征在于,所述待配置区域由多个作业位置块拼接而成;所述确定所述待配置区域上被所述用户选择的虚拟位置点,包括:
    提供所述待配置区域的各作业位置块的块特征点,作为可选虚拟位置点;
    根据所述用户对所述可选虚拟位置点的选择信息,确定所述待配置区域上被所述用户选择的虚拟位置点。
  12. 根据权利要求11所述的方法,其特征在于,所述虚拟位置点的数量为多个;每一虚拟位置点对应一作业位置块;所述方法还包括:
    响应于所述用户对一作业位置块的触发操作,将所述一作业位置块对应的一个或多个虚拟位置点进行放大显示;
    响应于所述用户对放大显示的一个或多个虚拟位置点的触发操作,控制所述细胞操作机器人将所述吸取管移动至相应的实际位置点。
  13. 根据权利要求11所述的方法,其特征在于,所述虚拟位置点的数量为多个;一作业位置块对应一虚拟位置点;所述方法还包括:
    响应于所述用户对一作业位置块的触发操作,控制所述细胞操作机器人将所述吸取管移动至相应的实际位置点。
  14. 根据权利要求8所述的方法,其特征在于,所述细胞操作任务执行区域,选自取液区域、置液区域和清洗区域构成的组。
  15. 一种基于机器人的细胞操作任务处理方法,其特征在于,由终端执行,所述方法包括:
    获取用户指示细胞操作机器人执行的细胞操作任务;
    获取所述用户在所述细胞操作任务下的操作习惯信息;
    根据所述操作习惯信息,确定适用于所述细胞操作任务的移动轨迹和角度;
    控制所述细胞操作机器人按照所述移动轨迹将吸取管移动至目标位置;
    控制所述细胞操作机器人使所述吸取管到达所述目标位置时,与预设平面形成所述角度。
  16. 根据权利要求15所述的方法,其特征在于,所述获取所述用户在所述细胞操作任务下的操作习惯信息,包括:
    获取所述用户在历史时段内针对所述细胞操作任务的操作信息;
    根据对所述操作信息的统计,得到所述操作习惯信息。
  17. 根据权利要求16所述的方法,其特征在于,所述细胞操作任务包括取液操作;所述操作信息包括取液操作位置信息和取液操作角度信息;所述取液操作位置信息用于控制所述细胞操作机器人将所述吸取管移动至相应取液位置;所述取液操作角度信息用于控制所述细胞操作机器人将所述吸取管移动至所述相应取液位置时,与所述预设平面形成相应角度;
    所述根据对所述操作信息的统计,得到所述操作习惯信息,包括:
    根据所述取液操作位置信息和所述取液操作角度信息,确定满足取液操作位置频次条件的高频取液位置,以及所述高频取液位置下满足取液操作角度频次条件的高频取液角度;
    根据所述高频取液位置和高频取液角度,得到所述操作习惯信息。
  18. 根据权利要求16所述的方法,其特征在于,所述细胞操作任务包括置液操作;所述操作信息包括置液操作位置信息和置液操作角度信息;所述置液操作位置信息用于控制所述细胞操作机器人将所述吸取管移动至相应置液位置;所述置液操作角度信息用于控制所述细胞操作机器人将所述吸取管移动至所述相应置液位置时,与所述预设平面形成相应角度;
    所述根据对所述操作信息的统计,得到所述操作习惯信息,包括:
    根据所述置液操作位置信息和所述置液操作角度信息,确定满足置液操作位置频次条件的高频置液位置,以及所述高频置液位置下满足置液操作角度频次条件的高频置液角度;
    根据所述高频置液位置和高频置液角度,得到所述操作习惯信息。
  19. 根据权利要求16所述的方法,其特征在于,所述细胞操作任务包括清洗操作;所述操作信息包括清洗操作位置信息和清洗操作角度信息;所述清洗操作位置信息用于控制所述细胞操作机器人将所述吸取管移动至相应清洗位置;所述清洗操作角度信息用于控制所述细胞操作机器人将所述吸取管移动至所述相应清洗位置时,与所述预设平面形成相应角度;
    所述根据对所述操作信息的统计,得到所述操作习惯信息,包括:
    根据所述清洗操作位置信息和所述清洗操作角度信息,确定满足清洗操作位置频次条件的高频清洗位置,以及所述高频清洗位置下满足清洗操作角度频次条件的高频清洗角度;
    根据所述高频清洗位置和高频清洗角度,得到所述操作习惯信息。
  20. 根据权利要求15所述的方法,其特征在于,所述细胞操作任务选自取液操作、置液操作和清洗操作构成的组;
    所述获取所述用户在所述细胞操作任务下的操作习惯信息,包括以下至少一种:
    获取由所述用户针对所述取液操作设定的高频取液位置和高频取液角度,根据所述高频取液位置和所述高频取液角度,得到所述操作习惯信息;
    获取由所述用户针对所述置液操作设定的高频置液位置和高频置液角度,根据所述高频置液位置和所述高频置液角度,得到所述操作习惯信息;
    获取由所述用户针对所述清洗操作设定的高频清洗位置和高频清洗角度,根据所述高频清洗位置和所述高频清洗角度,得到所述操作习惯信息。
  21. 根据权利要求15至20任一项所述的方法,其特征在于,所述根据所述操作习惯信息,确定适用于所述细胞操作任务的移动轨迹和角度,包括:
    根据所述操作习惯信息,确定适用于所述细胞操作任务的目标位置和角度;
    根据所述吸取管的当前位置和所述目标位置,得到适用于所述细胞操作任务的移动轨迹。
  22. 一种基于机器人的细胞操作任务处理装置,其特征在于,所述装置包括:
    协助请求发送模块,用于向任务协助终端发送针对细胞操作任务的协助请求;
    模拟操作显示模块,用于显示来自所述任务协助终端的,且针对所述细胞操作任务的模拟操作信息;
    实际操作获取模块,用于获取在所述任务执行终端的细胞操作界面输入的实际操作信息;
    操作任务执行模块,用于根据所述实际操作信息控制机器人执行所述细胞操作任务;所述细胞操作任务可被所述任务协助终端停止执行。
  23. 一种基于机器人的细胞操作任务处理装置,其特征在于,所述装置包括:
    协助请求接收模块,用于接收任务执行终端发送的针对细胞操作任务的协助请求;
    辅助界面显示模块,用于根据所述协助请求,显示针对所述细胞操作任务的操作辅助界面;
    模拟操作处理模块,用于获取在所述操作辅助界面输入的模拟操作信息,将所述模拟操作信息发送至所述任务执行终端,以供所述任务执行终端进行展示;
    监控画面提供模块,用于提供监控画面;所述监控画面用于监控所述任务执行终端根据实际操作信息,控制机器人执行所述细胞操作任务;所述实际操作信息是在所述任务执行终端的细胞操作界面输入的;
    停止指令处理模块,用于当接收到停止执行指令时,控制所述机器人停止执行所述细胞操作任务。
  24. 一种基于机器人的细胞操作任务处理装置,其特征在于,所述装置包括:
    方式提供模块,用于提供细胞操作任务执行区域的多种可选布局方式;
    区域展示模块,用于根据用户对所述多种可选布局方式的选择,展示待配置区域;所述待配置区域为与用户所选布局方式相对应的细胞操作任务执行区域;
    位置确定模块,用于确定所述待配置区域上被所述用户选择的虚拟位置点;
    操作获取模块,用于获取所述用户对细胞操作机器人的操作信息;所述操作信息,用于控制所述细胞操作机器人将吸取管从原点运动到实际位置点;
    信息配置模块,用于当接收到所述用户对所述操作信息的确认信息时,根据所述操作信息配置所述虚拟位置点的控制信息;所述控制信息,用于当所述虚拟位置点被触发时,控制所述细胞操作机器人将所述吸取管移动至所述实际位置点。
  25. 一种基于机器人的细胞操作任务处理装置,其特征在于,所述装置包括:
    任务获取模块,用于获取用户指示细胞操作机器人执行的细胞操作任务;
    习惯获取模块,用于获取所述用户在所述细胞操作任务下的操作习惯信息;
    习惯处理模块,用于根据所述操作习惯信息,确定适用于所述细胞操作任务的移动轨迹和角度;
    机器人控制模块,用于控制所述细胞操作机器人按照所述移动轨迹将吸取管移动至目标位置;
    所述机器人控制模块,还用于控制所述细胞操作机器人使所述吸取管到达所述目标位置时,与预设平面形成所述角度。
  26. 一种计算机设备,包括一个或多个处理器及存储器,所述存储器存储有计算机可读指令,其特征在于,一个或多个处理器执行所述计算机可读指令时实现权利要求1至21任一项所述的方法的步骤。
  27. 一个或多个计算机可读存储介质,其上存储有计算机可读指令,其特征在于,所述计算机可读指令被一个或多个处理器执行时实现权利要求1至21中任一项所述的方法的步骤。
  28. 一种计算机程序产品,包括计算机可读指令,其特征在于,所述计算机可读指令被一个或多个处理器执行时实现权利要求1至21任一项所述的方法的步骤。
PCT/CN2022/116998 2021-09-06 2022-09-05 基于机器人的细胞操作任务处理方法、装置、设备及介质 WO2023030518A1 (zh)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN202111039293.0A CN113733087B (zh) 2021-09-06 2021-09-06 细胞操作机器人的控制信息配置方法、装置、设备和介质
CN202111040562.5A CN113771030B (zh) 2021-09-06 2021-09-06 细胞操作机器人的控制方法、装置、设备和存储介质
CN202111040555.5A CN113821287B (zh) 2021-09-06 2021-09-06 基于机器人的细胞操作任务处理方法、装置、设备和介质
CN202111040562.5 2021-09-06
CN202111040555.5 2021-09-06
CN202111039293.0 2021-09-06

Publications (1)

Publication Number Publication Date
WO2023030518A1 true WO2023030518A1 (zh) 2023-03-09

Family

ID=85411984

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/116998 WO2023030518A1 (zh) 2021-09-06 2022-09-05 基于机器人的细胞操作任务处理方法、装置、设备及介质

Country Status (1)

Country Link
WO (1) WO2023030518A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1418761A (zh) * 2002-12-10 2003-05-21 北京航空航天大学 面向生物医学工程的微操作机器人系统
CN112060091A (zh) * 2020-09-04 2020-12-11 苏州华兴源创科技股份有限公司 机器人回原点的方法、装置、机器人和存储介质
CN112911190A (zh) * 2019-12-04 2021-06-04 华为技术有限公司 一种远程协助的方法、电子设备和系统
CN113733087A (zh) * 2021-09-06 2021-12-03 深圳太力生物技术有限责任公司 细胞操作机器人的控制信息配置方法、装置、设备和介质
CN113771030A (zh) * 2021-09-06 2021-12-10 深圳太力生物技术有限责任公司 细胞操作机器人的控制方法、装置、设备和存储介质
CN113821287A (zh) * 2021-09-06 2021-12-21 深圳太力生物技术有限责任公司 基于机器人的细胞操作任务处理方法、装置、设备和介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1418761A (zh) * 2002-12-10 2003-05-21 北京航空航天大学 面向生物医学工程的微操作机器人系统
CN112911190A (zh) * 2019-12-04 2021-06-04 华为技术有限公司 一种远程协助的方法、电子设备和系统
CN112060091A (zh) * 2020-09-04 2020-12-11 苏州华兴源创科技股份有限公司 机器人回原点的方法、装置、机器人和存储介质
CN113733087A (zh) * 2021-09-06 2021-12-03 深圳太力生物技术有限责任公司 细胞操作机器人的控制信息配置方法、装置、设备和介质
CN113771030A (zh) * 2021-09-06 2021-12-10 深圳太力生物技术有限责任公司 细胞操作机器人的控制方法、装置、设备和存储介质
CN113821287A (zh) * 2021-09-06 2021-12-21 深圳太力生物技术有限责任公司 基于机器人的细胞操作任务处理方法、装置、设备和介质

Similar Documents

Publication Publication Date Title
WO2021036594A1 (zh) 一种应用于投屏场景的控制方法以及相关设备
CN105739900B (zh) 信息处理设备和方法、控制目标装置以及信息处理系统
CN1046621A (zh) 具有增强的换页能力的显示器
US20120235897A1 (en) Information processing apparatus, and control method and program therefor
CN104608120B (zh) 一种手机测试机械手装置及使用方法
US20230152949A1 (en) Application icon control method and apparatus, and electronic device
CN109144304A (zh) 至少一个显示窗口布局调整及触控自动校准方法及系统
CN110168487A (zh) 一种触摸控制方法及装置
US11036474B2 (en) Automating service maturity analysis and estimation
JP6538482B2 (ja) 電子機器及び方法
WO2023030518A1 (zh) 基于机器人的细胞操作任务处理方法、装置、设备及介质
US20170068427A1 (en) Control method, information processor apparatus and storage medium
JP5838278B1 (ja) コンピュータプログラム
US9256348B2 (en) Posture creation with tool pickup
WO2021232273A1 (zh) 无人机及其控制方法和装置、遥控终端、无人机系统
US9495124B1 (en) Device for displaying a remote display according to a monitor geometry
CN113771030B (zh) 细胞操作机器人的控制方法、装置、设备和存储介质
CN108885556A (zh) 控制数字输入
US9563723B1 (en) Generation of an observer view in a virtual environment
CN113821287B (zh) 基于机器人的细胞操作任务处理方法、装置、设备和介质
CN113733087B (zh) 细胞操作机器人的控制信息配置方法、装置、设备和介质
JP5623645B2 (ja) イメージオブジェクトの移動方法および装置
US11556300B2 (en) Remote display device, remote display system, and remote display method
JPWO2016024330A1 (ja) 情報を表示するための電子機器および方法
CN114564134A (zh) 应用图标显示方法、装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22863652

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE