TW202226137A - Method and system for controlling a handling machine and non-volatile computer readable recording medium - Google Patents

Method and system for controlling a handling machine and non-volatile computer readable recording medium Download PDF

Info

Publication number
TW202226137A
TW202226137A TW109144957A TW109144957A TW202226137A TW 202226137 A TW202226137 A TW 202226137A TW 109144957 A TW109144957 A TW 109144957A TW 109144957 A TW109144957 A TW 109144957A TW 202226137 A TW202226137 A TW 202226137A
Authority
TW
Taiwan
Prior art keywords
data
carrier
image
control
profile
Prior art date
Application number
TW109144957A
Other languages
Chinese (zh)
Other versions
TWI770726B (en
Inventor
蔡宗廷
鈞翔 雷
張彥中
劉清益
Original Assignee
財團法人工業技術研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 財團法人工業技術研究院 filed Critical 財團法人工業技術研究院
Priority to TW109144957A priority Critical patent/TWI770726B/en
Publication of TW202226137A publication Critical patent/TW202226137A/en
Application granted granted Critical
Publication of TWI770726B publication Critical patent/TWI770726B/en

Links

Images

Landscapes

  • Feeding Of Articles To Conveyors (AREA)
  • Manipulator (AREA)
  • Image Analysis (AREA)

Abstract

A method and a system for controlling a handling machine and a non-volatile computer readable recording medium are provided. The method includes: analyzing image data to obtain contour surface data corresponding to a target object from the image data; analyzing the contour surface data to obtain characteristic data which reflects a posture of the target object in a physical space; generating control data according to the characteristic data, wherein the control data is suitable for controlling the handling machine to transport the target object in response to the posture of the target object in the physical space.

Description

搬運機控制方法、系統及非揮發性電腦可讀記錄媒體Transporter control method, system, and non-volatile computer-readable recording medium

本發明是有關於一種搬運機控制技術,且特別是有關於一種搬運機控制方法、系統及非揮發性電腦可讀記錄媒體。The present invention relates to a conveyer control technology, and more particularly, to a conveyer control method, system and non-volatile computer-readable recording medium.

隨著人們的交易型態改變以及智慧倉儲等自動化的物流管理需求逐漸增加,越來越多的物流業者希望改為採用自動化的搬運裝置來自主完成貨物的搬運以及貨物上下架。然而,現有的影像辨識技術並無法直接套用於物流管理系統中。原因在於,待搬運貨物及/或乘載貨物的棧板在實體空間中往往是不規則地排列。因此,即便搬運裝置可以辨識出需要搬運的貨物,但其仍無法準確控制延伸臂或者夾具以特定角度插入至貨物下方的棧板凹槽中,以對棧板連同上方的貨物進行搬運。此外,待搬運貨物的包裝及/或乘載貨物的棧板的外觀上也可能具有瑕疵或發生破損,從而增加影像辨識的難度。With the change of people's transaction patterns and the increasing demand for automated logistics management such as smart warehousing, more and more logistics companies hope to use automated handling devices to independently complete the handling of goods and the loading and unloading of goods. However, the existing image recognition technology cannot be directly applied to the logistics management system. The reason is that the goods to be handled and/or the pallets carrying the goods are often arranged irregularly in the physical space. Therefore, even if the handling device can identify the goods to be handled, it still cannot accurately control the extension arm or the clamp to be inserted into the pallet groove under the goods at a specific angle, so as to carry the pallet together with the goods above. In addition, the packaging of the goods to be transported and/or the pallets carrying the goods may also have defects or damage in appearance, which increases the difficulty of image recognition.

本發明提供一種搬運機控制方法、系統及非揮發性電腦可讀記錄媒體,可提高搬運機執行自動化貨物搬運的效率。The present invention provides a handling machine control method, system and non-volatile computer-readable recording medium, which can improve the efficiency of the handling machine in performing automated cargo handling.

本發明的實施例提供一種搬運機控制方法,其包括:分析影像資料以獲得所述影像資料中對應於承載物的輪廓面資料;分析所述輪廓面資料以獲得所述承載物的特徵資料,其中所述特徵資料反映所述承載物在實體空間中的姿態;以及根據所述特徵資料產生控制資料,其中所述控制資料適於控制所述搬運機響應於所述承載物在所述實體空間中的所述姿態來搬運所述承載物。An embodiment of the present invention provides a method for controlling a transporter, which includes: analyzing image data to obtain profile data corresponding to a carrier in the image data; analyzing the profile data to obtain feature data of the carrier, wherein the characteristic data reflects the posture of the carrying object in the physical space; and control data is generated according to the characteristic data, wherein the control data is adapted to control the handling machine in response to the carrying object in the physical space in the posture to carry the load.

本發明的實施例另提供一種搬運機控制系統,其包括搬運機以及控制主機。所述控制主機耦接至所述搬運機。所述控制主機用以分析影像資料以獲得所述影像資料中對應於承載物的輪廓面資料。所述控制主機更用以分析所述輪廓面資料以獲得所述承載物的特徵資料,其中所述特徵資料反映所述承載物在實體空間中的姿態。所述控制主機更用以根據所述特徵資料產生控制資料。所述搬運機用以根據所述控制資料而響應於所述承載物在所述實體空間中的所述姿態來搬運所述承載物。Embodiments of the present invention further provide a handling machine control system, which includes a handling machine and a control host. The control host is coupled to the handler. The control host is used for analyzing the image data to obtain the contour surface data corresponding to the carrier in the image data. The control host is further configured to analyze the profile surface data to obtain characteristic data of the carrying object, wherein the characteristic data reflects the posture of the carrying object in the physical space. The control host is further configured to generate control data according to the characteristic data. The transporter is used for transporting the carrier in response to the posture of the carrier in the physical space according to the control data.

本發明的實施例另提供一種非揮發性電腦可讀記錄媒體,其儲存有程式碼,且所述程式碼經處理器執行以:分析影像資料以獲得所述影像資料中對應於承載物的輪廓面資料;分析所述輪廓面資料以獲得所述承載物的特徵資料,其中所述特徵資料反映所述承載物在實體空間中的姿態;以及根據所述特徵資料產生控制資料,其中所述控制資料適於控制所述搬運機響應於所述承載物在所述實體空間中的所述姿態來搬運所述承載物。An embodiment of the present invention further provides a non-volatile computer-readable recording medium, which stores a program code, and the program code is executed by a processor to: analyze image data to obtain a contour corresponding to a carrier in the image data surface data; analyzing the profile surface data to obtain characteristic data of the bearing, wherein the characteristic data reflects the posture of the bearing in the solid space; and generating control data according to the characteristic data, wherein the control Data is adapted to control the handling machine to handle the carrier in response to the attitude of the carrier in the physical space.

基於上述,在分析影像資料以獲得影像資料中對應於承載物的輪廓面資料後,可進一步分析所述輪廓面資料以獲得所述承載物的特徵資料,其反映所述承載物在實體空間中的姿態。然後,可根據所述特徵資料產生控制資料。特別是,所述控制資料適於控制搬運機響應於所述承載物在所述實體空間中的所述姿態來搬運所述目標物。藉此,可有效提高搬運機執行自動化貨物搬運的效率。Based on the above, after analyzing the image data to obtain the contour surface data corresponding to the bearing object in the image data, the contour surface data can be further analyzed to obtain the characteristic data of the bearing object, which reflects that the bearing object is in the physical space gesture. Then, control data can be generated based on the characteristic data. In particular, the control profile is adapted to control the handling machine to handle the target in response to the pose of the carrier in the physical space. In this way, the efficiency of the handling machine in performing automated cargo handling can be effectively improved.

圖1是根據本發明的一實施例所繪示的搬運機控制系統的示意圖。請參照圖1,系統(亦稱為搬運機控制系統)10包括搬運機11、控制主機12及承載物13。搬運機11、控制主機12及承載物13的數目皆可以是一或多個,本發明不加以限制。FIG. 1 is a schematic diagram of a handling machine control system according to an embodiment of the present invention. Referring to FIG. 1 , a system (also referred to as a transporter control system) 10 includes a transporter 11 , a control host 12 and a carrier 13 . The number of the carrier 11 , the control host 12 and the carrier 13 can be one or more, which is not limited in the present invention.

搬運機11用以搬運承載物13。例如,搬運機11可具有移動與轉動機構以於地面上進行前進、後退及/或轉向等行為。此外,搬運機11可具有延伸臂101與102。例如,搬運機11可控制延伸臂101與102進行垂直或水平移動。藉此,搬運機11可使用延伸臂101與102來搬運承載物13。在一實施例中,搬運機11可以是堆高車、拖板車、棧板車、叉車或鏟車等。在一實施例中,延伸臂101與102亦可以是實作為夾具、托盤或機械手臂等可用以搬運承載物13的機構件,而承載物13可以是棧板、托盤、載台或其他用以乘載物品的扁平或立體結構物。控制主機12可為桌上型電腦、筆記型電腦、平板電腦、工業用電腦、伺服器或其他類型的具有資料傳輸與處理功能的電腦裝置。搬運機11可與控制主機12進行通訊。The transporter 11 is used to transport the load 13 . For example, the handling machine 11 may have a movement and rotation mechanism to perform actions such as advancing, retreating and/or turning on the ground. In addition, the carrier 11 may have extension arms 101 and 102 . For example, the carrier 11 can control the extension arms 101 and 102 to move vertically or horizontally. Thereby, the carrier 11 can use the extension arms 101 and 102 to carry the load 13 . In one embodiment, the handler 11 may be a stacker, a pallet truck, a pallet truck, a forklift, a forklift, or the like. In one embodiment, the extension arms 101 and 102 can also be implemented as jigs, pallets, or mechanical arms that can be used to carry the carrier 13. A flat or three-dimensional structure for carrying objects. The control host 12 can be a desktop computer, a notebook computer, a tablet computer, an industrial computer, a server or other types of computer devices with data transmission and processing functions. The carrier 11 can communicate with the control host 12 .

在圖1以及以下的實施例中,承載物13是以棧板作為範例。貨物可以放置於承載物13上。承載物13下方可具有凹槽131與132。凹槽131可視為延伸臂101的插入口,且凹槽132可視為延伸臂102的插入口。搬運機11可將延伸臂101與102分別插入凹槽131與132。在將延伸臂101與102分別插入凹槽131與132後,搬運機11可控制延伸臂101與102舉起承載物13。須注意的是,在其他未提及的實施例中,承載物13還可以包括其他類型的承載物,只要可以被搬運機11搬運即可。此外,圖1的搬運機11的外型也僅為示意圖,其具體外觀可根據搬運機11的實際類型而改變。1 and the following embodiments, the carrier 13 is a pallet as an example. Goods can be placed on the carrier 13 . There may be grooves 131 and 132 below the carrier 13 . The groove 131 can be regarded as an insertion port of the extension arm 101 , and the groove 132 can be regarded as an insertion port of the extension arm 102 . The carrier 11 can insert the extension arms 101 and 102 into the grooves 131 and 132, respectively. After the extension arms 101 and 102 are inserted into the grooves 131 and 132 respectively, the carrier 11 can control the extension arms 101 and 102 to lift the load 13 . It should be noted that, in other unmentioned embodiments, the carrier 13 may also include other types of carriers, as long as they can be carried by the carrier 11 . In addition, the appearance of the transporter 11 in FIG. 1 is only a schematic diagram, and its specific appearance can be changed according to the actual type of the transporter 11 .

須注意的是,在圖1的實施例中,搬運機11的延伸臂101與102沒有對齊承載物13的凹槽131與132。在此狀態下,搬運機11的延伸臂101與102並無法順利插入至承載物13的凹槽131與132中以搬移承載物13。控制主機12可指示搬運機11移動至適當的位置以搬運承載物13。It should be noted that, in the embodiment of FIG. 1 , the extending arms 101 and 102 of the carrier 11 are not aligned with the grooves 131 and 132 of the carrier 13 . In this state, the extension arms 101 and 102 of the carrier 11 cannot be inserted into the grooves 131 and 132 of the carrier 13 smoothly to move the carrier 13 . The control host 12 can instruct the carrier 11 to move to an appropriate position to carry the load 13 .

在一實施例中,搬運機11還設置有影像擷取介面103。影像擷取介面103用以擷取外部影像。例如,影像擷取介面103可包含鏡頭與感光元件等光學元件。在圖1的實施例中,影像擷取介面103可設置於搬運機11前方,以擷取搬運機11前方的影像。然而,在一實施例中,影像擷取介面103亦可以設置於搬運機11的任意位置,以擷取其他方向的影像。In one embodiment, the transporter 11 is further provided with an image capturing interface 103 . The image capture interface 103 is used for capturing external images. For example, the image capture interface 103 may include optical elements such as a lens and a photosensitive element. In the embodiment of FIG. 1 , the image capturing interface 103 may be disposed in front of the transporter 11 to capture images in front of the transporter 11 . However, in an embodiment, the image capturing interface 103 can also be disposed at any position of the transporter 11 to capture images in other directions.

在一實施例中,影像擷取介面103所擷取的影像(即目標影像)包含待搬運的承載物13的至少一部分影像。也就是說,承載物13的至少一部分影像會出現於該目標影像中。影像擷取介面103可根據所擷取的目標影像產生影像資料DATA(image)。影像資料DATA(image)可帶有與承載物13當前在實體空間中的姿態之資訊。其中實體空間是指承載物13與搬運機11所實際存在的空間。例如,影像資料DATA(image)可反映承載物13與搬運機11在實體空間中的相對位置關係。In one embodiment, the image captured by the image capture interface 103 (ie, the target image) includes at least a part of the image of the carrier 13 to be transported. That is, at least a part of the image of the carrier 13 will appear in the target image. The image capturing interface 103 can generate image data DATA(image) according to the captured target image. The image data DATA(image) may contain information about the current posture of the carrier 13 in the physical space. The physical space refers to the space where the carrier 13 and the transporter 11 actually exist. For example, the image data DATA (image) can reflect the relative positional relationship between the carrier 13 and the carrier 11 in the physical space.

搬運機11可將影像資料DATA(image)傳送給控制主機12。控制主機12可分析影像資料DATA(image)以獲得影像資料DATA(image)中對應於承載物13的輪廓面資料。控制主機12可分析此輪廓面資料以獲得承載物13的特徵資料。此特徵資料可反映承載物13在實體空間中的姿態。接著,控制主機12可根據此特徵資料產生控制資料DATA(control)。控制資料DATA(control)適於控制搬運機11響應於承載物13在所述實體空間中的姿態來搬運承載物13。The transporter 11 can transmit the image data DATA (image) to the control host 12 . The control host 12 may analyze the image data DATA(image) to obtain contour surface data corresponding to the carrier 13 in the image data DATA(image). The control host 12 can analyze the profile data to obtain characteristic data of the carrier 13 . The characteristic data can reflect the posture of the carrier 13 in the physical space. Then, the control host 12 can generate control data DATA(control) according to the characteristic data. The control data DATA(control) is suitable for controlling the carrier 11 to carry the carrier 13 in response to the attitude of the carrier 13 in the physical space.

圖2是根據本發明的一實施例所繪示的控制搬運機移動以搬運承載物的示意圖。請參照圖2,接續於圖1的實施例,根據影像資料DATA(image),控制主機12可產生控制資料DATA(control)並將控制資料DATA(control)傳送至搬運機11。控制資料DATA(control)可包含指示搬運機11移動的控制訊號。FIG. 2 is a schematic diagram of controlling the movement of a transporter to transport a load according to an embodiment of the present invention. Referring to FIG. 2 , following the embodiment of FIG. 1 , according to the image data DATA(image), the control host 12 can generate the control data DATA(control) and transmit the control data DATA(control) to the transporter 11 . The control data DATA(control) may include control signals for instructing the transporter 11 to move.

根據控制資料DATA(control),搬運機11可響應於承載物13當前在實體空間中的姿態而移動至適於搬運承載物13的位置,如圖2所示。例如,在此位置上,搬運機11的延伸臂101與102可對齊承載物13的凹槽131與132。此時,搬運機11只要前進即可將延伸臂101與102插入至承載物13的凹槽131與132中以搬移承載物13。換言之,在一實施例中,控制資料DATA(control)適於驅使搬運機11將延伸臂101與102插入至承載物13的凹槽131與132,以藉由延伸臂101與102搬運承載物13。According to the control data DATA(control), the carrier 11 can move to a position suitable for carrying the carrier 13 in response to the current posture of the carrier 13 in the physical space, as shown in FIG. 2 . For example, in this position, the extension arms 101 and 102 of the carrier 11 can be aligned with the grooves 131 and 132 of the carrier 13 . At this time, as long as the carrier 11 moves forward, the extension arms 101 and 102 can be inserted into the grooves 131 and 132 of the carrier 13 to move the carrier 13 . In other words, in one embodiment, the control data DATA(control) is adapted to drive the carrier 11 to insert the extension arms 101 and 102 into the grooves 131 and 132 of the carrier 13 , so as to carry the carrier 13 by the extension arms 101 and 102 .

在圖2的一實施例中,在搬運機11的移動過程中,搬運機11可持續擷取目標影像並回傳對應的影像資料DATA(image)至控制主機12。根據持續接收到的影像資料DATA(image),控制主機12可藉由控制資料DATA(control)來持續修正搬運機11的移動軌跡,直到搬運機11移動至適於搬運承載物13的位置為止。In an embodiment of FIG. 2 , during the moving process of the transporter 11 , the transporter 11 can continuously capture target images and return corresponding image data DATA (image) to the control host 12 . According to the continuously received image data DATA(image), the control host 12 can continuously correct the moving trajectory of the carrier 11 through the control data DATA(control) until the carrier 11 moves to a position suitable for carrying the load 13 .

須注意的是,在另一實施例中,控制主機12亦可以結合至搬運機11內部。藉此,搬運機11可藉由自身的影像擷取以及資料處理機制來完成自動化的搬移動作。It should be noted that, in another embodiment, the control host 12 may also be integrated into the transporter 11 . In this way, the transporter 11 can complete the automatic transporting operation through its own image capturing and data processing mechanism.

圖3是根據本發明的一實施例所繪示的控制主機的功能方塊圖。請參照圖3,控制主機12包括處理器31、儲存電路32及輸出/輸出(I/O)界面33。處理器31用以控制控制主機12的整體或部分操作。例如,處理器31可包括中央處理單元(Central Processing Unit, CPU)、或是其他可程式化之一般用途或特殊用途的微處理器、數位訊號處理器(Digital Signal Processor, DSP)、可程式化控制器、特殊應用積體電路(Application Specific Integrated Circuits, ASIC)、可程式化邏輯裝置(Programmable Logic Device, PLD)或其他類似裝置或這些裝置的組合。須注意的是,在以下的實施例中,對於處理器31的說明等同於對於控制主機12的說明。FIG. 3 is a functional block diagram of a control host according to an embodiment of the present invention. Referring to FIG. 3 , the control host 12 includes a processor 31 , a storage circuit 32 and an output/output (I/O) interface 33 . The processor 31 is used to control the whole or part of the operation of the control host 12 . For example, the processor 31 may include a central processing unit (CPU), or other programmable general-purpose or special-purpose microprocessors, digital signal processors (DSP), programmable Controllers, Application Specific Integrated Circuits (ASICs), Programmable Logic Devices (PLDs) or other similar devices or combinations of these devices. It should be noted that, in the following embodiments, the description of the processor 31 is equivalent to the description of the control host 12 .

儲存電路32耦接至處理器31並用以儲存資料。例如,儲存電路32可包括揮發性儲存電路與非揮發性儲存電路。揮發性儲存電路用以揮發性地儲存資料。例如,揮發性儲存電路可包括隨機存取記憶體(Random Access Memory, RAM)或類似的揮發性儲存媒體。非揮發性儲存電路用以非揮發性地儲存資料。例如,非揮發性儲存電路可包括唯讀記憶體(Read Only Memory, ROM)、固態硬碟(solid state disk, SSD)及/或傳統硬碟(Hard disk drive, HDD)或類似的非揮發性儲存媒體。The storage circuit 32 is coupled to the processor 31 and used for storing data. For example, the storage circuit 32 may include a volatile storage circuit and a non-volatile storage circuit. The volatile storage circuit is used for volatile storage of data. For example, the volatile storage circuit may include random access memory (RAM) or similar volatile storage media. The non-volatile storage circuit is used for non-volatile storage of data. For example, the non-volatile storage circuit may include read only memory (ROM), solid state disk (SSD) and/or conventional hard disk drive (HDD) or similar non-volatile storage media.

輸出/輸出界面33耦接至處理器31並用以傳遞訊號。例如,處理器31可經由輸出/輸出界面33接收輸入訊號或者傳送輸出訊號。例如,輸出/輸出界面33可包括網路連接界面、滑鼠、鍵盤、螢幕、觸控面板、及/或揚聲器等各式輸入/輸出裝置。The output/output interface 33 is coupled to the processor 31 and used for transmitting signals. For example, the processor 31 may receive input signals or transmit output signals via the output/output interface 33 . For example, the output/output interface 33 may include various input/output devices such as a network connection interface, a mouse, a keyboard, a screen, a touch panel, and/or a speaker.

在一實施例中,儲存電路32可用以儲存影像資料301。例如,影像資料301可根據圖1的影像資料DATA(image)而儲存於儲存電路32。處理器31可從儲存電路32中讀取影像資料301並根據影像資料301產生圖2的控制資料DATA(control)。In one embodiment, the storage circuit 32 can be used to store the image data 301 . For example, the image data 301 may be stored in the storage circuit 32 according to the image data DATA(image) of FIG. 1 . The processor 31 can read the image data 301 from the storage circuit 32 and generate the control data DATA(control) in FIG. 2 according to the image data 301 .

在一實施例中,儲存電路32更儲存有影像辨識模組302。影像辨識模組302可執行機器視覺等影像辨識操作。處理器31可藉由影像辨識模組302對影像資料301(即目標影像的資料)執行影像辨識並根據辨識結果產生控制資料DATA(control)。影像辨識模組302可經訓練以從影像資料301中辨識目標物(例如圖1的承載物13)。特別是,影像辨識模組302可經訓練以提高對於目標物的辨識準確度。In one embodiment, the storage circuit 32 further stores the image recognition module 302 . The image recognition module 302 can perform image recognition operations such as machine vision. The processor 31 can perform image recognition on the image data 301 (that is, the data of the target image) through the image recognition module 302 and generate control data DATA(control) according to the recognition result. The image recognition module 302 can be trained to recognize a target object (eg, the carrier 13 of FIG. 1 ) from the image data 301 . In particular, the image recognition module 302 can be trained to improve the recognition accuracy of the target.

在一實施例中,影像辨識模組302亦可以實作為硬體電路。例如,影像辨識模組302的電路可實作於處理器31內部或者獨立於處理器31之外,本發明不加以限制。In one embodiment, the image recognition module 302 can also be implemented as a hardware circuit. For example, the circuit of the image recognition module 302 can be implemented inside the processor 31 or independent of the processor 31, which is not limited in the present invention.

在一實施例中,處理器31可經由影像辨識模組302分析影像資料301以獲得影像資料301中對應於承載物13的輪廓面資料。例如,處理器31可經由影像辨識模組302辨識目標影像中的一或多區域(亦稱為目標區域)。每一個目標區域包含由影像辨識模組302辨識出的承載物13的影像。然後,處理器31可根據所辨識出的目標區域來獲得影像資料301中對應於承載物的輪廓面資料。In one embodiment, the processor 31 can analyze the image data 301 through the image recognition module 302 to obtain the contour surface data corresponding to the carrier 13 in the image data 301 . For example, the processor 31 may identify one or more regions (also referred to as target regions) in the target image through the image recognition module 302 . Each target area includes the image of the carrier 13 recognized by the image recognition module 302 . Then, the processor 31 can obtain the contour surface data corresponding to the carrier in the image data 301 according to the identified target area.

圖4是根據本發明的一實施例所繪示的目標影像的示意圖。在本實施例中,影像41(即目標影像)中呈現了承載物13以及放置於承載物13上方的貨物15(或其他物品)。請參照圖3與圖4,在本實施例中,影像資料301可反映影像41。詳細來說,影像資料301可至少包含有影像41中的影像色彩資訊以及影像尺寸資訊。FIG. 4 is a schematic diagram of a target image according to an embodiment of the present invention. In this embodiment, the image 41 (ie, the target image) presents the carrier 13 and the goods 15 (or other items) placed above the carrier 13 . Please refer to FIG. 3 and FIG. 4 , in this embodiment, the image data 301 can reflect the image 41 . Specifically, the image data 301 may at least include image color information and image size information in the image 41 .

在一實施例中,處理器31可經由影像辨識模組302分析影像資料301以辨識影像41中的承載物13。影像辨識模組302可將承載物13所在的區域範圍圈選為區域401。換言之,區域401中包含由影像辨識模組302辨識出的承載物13的至少部分影像。In one embodiment, the processor 31 can analyze the image data 301 through the image recognition module 302 to recognize the carrier 13 in the image 41 . The image recognition module 302 can circle the area where the carrier 13 is located as the area 401 . In other words, the area 401 includes at least a part of the image of the carrier 13 recognized by the image recognition module 302 .

圖5是根據本發明的一實施例所繪示的承載物的輪廓影像的示意圖。請參照圖3與圖5,接續於圖4的實施例,處理器31可根據影像辨識模組302對於承載物13的辨識結果產生影像51。例如,處理器31可根據影像辨識模組302對於承載物13的辨識結果將圖4的區域401以外的影像資料濾除以產生影像51。因此,影像51可(僅)包含區域401內的承載物13的輪廓501。在一實施例中,將區域401以外的影像資料濾除之操作亦可以視為是將承載物13之影像以外的背景影像濾除。在一實施例中,影像51亦稱為承載物13的輪廓影像。處理器31可分析輪廓501所涵蓋的影像範圍內的影像資料來獲得原始的影像資料301中對應於承載物13的像素分布之資訊。然後,處理器31可根據此像素分布之資訊產生所述承載物13的特徵資料。FIG. 5 is a schematic diagram of a contour image of a carrier according to an embodiment of the present invention. Referring to FIG. 3 and FIG. 5 , following the embodiment of FIG. 4 , the processor 31 can generate an image 51 according to the recognition result of the carrier 13 by the image recognition module 302 . For example, the processor 31 can filter out the image data other than the area 401 in FIG. 4 to generate the image 51 according to the recognition result of the carrier 13 by the image recognition module 302 . Thus, the image 51 may (only) contain the outline 501 of the carrier 13 within the area 401 . In one embodiment, the operation of filtering out the image data other than the area 401 can also be regarded as filtering out the background image other than the image of the carrier 13 . In one embodiment, the image 51 is also referred to as an outline image of the carrier 13 . The processor 31 can analyze the image data within the image range covered by the outline 501 to obtain information corresponding to the pixel distribution of the carrier 13 in the original image data 301 . Then, the processor 31 can generate characteristic data of the carrier 13 according to the pixel distribution information.

圖6是根據本發明的一實施例所繪示的承載物的特徵資料的示意圖。請參照圖3與圖6,接續於圖5的實施例,承載物13的輪廓501可由多個像素點61組成。每一個像素點61亦可稱為特徵點。每一個像素點61在虛擬空間u-v中都對應到一個虛擬座標。虛擬空間u-v由u軸平面與v軸平面組成。u軸平面與v軸平面彼此垂直。FIG. 6 is a schematic diagram of characteristic data of a carrier according to an embodiment of the present invention. Referring to FIGS. 3 and 6 , following the embodiment of FIG. 5 , the outline 501 of the carrier 13 may be composed of a plurality of pixel points 61 . Each pixel point 61 can also be called a feature point. Each pixel point 61 corresponds to a virtual coordinate in the virtual space u-v. The virtual space u-v consists of the u-axis plane and the v-axis plane. The u-axis plane and the v-axis plane are perpendicular to each other.

在一實施例中,處理器31可根據像素點61的分布狀態決定承載物13在虛擬空間u-v中的特徵向量601與602。特徵向量601反映圖5的輪廓501之長軸在虛擬空間u-v中的位置。特徵向量602反映輪廓501之短軸在虛擬空間u-v中的位置。特徵向量601與602可共同反映承載物13在虛擬空間u-v中的姿態。In one embodiment, the processor 31 may determine the feature vectors 601 and 602 of the carrier 13 in the virtual space u-v according to the distribution state of the pixel points 61 . The feature vector 601 reflects the position of the long axis of the contour 501 of FIG. 5 in the virtual space u-v. The feature vector 602 reflects the position of the short axis of the contour 501 in the virtual space u-v. The feature vectors 601 and 602 can jointly reflect the posture of the carrier 13 in the virtual space u-v.

在一實施例中,處理器31可獲得特徵向量601與602在虛擬空間u-v中與一個參考平面603之間的夾角Ø之資訊。處理器31可根據夾角Ø之資訊獲得承載物13在實體空間中與搬運機11之間的相對位置關係。然後,處理器31可根據此相對位置關係產生控制資料DATA(control)。In one embodiment, the processor 31 can obtain information about the included angle Ø between the feature vectors 601 and 602 in the virtual space u-v and a reference plane 603 . The processor 31 can obtain the relative positional relationship between the carrier 13 and the transporter 11 in the physical space according to the information of the included angle Ø. Then, the processor 31 can generate control data DATA(control) according to the relative positional relationship.

圖7是根據本發明的一實施例所繪示的控制搬運機移動以搬運承載物的示意圖。請參照圖3與圖7,接續於圖6的實施例,在一實施例中,處理器31可將虛擬空間u-v中的夾角Ø映射至實體空間中的夾角ϴ。此映射可藉由一個轉換方程式來完成。此夾角ϴ可反映搬運機11的延伸臂101與102與承載物13的凹槽131與132之間的一個角度差。處理器31可根據此夾角ϴ產生控制資料DATA(control)。藉此,控制資料DATA(control)可驅使搬運機11移動至適於搬運承載物13的位置,且搬運機11的移動量滿足夾角ϴ所定義的角度差。在此位置上,搬運機11的延伸臂101與102可對齊承載物13的凹槽131與132。FIG. 7 is a schematic diagram of controlling the movement of a transporter to transport a load according to an embodiment of the present invention. 3 and FIG. 7, following the embodiment of FIG. 6, in one embodiment, the processor 31 may map the angle Ø in the virtual space u-v to the angle ϴ in the physical space. This mapping can be accomplished by a conversion equation. The included angle ϴ can reflect an angle difference between the extension arms 101 and 102 of the carrier 11 and the grooves 131 and 132 of the carrier 13 . The processor 31 can generate control data DATA(control) according to the included angle ϴ. Thereby, the control data DATA(control) can drive the transporter 11 to move to a position suitable for carrying the load 13, and the movement amount of the transporter 11 satisfies the angle difference defined by the included angle ϴ. In this position, the extending arms 101 and 102 of the carrier 11 can be aligned with the grooves 131 and 132 of the carrier 13 .

在一實施例中,所獲得的輪廓面資料亦可包含承載物13的不同側面之影像的輪廓資料。處理器31可根據承載物13的不同側面之影像的輪廓資料來產生相對應的特徵資料。In one embodiment, the obtained contour surface data may also include contour data of images of different sides of the carrier 13 . The processor 31 can generate corresponding characteristic data according to the contour data of the images of different side surfaces of the carrier 13 .

圖8是根據本發明的一實施例所繪示的承載物的輪廓影像的示意圖。請參照圖3與圖8,在一實施例中,假設影像81為目標影像。處理器31可經由影像辨識模組302從影像81中識別出輪廓面801與802。輪廓面801包含承載物13的某一側面(亦稱為第一側面)之至少部分影像。輪廓面802包含承載物13的另一側面(亦稱為第二側面)之至少部分影像。處理器31可根據影像辨識模組302的辨識結果獲得影像資料301中對應於輪廓面801的輪廓面資料(亦稱為第一輪廓面資料)以及影像資料301中對應於輪廓面802的輪廓面資料(亦稱為第二輪廓面資料)。換言之,第一輪廓面資料包括影像資料301中與承載物13的第一側面之影像有關的資料,而第二輪廓面資料則包括影像資料301中與承載物13的第二側面之影像有關的資料。處理器31可根據第一輪廓面資料與第二輪廓面資料產生承載物13的特徵資料。FIG. 8 is a schematic diagram of a contour image of a carrier according to an embodiment of the present invention. Referring to FIG. 3 and FIG. 8 , in one embodiment, it is assumed that the image 81 is the target image. The processor 31 can recognize the contour surfaces 801 and 802 from the image 81 through the image recognition module 302 . The contour surface 801 includes at least a partial image of a side (also referred to as the first side) of the carrier 13 . The contour surface 802 includes at least a partial image of the other side (also referred to as the second side) of the carrier 13 . The processor 31 can obtain, according to the recognition result of the image recognition module 302 , the contour surface data (also referred to as the first contour surface data) corresponding to the contour surface 801 in the image data 301 and the contour surface corresponding to the contour surface 802 in the image data 301 data (also known as the second profile data). In other words, the first contour surface data includes data in the image data 301 related to the image of the first side surface of the carrier 13 , and the second contour surface data includes data in the image data 301 related to the image of the second side surface of the carrier 13 . material. The processor 31 can generate characteristic data of the carrier 13 according to the first profile data and the second profile data.

在一實施例中,處理器31可獲得第一輪廓面資料與第二輪廓面資料的至少其中之一所反映的輪廓比例。處理器31可根據此輪廓比例產生承載物13的特徵資料。例如,處理器31可分別統計輪廓面801與802中於某一軸向上的像素點的總數以獲得長度D1與D2。長度D1與D2可分別反映輪廓面801與802在承載物13的總輪廓中的長度占比。處理器31可根據長度D1與D2來產生承載物13的特徵資料。然後,處理器31可根據此特徵資料產生控制資料DATA(control)。In one embodiment, the processor 31 can obtain the contour ratio reflected by at least one of the first contour surface data and the second contour surface data. The processor 31 can generate characteristic data of the carrier 13 according to the outline ratio. For example, the processor 31 may count the total number of pixels on a certain axis in the contour surfaces 801 and 802 to obtain the lengths D1 and D2, respectively. The lengths D1 and D2 can respectively reflect the length ratios of the contour surfaces 801 and 802 in the overall contour of the carrier 13 . The processor 31 can generate characteristic data of the carrier 13 according to the lengths D1 and D2. Then, the processor 31 can generate control data DATA(control) according to the characteristic data.

在一實施例中,處理器31可將長度D1與D2的比例作為承載物13的特徵資料。處理器31可將長度D1與D2的比例映射到實體空間中的夾角ϴ。此映射可藉由一個轉換方程式來完成。處理器31可根據此夾角ϴ產生控制資料DATA(control),以驅使搬運機11移動至適於搬運承載物13的位置,且搬運機11的移動量滿足夾角ϴ所定義的角度差。具體的操作細節如圖7的實施例所述,在此不重複贅述。In one embodiment, the processor 31 may use the ratio of the lengths D1 and D2 as the characteristic data of the carrier 13 . The processor 31 may map the ratio of the lengths D1 and D2 to the included angle ϴ in the physical space. This mapping can be accomplished by a conversion equation. The processor 31 can generate control data DATA(control) according to the included angle ϴ, so as to drive the transporter 11 to move to a position suitable for carrying the load 13, and the movement amount of the transporter 11 satisfies the angle difference defined by the included angle ϴ. The specific operation details are as described in the embodiment of FIG. 7 , which will not be repeated here.

在一實施例中,處理器31亦可根據所獲得的特徵資料(例如圖6中的特徵向量601與602)來評估承載物在實體空間中的位置資訊及姿態資訊。處理器31可根據此些資訊來產生所述控制資料DATA(control)。In one embodiment, the processor 31 can also evaluate the position information and attitude information of the carrier in the physical space according to the obtained feature data (eg, the feature vectors 601 and 602 in FIG. 6 ). The processor 31 can generate the control data DATA(control) according to the information.

須注意的是,前述實施例皆是針對實體空間中的單一個承載物進行影像辨識以及特徵資料的提取等操作,藉此驅動搬運機移動至適當的位置來對此承載物進行搬運。然而,在另一實施例中,即便實體空間中存在多個承載物(可彼此堆疊或分散),控制主機也可依照前述實施例中提及的操作手段而逐一針對此些承載物執行影像辨識並指示搬運機自動執行後續的搬運行為。It should be noted that, in the aforementioned embodiments, operations such as image recognition and feature data extraction are performed on a single carrier in the physical space, thereby driving the carrier to move to an appropriate position to carry the carrier. However, in another embodiment, even if there are multiple bearers (which can be stacked or dispersed) in the physical space, the control host can perform image recognition for these bearers one by one according to the operation means mentioned in the previous embodiment. And instruct the handling machine to automatically perform subsequent handling behaviors.

本發明的一實施例也提出一種非揮發性電腦可讀記錄媒體。此非揮發性電腦可讀記錄媒體儲存有程式碼。電腦中的處理器(例如圖3的處理器31)可執行(或運行)此程式碼以執行前述提及的各項功能與操作。An embodiment of the present invention also provides a non-volatile computer-readable recording medium. The non-volatile computer-readable recording medium has program codes stored thereon. A processor in the computer (eg, the processor 31 in FIG. 3 ) can execute (or run) the code to perform the functions and operations mentioned above.

圖9是根據本發明的一實施例所繪示的搬運機控制方法的流程圖。請參照圖9,在步驟S901中,分析影像資料以獲得所述影像資料中對應於承載物的輪廓面資料。在步驟S902中,分析所述輪廓面資料以獲得所述承載物的特徵資料,其中所述特徵資料反映所述承載物在實體空間中的姿態。在步驟S903中,根據所述特徵資料產生控制資料,其中所述控制資料適於控制所述搬運機響應於所述承載物在所述實體空間中的所述姿態來搬運所述承載物。FIG. 9 is a flowchart of a method for controlling a transporter according to an embodiment of the present invention. Referring to FIG. 9 , in step S901 , the image data is analyzed to obtain contour surface data corresponding to the carrier in the image data. In step S902, the profile data is analyzed to obtain characteristic data of the carrier, wherein the characteristic data reflects the posture of the carrier in the physical space. In step S903, control data is generated according to the characteristic data, wherein the control data is suitable for controlling the carrier to carry the carrier in response to the posture of the carrier in the physical space.

然而,圖9中各步驟已詳細說明如上,在此便不再贅述。值得注意的是,圖9中各步驟可以實作為多個程式碼(例如軟體模組)或是電路(例如電路模組),本揭露不加以限制。此外,圖9的方法可以搭配以上範例實施例使用,也可以單獨使用,本揭露不加以限制。However, each step in FIG. 9 has been described in detail as above, and will not be repeated here. It should be noted that, each step in FIG. 9 may be implemented as a plurality of codes (eg, software modules) or circuits (eg, circuit modules), which are not limited in the present disclosure. In addition, the method of FIG. 9 can be used in conjunction with the above exemplary embodiments, and can also be used alone, which is not limited by the present disclosure.

綜上所述,主控裝置可根據所獲得的影像資料中與承載物有關的資訊來評估承載物在實體空間中的姿態,進而根據此姿態來驅使搬運機自動移動至合適的位置來搬運此承載物。在一實施例中,即便承載物在實體空間中的擺放位置及/或擺放角度是不規則的,搬運機仍可自動調整延伸臂的相對於承載物的插入角度,以順利舉起並搬運此承載物。藉此,可有效提高搬運機執行自動化貨物搬運的效率。To sum up, the main control device can evaluate the attitude of the load in the physical space according to the information related to the load in the obtained image data, and then drive the transporter to automatically move to a suitable position to carry the load according to the attitude. bearer. In one embodiment, even if the placement position and/or placement angle of the carrier in the physical space is irregular, the handling machine can still automatically adjust the insertion angle of the extension arm relative to the carrier, so as to smoothly lift and hold the carrier. Carry this load. In this way, the efficiency of the handling machine in performing automated cargo handling can be effectively improved.

雖然本揭露已以實施例揭露如上,然其並非用以限定本揭露,任何所屬技術領域中具有通常知識者,在不脫離本揭露的精神和範圍內,當可作些許的更動與潤飾,故本揭露的保護範圍當視後附的申請專利範圍所界定者為準。Although the present disclosure has been disclosed above with examples, it is not intended to limit the present disclosure. Anyone with ordinary knowledge in the technical field may make some changes and modifications without departing from the spirit and scope of the present disclosure. The scope of protection of the present disclosure shall be determined by the scope of the appended patent application.

10:搬運機控制系統 11:搬運機 101, 102:延伸臂 103:影像擷取介面 12:控制主機 13:承載物 15:貨物 131, 132:凹槽 DATA(image):影像資料 DATA(control):控制資料 31:處理器 32:儲存電路 301:影像資料 302:影像辨識模組 33:輸出/輸出界面 41, 51, 81:影像 401:區域 501:承載物的輪廓 61:像素點 601, 602:特徵向量 603:參考平面 801, 802:輪廓面 D1, D2:距離 S901~S903:步驟 10: Handling machine control system 11: Transporter 101, 102: Extension Arm 103: Image capture interface 12: Control host 13: Bearer 15: Cargo 131, 132: Grooves DATA(image): image data DATA(control): control data 31: Processor 32: Storage circuit 301: Video data 302: Image recognition module 33: Output/Output interface 41, 51, 81: Images 401: Area 501: Outline of the carrier 61: Pixels 601, 602: Eigenvectors 603: Reference plane 801, 802: Profile Surface D1, D2: Distance S901~S903: Steps

圖1是根據本發明的一實施例所繪示的搬運機控制系統的示意圖。 圖2是根據本發明的一實施例所繪示的控制搬運機移動以搬運承載物的示意圖。 圖3是根據本發明的一實施例所繪示的控制主機的功能方塊圖。 圖4是根據本發明的一實施例所繪示的目標影像的示意圖。 圖5是根據本發明的一實施例所繪示的承載物的輪廓影像的示意圖。 圖6是根據本發明的一實施例所繪示的承載物的特徵資料的示意圖。 圖7是根據本發明的一實施例所繪示的控制搬運機移動以搬運承載物的示意圖。 圖8是根據本發明的一實施例所繪示的承載物的輪廓影像的示意圖。 圖9是根據本發明的一實施例所繪示的搬運機控制方法的流程圖。 FIG. 1 is a schematic diagram of a handling machine control system according to an embodiment of the present invention. FIG. 2 is a schematic diagram of controlling the movement of a transporter to transport a load according to an embodiment of the present invention. FIG. 3 is a functional block diagram of a control host according to an embodiment of the present invention. FIG. 4 is a schematic diagram of a target image according to an embodiment of the present invention. FIG. 5 is a schematic diagram of a contour image of a carrier according to an embodiment of the present invention. FIG. 6 is a schematic diagram of characteristic data of a carrier according to an embodiment of the present invention. FIG. 7 is a schematic diagram of controlling the movement of a transporter to transport a load according to an embodiment of the present invention. FIG. 8 is a schematic diagram of a contour image of a carrier according to an embodiment of the present invention. FIG. 9 is a flowchart of a method for controlling a transporter according to an embodiment of the present invention.

S901~S903:步驟 S901~S903: Steps

Claims (21)

一種搬運機控制方法,包括: 分析一影像資料以獲得該影像資料中對應於一承載物的一輪廓面資料; 分析該輪廓面資料以獲得該承載物的一特徵資料,其中該特徵資料反映該承載物在一實體空間中的姿態;以及 根據該特徵資料產生一控制資料,其中該控制資料適於控制該搬運機響應於該承載物在該實體空間中的該姿態來搬運該承載物。 A handling machine control method, comprising: analyzing an image data to obtain a profile surface data corresponding to a carrier in the image data; analyzing the profile data to obtain a characteristic data of the carrier, wherein the characteristic data reflects the posture of the carrier in a physical space; and A control data is generated according to the characteristic data, wherein the control data is suitable for controlling the carrier to carry the carrier in response to the posture of the carrier in the physical space. 如請求項1所述的搬運機控制方法,更包括: 由一影像擷取介面擷取一目標影像,其中該目標影像包括該承載物的至少一部分影像;以及 根據所擷取的該目標影像產生該影像資料。 The handling machine control method according to claim 1, further comprising: capturing a target image by an image capture interface, wherein the target image includes at least a part of the image of the carrier; and The image data is generated according to the captured target image. 如請求項2所述的搬運機控制方法,其中該影像擷取介面設置於該搬運機上。The transporter control method according to claim 2, wherein the image capturing interface is disposed on the transporter. 如請求項1所述的搬運機控制方法,其中分析該影像之步驟包括: 藉由一影像辨識模組對該影像資料執行一影像辨識,且該影像辨識模組經訓練以從該影像資料中辨識該承載物。 The handling machine control method of claim 1, wherein the step of analyzing the image comprises: An image recognition is performed on the image data by an image recognition module, and the image recognition module is trained to recognize the carrier from the image data. 如請求項1所述的搬運機控制方法,其中分析該輪廓面資料以獲得該承載物的該特徵資料之步驟包括: 分析該輪廓面資料以獲得該影像資料中對應於該承載物的一像素分布之資訊;以及 根據該像素分布之資訊產生該特徵資料。 The handling machine control method as claimed in claim 1, wherein the step of analyzing the profile data to obtain the characteristic data of the carrier comprises: analyzing the profile data to obtain information on a pixel distribution in the image data corresponding to the carrier; and The characteristic data is generated according to the information of the pixel distribution. 如請求項5所述的搬運機控制方法,其中根據該像素分布之資訊產生該特徵資料之步驟包括: 根據該像素分布之資訊產生一特徵向量,其中該特徵向量用以反映該承載物在一虛擬空間中的姿態。 The conveyer control method according to claim 5, wherein the step of generating the characteristic data according to the information of the pixel distribution comprises: A feature vector is generated according to the information of the pixel distribution, wherein the feature vector is used to reflect the posture of the carrier in a virtual space. 如請求項6所述的搬運機控制方法,其中根據該特徵資料產生該控制資料之步驟包括: 獲得該特徵向量在該虛擬空間中與一參考平面之間的一夾角之資訊; 根據該夾角之資訊獲得該承載物在該實體空間中與該搬運機之間的一相對位置關係;以及 根據該相對位置關係產生該控制資料。 The method for controlling a transporter according to claim 6, wherein the step of generating the control data according to the characteristic data comprises: obtaining information about an included angle between the feature vector in the virtual space and a reference plane; Obtain a relative positional relationship between the carrier and the carrier in the physical space according to the information of the included angle; and The control data is generated according to the relative positional relationship. 如請求項1所述的搬運機控制方法,其中該輪廓面資料包括一第一輪廓面資料與一第二輪廓面資料,且分析該輪廓面資料以獲得該承載物的該特徵資料之步驟包括: 獲得該第一輪廓面資料與該第二輪廓面資料的至少其中之一所反映的一輪廓比例;以及 根據該輪廓比例產生該特徵資料。 The handling method of claim 1, wherein the profile data includes a first profile data and a second profile data, and the step of analyzing the profile data to obtain the characteristic data of the carrier includes the following steps: : obtaining a profile ratio reflected by at least one of the first profile data and the second profile data; and The characteristic data is generated according to the outline ratio. 如請求項8所述的搬運機控制方法,其中該第一輪廓面資料包括該影像資料中與該承載物的一第一側面之影像有關的資料,且該第二輪廓面資料包括該影像資料中與該承載物的一第二側面之影像有關的資料。The handling method of claim 8, wherein the first contour surface data includes data related to an image of a first side surface of the carrier in the image data, and the second contour surface data includes the image data information in relation to an image of a second side face of the carrier. 如請求項1所述的搬運機控制方法,其中該控制資料適於驅使該搬運機將一延伸臂插入至該承載物的一插入口,以藉由該延伸臂搬運該承載物。The control method for a transporter as claimed in claim 1, wherein the control data is adapted to drive the transporter to insert an extension arm into an insertion opening of the carrier, so as to transport the carrier by the extension arm. 一種搬運機控制系統,包括: 一搬運機;以及 一控制主機,耦接至該搬運機, 其中該控制主機用以分析一影像資料以獲得該影像資料中對應於一承載物的一輪廓面資料, 該控制主機更用以分析該輪廓面資料以獲得該承載物的一特徵資料,其中該特徵資料反映該承載物在一實體空間中的姿態, 該控制主機更用以根據該特徵資料產生一控制資料,並且 該搬運機用以根據該控制資料而響應於該承載物在該實體空間中的該姿態來搬運該承載物。 A handling machine control system, comprising: a handling machine; and a control host, coupled to the handling machine, Wherein the control host is used for analyzing an image data to obtain a profile data corresponding to a carrier in the image data, The control host is further used for analyzing the profile data to obtain a characteristic data of the carrier, wherein the characteristic data reflects the posture of the carrier in a physical space, The control host is further configured to generate a control data according to the characteristic data, and The transporter is used for transporting the carrier in response to the posture of the carrier in the physical space according to the control data. 如請求項11所述的搬運機控制系統,更包括: 一影像擷取介面,耦接至該控制主機, 其中該影像擷取介面用以擷取一目標影像,該目標影像包括該承載物的至少一部分影像,並且 該影像擷取介面更用以根據所擷取的該目標影像產生該影像資料。 The handling machine control system according to claim 11, further comprising: an image capture interface, coupled to the control host, Wherein the image capture interface is used to capture a target image, the target image includes at least a part of the image of the carrier, and The image capturing interface is further used for generating the image data according to the captured target image. 如請求項12所述的搬運機控制系統,其中該影像擷取介面設置於該搬運機上。The transporter control system of claim 12, wherein the image capture interface is disposed on the transporter. 如請求項11所述的搬運機控制系統,其中分析該影像之操作包括: 藉由一影像辨識模組對該影像資料執行一影像辨識,且該影像辨識模組經訓練以從該影像資料中辨識該承載物。 The handler control system of claim 11, wherein analyzing the image comprises: An image recognition is performed on the image data by an image recognition module, and the image recognition module is trained to recognize the carrier from the image data. 如請求項11所述的搬運機控制系統,其中分析該輪廓面資料以獲得該承載物的該特徵資料之操作包括: 分析該輪廓面資料以獲得該影像資料中對應於該承載物的一像素分布之資訊;以及 根據該像素分布之資訊產生該特徵資料。 The handler control system of claim 11, wherein the operation of analyzing the profile data to obtain the characteristic data of the carrier comprises: analyzing the profile data to obtain information on a pixel distribution in the image data corresponding to the carrier; and The characteristic data is generated according to the information of the pixel distribution. 如請求項15所述的搬運機控制系統,其中根據該像素分布之資訊產生該特徵資料之操作包括: 根據該像素分布之資訊產生一特徵向量,其中該特徵向量用以反映該承載物在一虛擬空間中的姿態。 The transporter control system according to claim 15, wherein the operation of generating the characteristic data according to the information of the pixel distribution comprises: A feature vector is generated according to the information of the pixel distribution, wherein the feature vector is used to reflect the posture of the carrier in a virtual space. 如請求項16所述的搬運機控制系統,其中根據該特徵資料產生該控制資料之操作包括: 獲得該特徵向量在該虛擬空間中與一參考平面之間的一夾角之資訊; 根據該夾角之資訊獲得該承載物在該實體空間中與該搬運機之間的一相對位置關係;以及 根據該相對位置關係產生該控制資料。 The handling machine control system of claim 16, wherein the operation of generating the control data according to the characteristic data comprises: obtaining information about an included angle between the feature vector in the virtual space and a reference plane; Obtain a relative positional relationship between the carrier and the carrier in the physical space according to the information of the included angle; and The control data is generated according to the relative positional relationship. 如請求項11所述的搬運機控制系統,其中該輪廓面資料包括一第一輪廓面資料與一第二輪廓面資料,且分析該輪廓面資料以獲得該承載物的該特徵資料之操作包括: 獲得該第一輪廓面資料與該第二輪廓面資料的至少其中之一所反映的一輪廓比例;以及 根據該輪廓比例產生該特徵資料。 The handling machine control system of claim 11, wherein the profile data includes a first profile data and a second profile data, and the operation of analyzing the profile data to obtain the characteristic data of the carrier comprises: : obtaining a profile ratio reflected by at least one of the first profile data and the second profile data; and The characteristic data is generated according to the outline ratio. 如請求項18所述的搬運機控制系統,其中該第一輪廓面資料包括該影像資料中與該承載物的一第一側面之影像有關的資料,且該第二輪廓面資料包括該影像資料中與該承載物的一第二側面之影像有關的資料。The handler control system of claim 18, wherein the first profile data includes data related to an image of a first side surface of the carrier in the image data, and the second profile data includes the image data information in relation to an image of a second side face of the carrier. 如請求項11所述的搬運機控制系統,其中該搬運機更用以根據該控制資料而將一延伸臂插入至該承載物的一插入口,以藉由該延伸臂搬運該承載物。The transporter control system of claim 11, wherein the transporter is further configured to insert an extension arm into an insertion port of the carrier according to the control data, so as to transport the carrier by the extension arm. 一種非揮發性電腦可讀記錄媒體,其中該非揮發性電腦可讀記錄媒體儲存有程式碼,且該程式碼經一處理器執行以: 分析一影像資料以獲得該影像資料中對應於一承載物的一輪廓面資料; 分析該輪廓面資料以獲得該承載物的一特徵資料,其中該特徵資料反映該承載物在一實體空間中的姿態;以及 根據該特徵資料產生一控制資料,其中該控制資料適於控制該搬運機響應於該承載物在該實體空間中的該姿態來搬運該承載物。 A non-volatile computer-readable recording medium, wherein the non-volatile computer-readable recording medium stores program code, and the program code is executed by a processor to: analyzing an image data to obtain a profile surface data corresponding to a carrier in the image data; analyzing the profile data to obtain a characteristic data of the carrier, wherein the characteristic data reflects the posture of the carrier in a physical space; and A control data is generated according to the characteristic data, wherein the control data is suitable for controlling the carrier to carry the carrier in response to the posture of the carrier in the physical space.
TW109144957A 2020-12-18 2020-12-18 Method and system for controlling a handling machine and non-volatile computer readable recording medium TWI770726B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW109144957A TWI770726B (en) 2020-12-18 2020-12-18 Method and system for controlling a handling machine and non-volatile computer readable recording medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW109144957A TWI770726B (en) 2020-12-18 2020-12-18 Method and system for controlling a handling machine and non-volatile computer readable recording medium

Publications (2)

Publication Number Publication Date
TW202226137A true TW202226137A (en) 2022-07-01
TWI770726B TWI770726B (en) 2022-07-11

Family

ID=83436790

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109144957A TWI770726B (en) 2020-12-18 2020-12-18 Method and system for controlling a handling machine and non-volatile computer readable recording medium

Country Status (1)

Country Link
TW (1) TWI770726B (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8958907B2 (en) * 2011-03-31 2015-02-17 Sinfonia Technology Co., Ltd. Robot arm apparatus
CN107324041B (en) * 2016-04-29 2019-11-26 上海微电子装备(集团)股份有限公司 Manipulator and automatic film magazine handling device for film magazine clamping
TWI626704B (en) * 2016-08-29 2018-06-11 樹德科技大學 Automatic ic transporting system with image recognition function and transporting method thereof
TWM589626U (en) * 2019-07-01 2020-01-21 日商Airobot股份有限公司 Autonomous mobile handling robot and its carrying member

Also Published As

Publication number Publication date
TWI770726B (en) 2022-07-11

Similar Documents

Publication Publication Date Title
US10596701B1 (en) Robotic system with enhanced scanning mechanism
US20240078512A1 (en) Robotic system with automated object detection mechanism and methods of operating the same
US10679379B1 (en) Robotic system with dynamic packing mechanism
JP2019509559A (en) Box location, separation, and picking using a sensor-guided robot
CN110599544B (en) Workpiece positioning method and device based on machine vision
CN114820772B (en) System and method for object detection based on image data
EP3766644A1 (en) Workpiece picking device and workpiece picking method
Arpenti et al. RGB-D recognition and localization of cases for robotic depalletizing in supermarkets
US11772271B2 (en) Method and computing system for object recognition or object registration based on image classification
US20230381971A1 (en) Method and computing system for object registration based on image classification
CN115546300A (en) Method and device for identifying pose of tray placed tightly, computer equipment and medium
TWI770726B (en) Method and system for controlling a handling machine and non-volatile computer readable recording medium
CN114092428A (en) Image data processing method, image data processing device, electronic equipment and storage medium
WO2024016633A1 (en) Article sorting method and apparatus, and computer-readable storage medium
US20220194762A1 (en) Method and system for controlling a handling machine and non-volatile computer readable recording medium
CN116468791A (en) Unstacking positioning method, unstacking positioning device, unstacking positioning system and storage medium
WO2023082417A1 (en) Grabbing point information obtaining method and apparatus, electronic device, and storage medium
WO2023213070A1 (en) Method and apparatus for obtaining goods pose based on 2d camera, device, and storage medium
CN111687829B (en) Anti-collision control method, device, medium and terminal based on depth vision
CN114022342A (en) Acquisition method and device for acquisition point information, electronic equipment and storage medium
US20230161348A1 (en) Handling machine control method, handling machine control system and control host
EP4349745A1 (en) Methods, systems, and computer program products for executing partial depalletization operations in robotic depalletization
EP4309858A1 (en) Methods, systems, and computer program products for reachability constraint manipulation for height thresholded scenarios in robotic depalletization
US11806882B1 (en) Robotic picking system and method of use
US20220366694A1 (en) Method and computing systems for performing object detection