TW202226137A - Method and system for controlling a handling machine and non-volatile computer readable recording medium - Google Patents
Method and system for controlling a handling machine and non-volatile computer readable recording medium Download PDFInfo
- Publication number
- TW202226137A TW202226137A TW109144957A TW109144957A TW202226137A TW 202226137 A TW202226137 A TW 202226137A TW 109144957 A TW109144957 A TW 109144957A TW 109144957 A TW109144957 A TW 109144957A TW 202226137 A TW202226137 A TW 202226137A
- Authority
- TW
- Taiwan
- Prior art keywords
- data
- carrier
- image
- control
- profile
- Prior art date
Links
Images
Landscapes
- Feeding Of Articles To Conveyors (AREA)
- Manipulator (AREA)
- Image Analysis (AREA)
Abstract
Description
本發明是有關於一種搬運機控制技術,且特別是有關於一種搬運機控制方法、系統及非揮發性電腦可讀記錄媒體。The present invention relates to a conveyer control technology, and more particularly, to a conveyer control method, system and non-volatile computer-readable recording medium.
隨著人們的交易型態改變以及智慧倉儲等自動化的物流管理需求逐漸增加,越來越多的物流業者希望改為採用自動化的搬運裝置來自主完成貨物的搬運以及貨物上下架。然而,現有的影像辨識技術並無法直接套用於物流管理系統中。原因在於,待搬運貨物及/或乘載貨物的棧板在實體空間中往往是不規則地排列。因此,即便搬運裝置可以辨識出需要搬運的貨物,但其仍無法準確控制延伸臂或者夾具以特定角度插入至貨物下方的棧板凹槽中,以對棧板連同上方的貨物進行搬運。此外,待搬運貨物的包裝及/或乘載貨物的棧板的外觀上也可能具有瑕疵或發生破損,從而增加影像辨識的難度。With the change of people's transaction patterns and the increasing demand for automated logistics management such as smart warehousing, more and more logistics companies hope to use automated handling devices to independently complete the handling of goods and the loading and unloading of goods. However, the existing image recognition technology cannot be directly applied to the logistics management system. The reason is that the goods to be handled and/or the pallets carrying the goods are often arranged irregularly in the physical space. Therefore, even if the handling device can identify the goods to be handled, it still cannot accurately control the extension arm or the clamp to be inserted into the pallet groove under the goods at a specific angle, so as to carry the pallet together with the goods above. In addition, the packaging of the goods to be transported and/or the pallets carrying the goods may also have defects or damage in appearance, which increases the difficulty of image recognition.
本發明提供一種搬運機控制方法、系統及非揮發性電腦可讀記錄媒體,可提高搬運機執行自動化貨物搬運的效率。The present invention provides a handling machine control method, system and non-volatile computer-readable recording medium, which can improve the efficiency of the handling machine in performing automated cargo handling.
本發明的實施例提供一種搬運機控制方法,其包括:分析影像資料以獲得所述影像資料中對應於承載物的輪廓面資料;分析所述輪廓面資料以獲得所述承載物的特徵資料,其中所述特徵資料反映所述承載物在實體空間中的姿態;以及根據所述特徵資料產生控制資料,其中所述控制資料適於控制所述搬運機響應於所述承載物在所述實體空間中的所述姿態來搬運所述承載物。An embodiment of the present invention provides a method for controlling a transporter, which includes: analyzing image data to obtain profile data corresponding to a carrier in the image data; analyzing the profile data to obtain feature data of the carrier, wherein the characteristic data reflects the posture of the carrying object in the physical space; and control data is generated according to the characteristic data, wherein the control data is adapted to control the handling machine in response to the carrying object in the physical space in the posture to carry the load.
本發明的實施例另提供一種搬運機控制系統,其包括搬運機以及控制主機。所述控制主機耦接至所述搬運機。所述控制主機用以分析影像資料以獲得所述影像資料中對應於承載物的輪廓面資料。所述控制主機更用以分析所述輪廓面資料以獲得所述承載物的特徵資料,其中所述特徵資料反映所述承載物在實體空間中的姿態。所述控制主機更用以根據所述特徵資料產生控制資料。所述搬運機用以根據所述控制資料而響應於所述承載物在所述實體空間中的所述姿態來搬運所述承載物。Embodiments of the present invention further provide a handling machine control system, which includes a handling machine and a control host. The control host is coupled to the handler. The control host is used for analyzing the image data to obtain the contour surface data corresponding to the carrier in the image data. The control host is further configured to analyze the profile surface data to obtain characteristic data of the carrying object, wherein the characteristic data reflects the posture of the carrying object in the physical space. The control host is further configured to generate control data according to the characteristic data. The transporter is used for transporting the carrier in response to the posture of the carrier in the physical space according to the control data.
本發明的實施例另提供一種非揮發性電腦可讀記錄媒體,其儲存有程式碼,且所述程式碼經處理器執行以:分析影像資料以獲得所述影像資料中對應於承載物的輪廓面資料;分析所述輪廓面資料以獲得所述承載物的特徵資料,其中所述特徵資料反映所述承載物在實體空間中的姿態;以及根據所述特徵資料產生控制資料,其中所述控制資料適於控制所述搬運機響應於所述承載物在所述實體空間中的所述姿態來搬運所述承載物。An embodiment of the present invention further provides a non-volatile computer-readable recording medium, which stores a program code, and the program code is executed by a processor to: analyze image data to obtain a contour corresponding to a carrier in the image data surface data; analyzing the profile surface data to obtain characteristic data of the bearing, wherein the characteristic data reflects the posture of the bearing in the solid space; and generating control data according to the characteristic data, wherein the control Data is adapted to control the handling machine to handle the carrier in response to the attitude of the carrier in the physical space.
基於上述,在分析影像資料以獲得影像資料中對應於承載物的輪廓面資料後,可進一步分析所述輪廓面資料以獲得所述承載物的特徵資料,其反映所述承載物在實體空間中的姿態。然後,可根據所述特徵資料產生控制資料。特別是,所述控制資料適於控制搬運機響應於所述承載物在所述實體空間中的所述姿態來搬運所述目標物。藉此,可有效提高搬運機執行自動化貨物搬運的效率。Based on the above, after analyzing the image data to obtain the contour surface data corresponding to the bearing object in the image data, the contour surface data can be further analyzed to obtain the characteristic data of the bearing object, which reflects that the bearing object is in the physical space gesture. Then, control data can be generated based on the characteristic data. In particular, the control profile is adapted to control the handling machine to handle the target in response to the pose of the carrier in the physical space. In this way, the efficiency of the handling machine in performing automated cargo handling can be effectively improved.
圖1是根據本發明的一實施例所繪示的搬運機控制系統的示意圖。請參照圖1,系統(亦稱為搬運機控制系統)10包括搬運機11、控制主機12及承載物13。搬運機11、控制主機12及承載物13的數目皆可以是一或多個,本發明不加以限制。FIG. 1 is a schematic diagram of a handling machine control system according to an embodiment of the present invention. Referring to FIG. 1 , a system (also referred to as a transporter control system) 10 includes a
搬運機11用以搬運承載物13。例如,搬運機11可具有移動與轉動機構以於地面上進行前進、後退及/或轉向等行為。此外,搬運機11可具有延伸臂101與102。例如,搬運機11可控制延伸臂101與102進行垂直或水平移動。藉此,搬運機11可使用延伸臂101與102來搬運承載物13。在一實施例中,搬運機11可以是堆高車、拖板車、棧板車、叉車或鏟車等。在一實施例中,延伸臂101與102亦可以是實作為夾具、托盤或機械手臂等可用以搬運承載物13的機構件,而承載物13可以是棧板、托盤、載台或其他用以乘載物品的扁平或立體結構物。控制主機12可為桌上型電腦、筆記型電腦、平板電腦、工業用電腦、伺服器或其他類型的具有資料傳輸與處理功能的電腦裝置。搬運機11可與控制主機12進行通訊。The
在圖1以及以下的實施例中,承載物13是以棧板作為範例。貨物可以放置於承載物13上。承載物13下方可具有凹槽131與132。凹槽131可視為延伸臂101的插入口,且凹槽132可視為延伸臂102的插入口。搬運機11可將延伸臂101與102分別插入凹槽131與132。在將延伸臂101與102分別插入凹槽131與132後,搬運機11可控制延伸臂101與102舉起承載物13。須注意的是,在其他未提及的實施例中,承載物13還可以包括其他類型的承載物,只要可以被搬運機11搬運即可。此外,圖1的搬運機11的外型也僅為示意圖,其具體外觀可根據搬運機11的實際類型而改變。1 and the following embodiments, the
須注意的是,在圖1的實施例中,搬運機11的延伸臂101與102沒有對齊承載物13的凹槽131與132。在此狀態下,搬運機11的延伸臂101與102並無法順利插入至承載物13的凹槽131與132中以搬移承載物13。控制主機12可指示搬運機11移動至適當的位置以搬運承載物13。It should be noted that, in the embodiment of FIG. 1 , the extending
在一實施例中,搬運機11還設置有影像擷取介面103。影像擷取介面103用以擷取外部影像。例如,影像擷取介面103可包含鏡頭與感光元件等光學元件。在圖1的實施例中,影像擷取介面103可設置於搬運機11前方,以擷取搬運機11前方的影像。然而,在一實施例中,影像擷取介面103亦可以設置於搬運機11的任意位置,以擷取其他方向的影像。In one embodiment, the
在一實施例中,影像擷取介面103所擷取的影像(即目標影像)包含待搬運的承載物13的至少一部分影像。也就是說,承載物13的至少一部分影像會出現於該目標影像中。影像擷取介面103可根據所擷取的目標影像產生影像資料DATA(image)。影像資料DATA(image)可帶有與承載物13當前在實體空間中的姿態之資訊。其中實體空間是指承載物13與搬運機11所實際存在的空間。例如,影像資料DATA(image)可反映承載物13與搬運機11在實體空間中的相對位置關係。In one embodiment, the image captured by the image capture interface 103 (ie, the target image) includes at least a part of the image of the
搬運機11可將影像資料DATA(image)傳送給控制主機12。控制主機12可分析影像資料DATA(image)以獲得影像資料DATA(image)中對應於承載物13的輪廓面資料。控制主機12可分析此輪廓面資料以獲得承載物13的特徵資料。此特徵資料可反映承載物13在實體空間中的姿態。接著,控制主機12可根據此特徵資料產生控制資料DATA(control)。控制資料DATA(control)適於控制搬運機11響應於承載物13在所述實體空間中的姿態來搬運承載物13。The
圖2是根據本發明的一實施例所繪示的控制搬運機移動以搬運承載物的示意圖。請參照圖2,接續於圖1的實施例,根據影像資料DATA(image),控制主機12可產生控制資料DATA(control)並將控制資料DATA(control)傳送至搬運機11。控制資料DATA(control)可包含指示搬運機11移動的控制訊號。FIG. 2 is a schematic diagram of controlling the movement of a transporter to transport a load according to an embodiment of the present invention. Referring to FIG. 2 , following the embodiment of FIG. 1 , according to the image data DATA(image), the
根據控制資料DATA(control),搬運機11可響應於承載物13當前在實體空間中的姿態而移動至適於搬運承載物13的位置,如圖2所示。例如,在此位置上,搬運機11的延伸臂101與102可對齊承載物13的凹槽131與132。此時,搬運機11只要前進即可將延伸臂101與102插入至承載物13的凹槽131與132中以搬移承載物13。換言之,在一實施例中,控制資料DATA(control)適於驅使搬運機11將延伸臂101與102插入至承載物13的凹槽131與132,以藉由延伸臂101與102搬運承載物13。According to the control data DATA(control), the
在圖2的一實施例中,在搬運機11的移動過程中,搬運機11可持續擷取目標影像並回傳對應的影像資料DATA(image)至控制主機12。根據持續接收到的影像資料DATA(image),控制主機12可藉由控制資料DATA(control)來持續修正搬運機11的移動軌跡,直到搬運機11移動至適於搬運承載物13的位置為止。In an embodiment of FIG. 2 , during the moving process of the
須注意的是,在另一實施例中,控制主機12亦可以結合至搬運機11內部。藉此,搬運機11可藉由自身的影像擷取以及資料處理機制來完成自動化的搬移動作。It should be noted that, in another embodiment, the
圖3是根據本發明的一實施例所繪示的控制主機的功能方塊圖。請參照圖3,控制主機12包括處理器31、儲存電路32及輸出/輸出(I/O)界面33。處理器31用以控制控制主機12的整體或部分操作。例如,處理器31可包括中央處理單元(Central Processing Unit, CPU)、或是其他可程式化之一般用途或特殊用途的微處理器、數位訊號處理器(Digital Signal Processor, DSP)、可程式化控制器、特殊應用積體電路(Application Specific Integrated Circuits, ASIC)、可程式化邏輯裝置(Programmable Logic Device, PLD)或其他類似裝置或這些裝置的組合。須注意的是,在以下的實施例中,對於處理器31的說明等同於對於控制主機12的說明。FIG. 3 is a functional block diagram of a control host according to an embodiment of the present invention. Referring to FIG. 3 , the
儲存電路32耦接至處理器31並用以儲存資料。例如,儲存電路32可包括揮發性儲存電路與非揮發性儲存電路。揮發性儲存電路用以揮發性地儲存資料。例如,揮發性儲存電路可包括隨機存取記憶體(Random Access Memory, RAM)或類似的揮發性儲存媒體。非揮發性儲存電路用以非揮發性地儲存資料。例如,非揮發性儲存電路可包括唯讀記憶體(Read Only Memory, ROM)、固態硬碟(solid state disk, SSD)及/或傳統硬碟(Hard disk drive, HDD)或類似的非揮發性儲存媒體。The
輸出/輸出界面33耦接至處理器31並用以傳遞訊號。例如,處理器31可經由輸出/輸出界面33接收輸入訊號或者傳送輸出訊號。例如,輸出/輸出界面33可包括網路連接界面、滑鼠、鍵盤、螢幕、觸控面板、及/或揚聲器等各式輸入/輸出裝置。The output/
在一實施例中,儲存電路32可用以儲存影像資料301。例如,影像資料301可根據圖1的影像資料DATA(image)而儲存於儲存電路32。處理器31可從儲存電路32中讀取影像資料301並根據影像資料301產生圖2的控制資料DATA(control)。In one embodiment, the
在一實施例中,儲存電路32更儲存有影像辨識模組302。影像辨識模組302可執行機器視覺等影像辨識操作。處理器31可藉由影像辨識模組302對影像資料301(即目標影像的資料)執行影像辨識並根據辨識結果產生控制資料DATA(control)。影像辨識模組302可經訓練以從影像資料301中辨識目標物(例如圖1的承載物13)。特別是,影像辨識模組302可經訓練以提高對於目標物的辨識準確度。In one embodiment, the
在一實施例中,影像辨識模組302亦可以實作為硬體電路。例如,影像辨識模組302的電路可實作於處理器31內部或者獨立於處理器31之外,本發明不加以限制。In one embodiment, the
在一實施例中,處理器31可經由影像辨識模組302分析影像資料301以獲得影像資料301中對應於承載物13的輪廓面資料。例如,處理器31可經由影像辨識模組302辨識目標影像中的一或多區域(亦稱為目標區域)。每一個目標區域包含由影像辨識模組302辨識出的承載物13的影像。然後,處理器31可根據所辨識出的目標區域來獲得影像資料301中對應於承載物的輪廓面資料。In one embodiment, the
圖4是根據本發明的一實施例所繪示的目標影像的示意圖。在本實施例中,影像41(即目標影像)中呈現了承載物13以及放置於承載物13上方的貨物15(或其他物品)。請參照圖3與圖4,在本實施例中,影像資料301可反映影像41。詳細來說,影像資料301可至少包含有影像41中的影像色彩資訊以及影像尺寸資訊。FIG. 4 is a schematic diagram of a target image according to an embodiment of the present invention. In this embodiment, the image 41 (ie, the target image) presents the
在一實施例中,處理器31可經由影像辨識模組302分析影像資料301以辨識影像41中的承載物13。影像辨識模組302可將承載物13所在的區域範圍圈選為區域401。換言之,區域401中包含由影像辨識模組302辨識出的承載物13的至少部分影像。In one embodiment, the
圖5是根據本發明的一實施例所繪示的承載物的輪廓影像的示意圖。請參照圖3與圖5,接續於圖4的實施例,處理器31可根據影像辨識模組302對於承載物13的辨識結果產生影像51。例如,處理器31可根據影像辨識模組302對於承載物13的辨識結果將圖4的區域401以外的影像資料濾除以產生影像51。因此,影像51可(僅)包含區域401內的承載物13的輪廓501。在一實施例中,將區域401以外的影像資料濾除之操作亦可以視為是將承載物13之影像以外的背景影像濾除。在一實施例中,影像51亦稱為承載物13的輪廓影像。處理器31可分析輪廓501所涵蓋的影像範圍內的影像資料來獲得原始的影像資料301中對應於承載物13的像素分布之資訊。然後,處理器31可根據此像素分布之資訊產生所述承載物13的特徵資料。FIG. 5 is a schematic diagram of a contour image of a carrier according to an embodiment of the present invention. Referring to FIG. 3 and FIG. 5 , following the embodiment of FIG. 4 , the
圖6是根據本發明的一實施例所繪示的承載物的特徵資料的示意圖。請參照圖3與圖6,接續於圖5的實施例,承載物13的輪廓501可由多個像素點61組成。每一個像素點61亦可稱為特徵點。每一個像素點61在虛擬空間u-v中都對應到一個虛擬座標。虛擬空間u-v由u軸平面與v軸平面組成。u軸平面與v軸平面彼此垂直。FIG. 6 is a schematic diagram of characteristic data of a carrier according to an embodiment of the present invention. Referring to FIGS. 3 and 6 , following the embodiment of FIG. 5 , the
在一實施例中,處理器31可根據像素點61的分布狀態決定承載物13在虛擬空間u-v中的特徵向量601與602。特徵向量601反映圖5的輪廓501之長軸在虛擬空間u-v中的位置。特徵向量602反映輪廓501之短軸在虛擬空間u-v中的位置。特徵向量601與602可共同反映承載物13在虛擬空間u-v中的姿態。In one embodiment, the
在一實施例中,處理器31可獲得特徵向量601與602在虛擬空間u-v中與一個參考平面603之間的夾角Ø之資訊。處理器31可根據夾角Ø之資訊獲得承載物13在實體空間中與搬運機11之間的相對位置關係。然後,處理器31可根據此相對位置關係產生控制資料DATA(control)。In one embodiment, the
圖7是根據本發明的一實施例所繪示的控制搬運機移動以搬運承載物的示意圖。請參照圖3與圖7,接續於圖6的實施例,在一實施例中,處理器31可將虛擬空間u-v中的夾角Ø映射至實體空間中的夾角ϴ。此映射可藉由一個轉換方程式來完成。此夾角ϴ可反映搬運機11的延伸臂101與102與承載物13的凹槽131與132之間的一個角度差。處理器31可根據此夾角ϴ產生控制資料DATA(control)。藉此,控制資料DATA(control)可驅使搬運機11移動至適於搬運承載物13的位置,且搬運機11的移動量滿足夾角ϴ所定義的角度差。在此位置上,搬運機11的延伸臂101與102可對齊承載物13的凹槽131與132。FIG. 7 is a schematic diagram of controlling the movement of a transporter to transport a load according to an embodiment of the present invention. 3 and FIG. 7, following the embodiment of FIG. 6, in one embodiment, the
在一實施例中,所獲得的輪廓面資料亦可包含承載物13的不同側面之影像的輪廓資料。處理器31可根據承載物13的不同側面之影像的輪廓資料來產生相對應的特徵資料。In one embodiment, the obtained contour surface data may also include contour data of images of different sides of the
圖8是根據本發明的一實施例所繪示的承載物的輪廓影像的示意圖。請參照圖3與圖8,在一實施例中,假設影像81為目標影像。處理器31可經由影像辨識模組302從影像81中識別出輪廓面801與802。輪廓面801包含承載物13的某一側面(亦稱為第一側面)之至少部分影像。輪廓面802包含承載物13的另一側面(亦稱為第二側面)之至少部分影像。處理器31可根據影像辨識模組302的辨識結果獲得影像資料301中對應於輪廓面801的輪廓面資料(亦稱為第一輪廓面資料)以及影像資料301中對應於輪廓面802的輪廓面資料(亦稱為第二輪廓面資料)。換言之,第一輪廓面資料包括影像資料301中與承載物13的第一側面之影像有關的資料,而第二輪廓面資料則包括影像資料301中與承載物13的第二側面之影像有關的資料。處理器31可根據第一輪廓面資料與第二輪廓面資料產生承載物13的特徵資料。FIG. 8 is a schematic diagram of a contour image of a carrier according to an embodiment of the present invention. Referring to FIG. 3 and FIG. 8 , in one embodiment, it is assumed that the
在一實施例中,處理器31可獲得第一輪廓面資料與第二輪廓面資料的至少其中之一所反映的輪廓比例。處理器31可根據此輪廓比例產生承載物13的特徵資料。例如,處理器31可分別統計輪廓面801與802中於某一軸向上的像素點的總數以獲得長度D1與D2。長度D1與D2可分別反映輪廓面801與802在承載物13的總輪廓中的長度占比。處理器31可根據長度D1與D2來產生承載物13的特徵資料。然後,處理器31可根據此特徵資料產生控制資料DATA(control)。In one embodiment, the
在一實施例中,處理器31可將長度D1與D2的比例作為承載物13的特徵資料。處理器31可將長度D1與D2的比例映射到實體空間中的夾角ϴ。此映射可藉由一個轉換方程式來完成。處理器31可根據此夾角ϴ產生控制資料DATA(control),以驅使搬運機11移動至適於搬運承載物13的位置,且搬運機11的移動量滿足夾角ϴ所定義的角度差。具體的操作細節如圖7的實施例所述,在此不重複贅述。In one embodiment, the
在一實施例中,處理器31亦可根據所獲得的特徵資料(例如圖6中的特徵向量601與602)來評估承載物在實體空間中的位置資訊及姿態資訊。處理器31可根據此些資訊來產生所述控制資料DATA(control)。In one embodiment, the
須注意的是,前述實施例皆是針對實體空間中的單一個承載物進行影像辨識以及特徵資料的提取等操作,藉此驅動搬運機移動至適當的位置來對此承載物進行搬運。然而,在另一實施例中,即便實體空間中存在多個承載物(可彼此堆疊或分散),控制主機也可依照前述實施例中提及的操作手段而逐一針對此些承載物執行影像辨識並指示搬運機自動執行後續的搬運行為。It should be noted that, in the aforementioned embodiments, operations such as image recognition and feature data extraction are performed on a single carrier in the physical space, thereby driving the carrier to move to an appropriate position to carry the carrier. However, in another embodiment, even if there are multiple bearers (which can be stacked or dispersed) in the physical space, the control host can perform image recognition for these bearers one by one according to the operation means mentioned in the previous embodiment. And instruct the handling machine to automatically perform subsequent handling behaviors.
本發明的一實施例也提出一種非揮發性電腦可讀記錄媒體。此非揮發性電腦可讀記錄媒體儲存有程式碼。電腦中的處理器(例如圖3的處理器31)可執行(或運行)此程式碼以執行前述提及的各項功能與操作。An embodiment of the present invention also provides a non-volatile computer-readable recording medium. The non-volatile computer-readable recording medium has program codes stored thereon. A processor in the computer (eg, the
圖9是根據本發明的一實施例所繪示的搬運機控制方法的流程圖。請參照圖9,在步驟S901中,分析影像資料以獲得所述影像資料中對應於承載物的輪廓面資料。在步驟S902中,分析所述輪廓面資料以獲得所述承載物的特徵資料,其中所述特徵資料反映所述承載物在實體空間中的姿態。在步驟S903中,根據所述特徵資料產生控制資料,其中所述控制資料適於控制所述搬運機響應於所述承載物在所述實體空間中的所述姿態來搬運所述承載物。FIG. 9 is a flowchart of a method for controlling a transporter according to an embodiment of the present invention. Referring to FIG. 9 , in step S901 , the image data is analyzed to obtain contour surface data corresponding to the carrier in the image data. In step S902, the profile data is analyzed to obtain characteristic data of the carrier, wherein the characteristic data reflects the posture of the carrier in the physical space. In step S903, control data is generated according to the characteristic data, wherein the control data is suitable for controlling the carrier to carry the carrier in response to the posture of the carrier in the physical space.
然而,圖9中各步驟已詳細說明如上,在此便不再贅述。值得注意的是,圖9中各步驟可以實作為多個程式碼(例如軟體模組)或是電路(例如電路模組),本揭露不加以限制。此外,圖9的方法可以搭配以上範例實施例使用,也可以單獨使用,本揭露不加以限制。However, each step in FIG. 9 has been described in detail as above, and will not be repeated here. It should be noted that, each step in FIG. 9 may be implemented as a plurality of codes (eg, software modules) or circuits (eg, circuit modules), which are not limited in the present disclosure. In addition, the method of FIG. 9 can be used in conjunction with the above exemplary embodiments, and can also be used alone, which is not limited by the present disclosure.
綜上所述,主控裝置可根據所獲得的影像資料中與承載物有關的資訊來評估承載物在實體空間中的姿態,進而根據此姿態來驅使搬運機自動移動至合適的位置來搬運此承載物。在一實施例中,即便承載物在實體空間中的擺放位置及/或擺放角度是不規則的,搬運機仍可自動調整延伸臂的相對於承載物的插入角度,以順利舉起並搬運此承載物。藉此,可有效提高搬運機執行自動化貨物搬運的效率。To sum up, the main control device can evaluate the attitude of the load in the physical space according to the information related to the load in the obtained image data, and then drive the transporter to automatically move to a suitable position to carry the load according to the attitude. bearer. In one embodiment, even if the placement position and/or placement angle of the carrier in the physical space is irregular, the handling machine can still automatically adjust the insertion angle of the extension arm relative to the carrier, so as to smoothly lift and hold the carrier. Carry this load. In this way, the efficiency of the handling machine in performing automated cargo handling can be effectively improved.
雖然本揭露已以實施例揭露如上,然其並非用以限定本揭露,任何所屬技術領域中具有通常知識者,在不脫離本揭露的精神和範圍內,當可作些許的更動與潤飾,故本揭露的保護範圍當視後附的申請專利範圍所界定者為準。Although the present disclosure has been disclosed above with examples, it is not intended to limit the present disclosure. Anyone with ordinary knowledge in the technical field may make some changes and modifications without departing from the spirit and scope of the present disclosure. The scope of protection of the present disclosure shall be determined by the scope of the appended patent application.
10:搬運機控制系統
11:搬運機
101, 102:延伸臂
103:影像擷取介面
12:控制主機
13:承載物
15:貨物
131, 132:凹槽
DATA(image):影像資料
DATA(control):控制資料
31:處理器
32:儲存電路
301:影像資料
302:影像辨識模組
33:輸出/輸出界面
41, 51, 81:影像
401:區域
501:承載物的輪廓
61:像素點
601, 602:特徵向量
603:參考平面
801, 802:輪廓面
D1, D2:距離
S901~S903:步驟
10: Handling machine control system
11:
圖1是根據本發明的一實施例所繪示的搬運機控制系統的示意圖。 圖2是根據本發明的一實施例所繪示的控制搬運機移動以搬運承載物的示意圖。 圖3是根據本發明的一實施例所繪示的控制主機的功能方塊圖。 圖4是根據本發明的一實施例所繪示的目標影像的示意圖。 圖5是根據本發明的一實施例所繪示的承載物的輪廓影像的示意圖。 圖6是根據本發明的一實施例所繪示的承載物的特徵資料的示意圖。 圖7是根據本發明的一實施例所繪示的控制搬運機移動以搬運承載物的示意圖。 圖8是根據本發明的一實施例所繪示的承載物的輪廓影像的示意圖。 圖9是根據本發明的一實施例所繪示的搬運機控制方法的流程圖。 FIG. 1 is a schematic diagram of a handling machine control system according to an embodiment of the present invention. FIG. 2 is a schematic diagram of controlling the movement of a transporter to transport a load according to an embodiment of the present invention. FIG. 3 is a functional block diagram of a control host according to an embodiment of the present invention. FIG. 4 is a schematic diagram of a target image according to an embodiment of the present invention. FIG. 5 is a schematic diagram of a contour image of a carrier according to an embodiment of the present invention. FIG. 6 is a schematic diagram of characteristic data of a carrier according to an embodiment of the present invention. FIG. 7 is a schematic diagram of controlling the movement of a transporter to transport a load according to an embodiment of the present invention. FIG. 8 is a schematic diagram of a contour image of a carrier according to an embodiment of the present invention. FIG. 9 is a flowchart of a method for controlling a transporter according to an embodiment of the present invention.
S901~S903:步驟 S901~S903: Steps
Claims (21)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109144957A TWI770726B (en) | 2020-12-18 | 2020-12-18 | Method and system for controlling a handling machine and non-volatile computer readable recording medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109144957A TWI770726B (en) | 2020-12-18 | 2020-12-18 | Method and system for controlling a handling machine and non-volatile computer readable recording medium |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202226137A true TW202226137A (en) | 2022-07-01 |
TWI770726B TWI770726B (en) | 2022-07-11 |
Family
ID=83436790
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW109144957A TWI770726B (en) | 2020-12-18 | 2020-12-18 | Method and system for controlling a handling machine and non-volatile computer readable recording medium |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI770726B (en) |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8958907B2 (en) * | 2011-03-31 | 2015-02-17 | Sinfonia Technology Co., Ltd. | Robot arm apparatus |
CN107324041B (en) * | 2016-04-29 | 2019-11-26 | 上海微电子装备(集团)股份有限公司 | Manipulator and automatic film magazine handling device for film magazine clamping |
TWI626704B (en) * | 2016-08-29 | 2018-06-11 | 樹德科技大學 | Automatic ic transporting system with image recognition function and transporting method thereof |
TWM589626U (en) * | 2019-07-01 | 2020-01-21 | 日商Airobot股份有限公司 | Autonomous mobile handling robot and its carrying member |
-
2020
- 2020-12-18 TW TW109144957A patent/TWI770726B/en active
Also Published As
Publication number | Publication date |
---|---|
TWI770726B (en) | 2022-07-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10596701B1 (en) | Robotic system with enhanced scanning mechanism | |
US20240078512A1 (en) | Robotic system with automated object detection mechanism and methods of operating the same | |
US10679379B1 (en) | Robotic system with dynamic packing mechanism | |
JP2019509559A (en) | Box location, separation, and picking using a sensor-guided robot | |
CN110599544B (en) | Workpiece positioning method and device based on machine vision | |
CN114820772B (en) | System and method for object detection based on image data | |
EP3766644A1 (en) | Workpiece picking device and workpiece picking method | |
Arpenti et al. | RGB-D recognition and localization of cases for robotic depalletizing in supermarkets | |
US11772271B2 (en) | Method and computing system for object recognition or object registration based on image classification | |
US20230381971A1 (en) | Method and computing system for object registration based on image classification | |
CN115546300A (en) | Method and device for identifying pose of tray placed tightly, computer equipment and medium | |
TWI770726B (en) | Method and system for controlling a handling machine and non-volatile computer readable recording medium | |
CN114092428A (en) | Image data processing method, image data processing device, electronic equipment and storage medium | |
WO2024016633A1 (en) | Article sorting method and apparatus, and computer-readable storage medium | |
US20220194762A1 (en) | Method and system for controlling a handling machine and non-volatile computer readable recording medium | |
CN116468791A (en) | Unstacking positioning method, unstacking positioning device, unstacking positioning system and storage medium | |
WO2023082417A1 (en) | Grabbing point information obtaining method and apparatus, electronic device, and storage medium | |
WO2023213070A1 (en) | Method and apparatus for obtaining goods pose based on 2d camera, device, and storage medium | |
CN111687829B (en) | Anti-collision control method, device, medium and terminal based on depth vision | |
CN114022342A (en) | Acquisition method and device for acquisition point information, electronic equipment and storage medium | |
US20230161348A1 (en) | Handling machine control method, handling machine control system and control host | |
EP4349745A1 (en) | Methods, systems, and computer program products for executing partial depalletization operations in robotic depalletization | |
EP4309858A1 (en) | Methods, systems, and computer program products for reachability constraint manipulation for height thresholded scenarios in robotic depalletization | |
US11806882B1 (en) | Robotic picking system and method of use | |
US20220366694A1 (en) | Method and computing systems for performing object detection |