TWI817921B - Model modeling instruction generation method and system - Google Patents

Model modeling instruction generation method and system Download PDF

Info

Publication number
TWI817921B
TWI817921B TW112120367A TW112120367A TWI817921B TW I817921 B TWI817921 B TW I817921B TW 112120367 A TW112120367 A TW 112120367A TW 112120367 A TW112120367 A TW 112120367A TW I817921 B TWI817921 B TW I817921B
Authority
TW
Taiwan
Prior art keywords
vector
constructed
information
target
model
Prior art date
Application number
TW112120367A
Other languages
Chinese (zh)
Inventor
池明洋
方鄒昭聰
戴敏育
謝汶欣
Original Assignee
明合智聯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 明合智聯股份有限公司 filed Critical 明合智聯股份有限公司
Priority to TW112120367A priority Critical patent/TWI817921B/en
Application granted granted Critical
Publication of TWI817921B publication Critical patent/TWI817921B/en

Links

Abstract

一種模型建模指令生成方法,藉由一儲存一包含多個物件標籤對應多個物件向量的映射表,及一包含多個對應該等物件向量之建構指令之指令集的模型建模指令生成系統來實施,並包含:(A) 根據一指示出至少一欲建構物件的輸入資訊,利用轉換方式,獲得一第一向量;(B) 根據該第一向量,利用解碼模型,獲得至少一指示出該至少一欲建構物件的第二向量;(C) 對於每一第二向量,根據該第二向量及該映射表,獲得一匹配該第二向量的目標物件標籤;(D) 對於每一目標物件標籤,根據該目標物件標籤及該指令集,產生一對應該目標物件標籤的目標建構指令。A method for generating model modeling instructions through a model modeling instruction generation system that stores a mapping table including multiple object tags corresponding to multiple object vectors, and an instruction set including multiple construction instructions corresponding to the corresponding object vectors. to implement, and includes: (A) using a conversion method to obtain a first vector based on an input information indicating at least one object to be constructed; (B) using a decoding model based on the first vector to obtain at least one indicating The at least one second vector of the object to be constructed; (C) for each second vector, obtain a target object label matching the second vector according to the second vector and the mapping table; (D) for each target The object tag generates a pair of target construction instructions for the target object tag based on the target object tag and the instruction set.

Description

模型建模指令生成方法及其系統Model modeling instruction generation method and system

本發明是有關於一種指令生成方法及其系統,特別是指一種應用於虛擬模型建構虛擬物件的指令生成方法及其系統。 The present invention relates to an instruction generation method and its system, and in particular to an instruction generation method and its system used in virtual models to construct virtual objects.

隨著元宇宙和虛擬實境相關的技術進步,目前虛擬場景建構技術(例:Unreal Engine,或稱虛幻引擎)已可呈現相當精緻的各種虛擬物件,讓使用者在虛擬世界中體驗充滿想像力且深入其境的感受。 With the advancement of technologies related to the metaverse and virtual reality, current virtual scene construction technology (such as: Unreal Engine, or Unreal Engine) can present a variety of quite exquisite virtual objects, allowing users to experience imaginative and exciting experiences in the virtual world. The feeling of being deeply involved in its environment.

然而,目前於虛擬場景建構技術雖已廣泛應用於電玩娛樂以及設計等領域,但使用者若要建構虛擬場景仍需要鑽研相關的背景知識,或是仰賴專業的設計團隊協助方能執行,造成相對於個體戶或是小企業皆過於耗損時間及成本,同時也局限了虛擬場景建構技術發展速度。 However, although virtual scene construction technology has been widely used in fields such as video games, entertainment and design, users still need to delve into relevant background knowledge to construct virtual scenes, or rely on the assistance of a professional design team to execute, resulting in a relatively complex situation. It is too time-consuming and costly for self-employed individuals or small businesses, and it also limits the development speed of virtual scene construction technology.

有鑑於此,實有必要尋求一解決方案,令欲建構虛擬場景的使用者能夠直覺簡單地操作任何建模軟體並進行設計規劃,快速建構出屬於自己的虛擬世界,以克服先前過度耗損時間及成本之 問題。 In view of this, it is necessary to find a solution that allows users who want to construct virtual scenes to intuitively and simply operate any modeling software and carry out design planning, and quickly construct their own virtual world to overcome the previous excessive time consumption and cost of problem.

因此,本發明的目的,即在提供一種令使用者能夠直覺簡單地產生建構虛擬場景之指令的模型建模指令生成方法。 Therefore, an object of the present invention is to provide a method for generating model modeling instructions that allows users to intuitively and simply generate instructions for constructing a virtual scene.

於是,本發明一種模型建模指令生成方法,藉由一經由一通訊網路連接一電子裝置的模型建模指令生成系統來實施,該模型建模指令生成系統儲存有一包含多個對應於多個由一虛幻引擎所建構之物件的物件標籤與多個對應該等物件標籤之物件向量的映射表,及一包含多個用於建構該等物件且對應該等物件向量之建構指令的指令集,並包含一步驟(A)、一步驟(B)、一步驟(C),及一步驟(D)。 Therefore, the present invention provides a method for generating model modeling instructions, which is implemented by a model modeling instruction generation system connected to an electronic device through a communication network. The model modeling instruction generation system stores a model containing a plurality of codes corresponding to a plurality of sources. a mapping table of object tags of objects constructed by the Unreal Engine and a plurality of object vectors corresponding to the corresponding object tags, and an instruction set including a plurality of construction instructions for constructing the objects and corresponding to the object vectors, and It includes one step (A), one step (B), one step (C), and one step (D).

步驟(A)是根據一來自該電子裝置且指示出至少一欲建構物件的輸入資訊,利用一用於將一資訊轉換為一輸出向量的轉換方式,獲得一對應該輸入資訊的第一向量。 Step (A) is to obtain a first vector corresponding to the input information using a conversion method for converting information into an output vector based on input information from the electronic device indicating at least one object to be constructed.

步驟(B)是根據該第一向量,利用一用於將一待解碼向量進行解碼並轉換為至少一待建構物件所指示出之至少一解碼後向量的解碼模型,獲得至少一指示出該至少一欲建構物件的第二向量。 Step (B) is to use a decoding model for decoding and converting a vector to be decoded into at least one decoded vector indicated by at least one object to be constructed according to the first vector to obtain at least one vector indicating the at least one decoded vector. A second vector of the object to be constructed.

步驟(C)是對於每一第二向量,根據該第二向量及該映射 表,自該等物件向量中,獲得一匹配該第二向量的目標物件標籤。 Step (C) is for each second vector, according to the second vector and the mapping table, and obtain a target object label matching the second vector from the object vectors.

步驟(D)是對於每一目標物件標籤,根據該目標物件標籤及該指令集,產生一用於在該虛幻引擎中建構該目標物件標籤所指示出之物件的目標建構指令。 Step (D) is for each target object tag, generating a target construction instruction for constructing the object indicated by the target object tag in the Unreal Engine according to the target object tag and the instruction set.

本發明的另一目的,即在提供一種令使用者能夠直覺簡單地產生建構虛擬場景之指令的模型建模指令生成系統。 Another object of the present invention is to provide a model modeling instruction generation system that allows users to intuitively and simply generate instructions for constructing virtual scenes.

於是,本發明模型建模指令生成系統包含一連接一通訊網路的通訊模組、一儲存模組,及一電連接該通訊模組及該儲存模組的處理模組。 Therefore, the model modeling instruction generation system of the present invention includes a communication module connected to a communication network, a storage module, and a processing module electrically connected to the communication module and the storage module.

該通訊模組,經由該通訊網路連接一電子裝置。 The communication module is connected to an electronic device through the communication network.

該儲存模組,儲存有一包含多個對應於多個由一虛幻引擎所建構之物件的物件標籤與多個對應該等物件標籤之物件向量的映射表,及一包含多個用於建構該等物件且對應該等物件向量之建構指令的指令集。 The storage module stores a mapping table including a plurality of object tags corresponding to a plurality of objects constructed by an Unreal Engine and a plurality of object vectors corresponding to the object tags, and a mapping table including a plurality of object tags for constructing the Object and a set of instructions corresponding to the construction instructions of the corresponding object vector.

該處理模組,根據該通訊模組所接收之一來自該電子裝置且指示出至少一欲建構物件的輸入資訊,利用一用於將一資訊轉換為一輸出向量的轉換方式,獲得一對應該輸入資訊的第一向量,該處理模組根據該第一向量,利用一用於將一待解碼向量進行解碼並轉換為至少一待建構物件所指示出之至少一解碼後向量的解碼模型,獲得至少一指示出該至少一欲建構物件的第二向量,對於每 一第二向量,該處理模組根據該第二向量及該映射表,自該等物件向量中,獲得一匹配該第二向量的目標物件標籤,對於每一目標物件標籤,該處理模組根據該目標物件標籤及該指令集,產生一用於在該虛幻引擎中建構該目標物件標籤所指示出之物件的目標建構指令。 The processing module, according to the input information received by the communication module from the electronic device and indicating at least one object to be constructed, uses a conversion method for converting an information into an output vector to obtain a pair of the corresponding A first vector of input information. Based on the first vector, the processing module uses a decoding model for decoding and converting a vector to be decoded into at least one decoded vector indicated by at least one object to be constructed, to obtain At least one second vector indicating the at least one object to be constructed, for each a second vector. The processing module obtains a target object label matching the second vector from the object vectors according to the second vector and the mapping table. For each target object label, the processing module obtains a target object label according to the second vector and the mapping table. The target object tag and the instruction set generate a target construction instruction for constructing the object indicated by the target object tag in the Unreal Engine.

本發明的功效在於:藉由該模型建模指令生成系統對所接收的輸入資訊(例:自然語言)利用該轉換方式進行處理,以獲得對應的該第一向量,接著利用該解碼模型獲得對應該第一向量,且指示出該使用者所欲建構之該至少一欲建構物件的該至少一第二向量,最後根據每一第二向量,透過該映射表及該指令集,產生每一欲建構物件對應於該虛幻引擎中之物件的該目標建構指令,而該虛幻引擎便能根據每一目標建構指令建構相對應的物件,使得該使用者能透過簡單且直覺的自然語言表達,進行虛擬場景的建構設計。 The effect of the present invention is to use the model modeling instruction generation system to process the received input information (for example: natural language) using the conversion method to obtain the corresponding first vector, and then use the decoding model to obtain the corresponding first vector. It should be a first vector and indicate the at least one second vector of the at least one object to be constructed that the user wants to construct. Finally, according to each second vector, through the mapping table and the instruction set, each desired object is generated. The construction object corresponds to the target construction instruction of the object in the Unreal Engine, and the Unreal Engine can construct the corresponding object according to each target construction instruction, so that the user can perform virtualization through simple and intuitive natural language expression. Scene construction design.

200:通訊網路 200:Communication network

1:模型建模指令生成系統 1: Model modeling instruction generation system

11:系統端通訊模組 11: System-side communication module

12:系統端儲存模組 12:System side storage module

13:系統端處理模組 13: System side processing module

2:電子裝置 2: Electronic devices

21:裝置端通訊模組 21:Device-side communication module

22:裝置端輸入模組 22: Device input module

23:裝置端處理模組 23:Device-side processing module

51~53:步驟 51~53: Steps

61~66:步驟 61~66: Steps

621、622:子步驟 621, 622: Sub-steps

641~644:子步驟 641~644: Sub-steps

本發明的其他的特徵及功效,將於參照圖式的實施方式中清楚地呈現,其中:圖1說明一用於執行本發明模型建模指令生成方法之一實施例的模型建模指令生成系統及一電子裝置; 圖2是一流程圖,說明本發明模型建模指令生成方法之該實施例的一模型訓練程序;圖3是一流程圖,說明該實施例的一指令產生程序;圖4是一流程圖,說明該實施例的該指令產生程序之步驟62的子步驟621、622;及圖5是一流程圖,說明該實施例的該指令產生程序之步驟64的子步驟641~644。 Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, in which: Figure 1 illustrates a model modeling instruction generation system for executing one embodiment of the model modeling instruction generation method of the present invention. and an electronic device; Figure 2 is a flow chart illustrating a model training program of the embodiment of the model modeling instruction generation method of the present invention; Figure 3 is a flow chart illustrating an instruction generation program of the embodiment; Figure 4 is a flow chart, Describe the sub-steps 621 and 622 of step 62 of the instruction generating program in this embodiment; and FIG. 5 is a flow chart illustrating the sub-steps 641 to 644 of step 64 of the instruction generating program of this embodiment.

參閱圖1,本發明模型建模指令生成方法之一之實施例,藉由一模型建模指令生成系統1來實施,該模型建模指令生成系統1包含一經由一通訊網路200與一電子裝置2連接的系統端通訊模組11、一系統端儲存模組12,以及一電連接該系統端通訊模組11與該系統端儲存模組12的系統端處理模組13。 Referring to Figure 1, one embodiment of the method for generating model modeling instructions of the present invention is implemented by a model modeling instruction generating system 1. The model modeling instruction generating system 1 includes a communication network 200 and an electronic device. 2 connected system-side communication module 11, a system-side storage module 12, and a system-side processing module 13 electrically connected to the system-side communication module 11 and the system-side storage module 12.

該系統端儲存模組12儲存有多個對應於一虛幻引擎所建構之多個物件的物件標籤、多個關於該等物件標籤的物件類別。其中,每一物件標籤被歸類為該等物件類別中之一者。 The system-side storage module 12 stores a plurality of object tags corresponding to a plurality of objects constructed by an Unreal Engine, and a plurality of object categories related to the object tags. Each object tag is classified into one of the object categories.

該系統端儲存模組12還儲存有一包含該等物件標籤與多個對應該等物件標籤之物件向量的映射表、一包含多個可調整物件特徵資訊與多個對應該等可調整物件特徵資訊,且分別由一正號 「+」或一負號「-」中之一者表示之一調整方向的物件特徵調整方向表、一包含多個用於建構該等物件且對應該等物件向量之建構指令的指令集、一用於將一高維度之向量進行編碼並轉換為一低維度之向量的編碼模型、一對應於該編碼模型且用於將另一低維度之向量進行解碼並轉換為另一高維度之向量的解碼模型、多個訓練集,及一已訓練完成之監督式的基石模型。其中,每一訓練集包含至少一對應於一待訓練建構物件的訓練物件名稱資訊及每一訓練物件名稱資訊所對應的該物件標籤。其中,該映射表還包含每一物件向量中之每一元素所對應的該等物件類別中之一者。 The system-side storage module 12 also stores a mapping table including the object tags and a plurality of object vectors corresponding to the object tags, a mapping table including a plurality of adjustable object characteristic information and a plurality of corresponding adjustable object characteristic information. , and each is represented by a positive sign One of "+" or a negative sign "-" represents an adjustment direction of an object feature adjustment direction table, an instruction set containing a plurality of construction instructions for constructing the objects and corresponding to the object vectors, an instruction set A coding model for encoding and converting a high-dimensional vector into a low-dimensional vector, and a coding model corresponding to the encoding model for decoding and converting another low-dimensional vector into another high-dimensional vector. Decoding model, multiple training sets, and a trained supervised cornerstone model. Each training set includes at least one training object name information corresponding to a structural object to be trained and the object label corresponding to each training object name information. The mapping table also includes one of the object categories corresponding to each element in each object vector.

在本實施例中,該虛幻引擎為一Unreal Engine,但不以此為限;該編碼模型為一End-To-End模型之編碼器(Encoder),但不以此為限;而該解碼模型為該End-To-End模型之解碼器(Decoder),但不以此為限;該基石模型係為一指令遵循語言模型(Instruction-Following Language Model),但不以此為限。 In this embodiment, the Unreal Engine is an Unreal Engine, but is not limited thereto; the encoding model is an End-To-End model encoder (Encoder), but is not limited thereto; and the decoding model It is the decoder of the End-To-End model, but it is not limited to this; the cornerstone model is an instruction-following language model (Instruction-Following Language Model), but it is not limited to this.

值得特別說明的是,在本實施例中,該系統端處理模組13係將該虛幻引擎所能建構的每一物件所對應之該物件標籤進行編碼(例:獨熱編碼,One-Hot Encoding)並獲得該物件所對應的該物件向量,以藉此獲得該映射表,但不以此方式為限。 It is worth mentioning that in this embodiment, the system-side processing module 13 encodes the object tag corresponding to each object that the Unreal Engine can construct (for example: One-Hot Encoding ) and obtain the object vector corresponding to the object, thereby obtaining the mapping table, but it is not limited to this method.

值得別說明的是,在其他實施例中,該虛幻引擎除了可 建置於其他電腦裝置內之外,亦可包含於模型建模指令生成系統1架構中。 It is worth mentioning that in other embodiments, the Unreal Engine can In addition to being built in other computer devices, it can also be included in the model modeling command generation system 1 architecture.

該電子裝置2包含一經由該通訊網路200連接該模型建模指令生成系統1的裝置端通訊模組21、一裝置端輸入模組22,以及一電連接該裝置端通訊模組21與該裝置端輸入模組22的裝置端處理模組23。 The electronic device 2 includes a device-side communication module 21 connected to the model modeling instruction generation system 1 via the communication network 200, a device-side input module 22, and an electrical connection between the device-side communication module 21 and the device. The device-side processing module 23 of the terminal input module 22.

在該實施例中,該模型建模指令生成系統1之實施態樣例如為一個人電腦、一伺服器或一雲端主機,但不以此為限。 In this embodiment, the implementation form of the model modeling instruction generation system 1 is, for example, a personal computer, a server or a cloud host, but is not limited thereto.

在該實施例中,每一電子裝置2之實施態樣例如為一個人電腦、一智慧型手機或一平板電腦,但不以此為限。 In this embodiment, the implementation form of each electronic device 2 is, for example, a personal computer, a smart phone or a tablet computer, but is not limited thereto.

以下將藉由本發明模型建模指令生成方法之該實施例,來說明該模型建模指令生成系統1與該電子裝置2的運作細節,建模指令生成方之該實施例包含一模型訓練程序,及一指令產生程序。 The operation details of the model modeling instruction generation system 1 and the electronic device 2 will be explained below through the embodiment of the model modeling instruction generation method of the present invention. The embodiment of the modeling instruction generation method includes a model training program, and an instruction generation program.

參閱圖2,該模型訓練程序係用於訓練該指令產生程序所需使用之一轉換方式,並包括步驟51~53。 Referring to Figure 2, the model training program is used to train a conversion method required by the instruction generation program, and includes steps 51 to 53.

在步驟51中,對於每一訓練集中的每一訓練物件名稱資訊,該系統端處理模組13根據該訓練物件名稱資訊所對應的物件標籤,利用該映射表,自該等物件向量中,獲得一對應該訓練物件名稱資訊的訓練物件向量。 In step 51, for each training object name information in each training set, the system-side processing module 13 uses the mapping table to obtain from the object vectors according to the object tag corresponding to the training object name information. A pair of training object vectors that should contain training object name information.

在步驟52中,對於每一訓練集,該系統端處理模組13根 據該訓練集中該至少一訓練物件名稱資訊所對應的該至少一訓練物件向量,利用該編碼模型,獲得一對應該訓練集的第三向量。其中,每一訓練物件向量之維度(例:50000維)彼此皆相同,且大於該第三向量(例:300維)。 In step 52, for each training set, the system-side processing module 13 According to the at least one training object vector corresponding to the at least one training object name information in the training set, the coding model is used to obtain a third vector corresponding to the training set. Among them, the dimensions of each training object vector (for example: 50000 dimensions) are the same as each other and are larger than the third vector (for example: 300 dimensions).

在步驟53中,該系統端處理模組13將每一訓練集所對應的該等訓練物件名稱資訊與該訓練集所對應的該第三向量作為一訓練資料,並根據所有訓練資料,對該基石模型進行微調(Fine-tune)訓練,以獲得一用於該指令產生程序之子步驟622所使用之該轉換方式所包含的第二階段模型。值得特別說明的是,經過微調後的該第二階段模型用於將一物件名稱轉換為一與該基石模型所輸出之資料型態不相同之特定維度的向量,相較該基石模型更適合特定的任務或應用場景;而在本實施例中,係依據Adapter插件方式,且利用所有訓練資料,不微調該基石模型之參數,僅微調所加入Adapter插件之參數進行訓練,以獲得該第二階段模型,但不以此為限。 In step 53, the system-side processing module 13 uses the training object name information corresponding to each training set and the third vector corresponding to the training set as a training data, and based on all the training data, the The cornerstone model undergoes fine-tune training to obtain a second-stage model included in the transformation method used in sub-step 622 of the instruction generation program. It is worth mentioning that the fine-tuned second-stage model is used to convert an object name into a vector of specific dimensions that is different from the data type output by the cornerstone model. Compared with the cornerstone model, it is more suitable for specific tasks or application scenarios; in this embodiment, based on the Adapter plug-in method and using all training data, the parameters of the cornerstone model are not fine-tuned, but only the parameters of the added Adapter plug-in are fine-tuned for training to obtain the second stage. model, but not limited to this.

參閱圖3,該指令產生程序係用於產生供該虛幻引擎建立對應之物件的指令,並包括步驟61~66。 Referring to Figure 3, the command generation program is used to generate commands for the Unreal Engine to create corresponding objects, and includes steps 61 to 66.

在步驟61中,該裝置端處理模組23回應該裝置端輸入模組22經由該使用者之操作所產生一輸入訊號,產生一指示出至少一欲建構物件的輸入資訊後,經由該裝置端通訊模組21將該輸入資訊 傳送至該模型建模指令生成系統1。值得特別說明的是,在本實施例中,該輸入資訊包含自然語言,在其他實施例中,該輸入資訊亦可包含一語音、一圖片或一影片。 In step 61, the device processing module 23 responds to an input signal generated by the device input module 22 through the user's operation, and generates input information indicating at least one object to be constructed, through the device The communication module 21 will input the information The model is sent to the modeling instruction generation system 1. It is worth mentioning that in this embodiment, the input information includes natural language. In other embodiments, the input information may also include a voice, a picture, or a video.

在步驟62中,該系統端處理模組13在透過該系統端通訊模組11接收該輸入資訊後,根據該輸入資訊,利用用於將一資訊轉換為一輸出向量的該轉換方式,獲得一對應該輸入資訊的第一向量。 In step 62, after receiving the input information through the system-side communication module 11, the system-side processing module 13 uses the conversion method for converting an information into an output vector according to the input information to obtain an The first vector corresponding to the input information.

參閱圖4,步驟62還包含子步驟621、622。 Referring to Figure 4, step 62 also includes sub-steps 621 and 622.

在子步驟621中,該系統端處理模組13根據該輸入資訊,利用一用於自該資訊擷取出關於至少一待建構物件之至少一物件資訊的第一階段模型以進行該轉換方式的一資訊擷取程序,獲得該輸入資訊中的至少一欲建構物件資訊,而該至少一欲建構物件資訊分別對應該至少一欲建構物件。其中,每一欲建構物件資訊包含一欲建構物件名稱資訊及一欲建構物件特徵資訊。其中,該輸入資訊亦可包含該使用者搜尋關於該至少一欲建構物件的一瀏覽紀錄。 In sub-step 621, the system-side processing module 13 uses a first-stage model for extracting at least one object information about at least one object to be constructed from the information to perform a step of the conversion method according to the input information. The information retrieval process obtains at least one object information to be constructed from the input information, and the at least one object information to be constructed corresponds to at least one object to be constructed respectively. Among them, each object information to be constructed includes a name information of the object to be constructed and a characteristic information of the object to be constructed. The input information may also include a browsing record of the user's search for the at least one object to be constructed.

值得特別說明的是,在本實施例中,該第一階段模型即為該基石模型,但不以此為限。 It is worth mentioning that in this embodiment, the first-stage model is the cornerstone model, but it is not limited to this.

舉例來說,該輸入資訊為「房間裝飾的頗為典雅,並有著一張寬大的書桌」,則第一組欲建構物件資訊為『房間(欲建構物件名稱資訊)』和『典雅(欲建構物件特徵資訊)』,第二組欲 建構物件資訊為『書桌(欲建構物件名稱資訊)』和『寬大(欲建構物件特徵資訊)』。特別地,該系統端處理模組13可根據該瀏覽紀錄,擷取出更多相關於該至少一欲建構物件的欲建構物件特徵資訊。 For example, if the input information is "the room is quite elegantly decorated and has a large desk", then the first set of object information to be constructed is "room (object name information to be constructed)" and "elegant (to construct object name information)" Object characteristic information)", the second group wants to The construction object information is "desk (object name information to be constructed)" and "wide (object characteristic information to be constructed)". In particular, the system-side processing module 13 can retrieve more characteristic information of the object to be constructed related to the at least one object to be constructed based on the browsing record.

在子步驟622中,該系統端處理模組13根據該至少一欲建構物件名稱資訊,利用一用於將該至少一物件資訊轉換為該輸出向量的第二階段模型以進行該轉換方式的一向量轉換程序,獲得對應該至少一欲建構物件資訊的該第一向量。 In sub-step 622, the system-side processing module 13 uses a second-stage model for converting the at least one object information to the output vector according to the at least one object name information to be constructed to perform a step of the conversion method. The vector conversion program obtains the first vector corresponding to the information of the at least one object to be constructed.

在步驟63中,該系統端處理模組13根據該第一向量,利用用於將一待解碼向量進行解碼並轉換為該至少一待建構物件所指示出之至少一解碼後向量的該解碼模型,獲得至少一指示出該至少一欲建構物件的第二向量。其中,每一第二向量之維度(例:50000維)彼此皆相同,且大於該第一向量(例:300維)之維度。舉例來說,步驟63係用於獲得上述例子『房間』和『書桌』各自所對應的第二向量。 In step 63, the system-side processing module 13 uses the decoding model for decoding a vector to be decoded and converting it into at least one decoded vector indicated by the at least one object to be constructed according to the first vector. , obtaining at least one second vector indicating the at least one object to be constructed. Among them, the dimensions of each second vector (for example: 50000 dimensions) are the same as each other and are larger than the dimension of the first vector (for example: 300 dimensions). For example, step 63 is used to obtain the second vectors corresponding to the "room" and "desk" in the above example.

在步驟64中,對於每一第二向量,該系統端處理模組13利用該第二向量對應之該欲建構物件所對應的欲建構物件資訊中的欲建構物件特徵資訊、該映射表及該物件特徵調整方向表,對該第二向量進行調整,以獲得調整後的該第二向量。特別地,每一調整後的第二向量相較於所對應之未調整的該第二向量帶有該使用 者所描述的外觀特徵。 In step 64, for each second vector, the system-side processing module 13 uses the characteristic information of the object to be constructed in the object to be constructed information corresponding to the object to be constructed corresponding to the second vector, the mapping table and the The object feature adjusts the direction table to adjust the second vector to obtain the adjusted second vector. In particular, each adjusted second vector is compared with the corresponding unadjusted second vector with the usage The appearance characteristics described by the author.

參閱圖5,步驟64還包含子步驟641~644。 Referring to Figure 5, step 64 also includes sub-steps 641~644.

在子步驟641中,對於每一第二向量,該系統端處理模組13根據該第二向量及該映射表,自該等物件向量中,獲得一匹配該第二向量的待檢視物件向量,並將該待檢視物件向量所對應的該物件標籤作為一待檢視物件標籤,並將該待檢視物件標籤所屬於的該物件類別作為一目標物件類別。其中,該系統端處理模組13係自該映射表之所有物件向量中,獲得與該第二向量之向量空間距離為最小者作為該待檢視物件向量。 In sub-step 641, for each second vector, the system-side processing module 13 obtains an object vector to be inspected that matches the second vector from the object vectors according to the second vector and the mapping table, The object label corresponding to the object vector to be inspected is used as an object label to be inspected, and the object category to which the object label to be inspected belongs is used as a target object category. Among all the object vectors in the mapping table, the system-side processing module 13 obtains the one with the smallest vector space distance from the second vector as the object vector to be inspected.

在子步驟642中,對於每一第二向量,該系統端處理模組13根據該目標物件類別及該映射表,自該第二向量中的所有元素中,獲得一與該目標物件類別具有相同之物件類別的待調整元素。 In sub-step 642, for each second vector, the system-side processing module 13 obtains, from all elements in the second vector according to the target object type and the mapping table, an element with the same characteristics as the target object type. The element to be adjusted of the object category.

在子步驟643中,對於每一第二向量,該系統端處理模組13根據該第二向量對應之該欲建構物件所對應的欲建構物件資訊中的欲建構物件特徵資訊,及該物件特徵調整方向表,自該物件特徵調整方向表的該等可調整物件特徵資訊中,獲得一匹配該欲建構物件特徵資訊的目標調整物件特徵資訊,並將該目標調整物件特徵資訊所對應的該調整方向作為該目標調整方向。值得特別說明的是,在本實施例中,該系統端處理模組13係使用習知詞向量(Word Embedding)技術,將該欲建構物件特徵資訊與每一可調整物件特 徵資訊進行向量空間相似度比對,藉以獲得該目標調整物件特徵資訊。具體來說,若該欲建構物件特徵資訊為『典雅』,且該等可調整物件特徵資訊中與『典雅』相似度最高的詞為『優雅』,則會將『優雅』作為該目標調整物件特徵資訊,同時獲得『優雅』所對應的該目標調整方向。 In sub-step 643, for each second vector, the system-side processing module 13 uses the object characteristic information to be constructed in the object information to be constructed corresponding to the object to be constructed corresponding to the second vector, and the object characteristics The adjustment direction table obtains a target adjustment object feature information that matches the object feature information to be constructed from the adjustable object feature information in the object feature adjustment direction table, and adjusts the target adjustment object feature information corresponding to direction as the target adjustment direction. It is worth mentioning that in this embodiment, the system-side processing module 13 uses word embedding technology to combine the characteristic information of the object to be constructed with the characteristics of each adjustable object. The information is collected for vector space similarity comparison to obtain characteristic information of the target adjustment object. Specifically, if the characteristic information of the object to be constructed is "elegant", and the word with the highest similarity to "elegant" in the adjustable object characteristic information is "elegant", then "elegant" will be used as the target adjustment object Characteristic information, and at the same time obtain the adjustment direction of the target corresponding to "Elegance".

在子步驟644中,對於每一第二向量,該系統端處理模組13利用一預設數值及該目標調整方向,調整該第二向量中的該待調整元素,以獲得調整後的該第二向量。值得特別說明的是,在本實施例中,該系統端處理模組13係將該第二向量中的該待調整元素,由該目標調整方向所指示出正負號以決定加上或減去該預設數值,以獲得調整後的該第二向量。具體來說,若該目標調整方向為該正號『+』,則將該待調整元素加上該預設數值;若該目標調整方向為該負號『-』,則將該待調整元素減去該預設數值。 In sub-step 644, for each second vector, the system-side processing module 13 uses a preset value and the target adjustment direction to adjust the element to be adjusted in the second vector to obtain the adjusted third Two vectors. It is worth mentioning that in this embodiment, the system-side processing module 13 determines whether to add or subtract the element to be adjusted by adding or subtracting the sign indicated by the target adjustment direction in the second vector. Default value to obtain the adjusted second vector. Specifically, if the target adjustment direction is a positive sign "+", then the element to be adjusted is added to the preset value; if the target adjustment direction is a negative sign "-", the element to be adjusted is subtracted. Go to the default value.

在步驟65中,對於每一調整後的第二向量,該系統端處理模組13根據調整後的該第二向量及該映射表,自該等物件向量中,獲得一匹配調整後之該第二向量的目標物件向量,並將該目標物件向量所對應的該物件標籤作為一目標物件標籤,並將該目標物件標籤所屬於的該物件類別作為另一目標物件類別。其中,該系統端處理模組13係自該映射表之所有物件向量中,獲得與調整後的該第二向量之向量空間距離為最小者作為該目標物件向量。 In step 65, for each adjusted second vector, the system-side processing module 13 obtains a matching adjusted third vector from the object vectors based on the adjusted second vector and the mapping table. A two-vector target object vector, and the object label corresponding to the target object vector is used as one target object label, and the object category to which the target object label belongs is used as another target object category. Among all the object vectors in the mapping table, the system-side processing module 13 obtains the one with the smallest vector space distance from the adjusted second vector as the target object vector.

值得特別說明的是,在本實施例中,該映射表已記錄每一物件向量中之每一元素所對應的物件類別,故在僅對該待調整元素進行調整後,調正後之該第二向量所對應的另一目標物件類別與調正前之該第二向量所對應的該目標物件類別仍會相同。具體來說,若子步驟641所述之該待檢視物件標籤指示為『書桌』且屬於『桌』的該目標物件類別,子步驟642則獲得該第二向量中同樣屬於『桌』物件類別的該待調整元素,而於子步驟644中對該待調整元素進行調整後,步驟65中調整後之該第二向量所對應的該另一目標物件類別依然會是『桌』物件類別。其差異在於,調整後的該第二向量所對應的該目標物件標籤相較於調整前的該第二向量所對應的該待檢視物件標籤並不相同,且更能突顯該使用者所描述的外觀特徵。 It is worth mentioning that in this embodiment, the mapping table has recorded the object category corresponding to each element in each object vector. Therefore, after adjusting only the element to be adjusted, the adjusted third The other target object type corresponding to the two vectors will still be the same as the target object type corresponding to the second vector before adjustment. Specifically, if the label of the object to be inspected in sub-step 641 indicates "desk" and belongs to the target object category of "table", sub-step 642 obtains the object category in the second vector that also belongs to the "table" object category. The element to be adjusted, and after the element to be adjusted is adjusted in sub-step 644, the other target object category corresponding to the adjusted second vector in step 65 will still be the "table" object category. The difference is that the label of the target object corresponding to the second vector after adjustment is different from the label of the object to be viewed corresponding to the second vector before adjustment, and can better highlight what the user described. Appearance characteristics.

值得特別說明的是,在其他實施例中,該系統端處理模組13於子步驟621亦可不擷取出該欲建構物件特徵資訊,而不執行步驟64,於步驟65中使用該第二向量(未經步驟64調整),以獲得該目標物件標籤。 It is worth mentioning that in other embodiments, the system-side processing module 13 may not retrieve the characteristic information of the object to be constructed in sub-step 621, instead of executing step 64, and use the second vector ( without adjustment in step 64) to obtain the target object label.

在步驟66中,對於每一目標物件標籤,該系統端處理模組13根據該目標物件標籤及該指令集,產生一用於在該虛幻引擎中建構該目標物件標籤所指示出之物件的目標建構指令。如此一來,該虛幻引擎便能根據每一目標建構指令產生相對應的物件,以完成 虛擬場景的建置。 In step 66, for each target object tag, the system-side processing module 13 generates a target for constructing the object indicated by the target object tag in the Unreal Engine according to the target object tag and the instruction set. Build instructions. In this way, the Unreal Engine can generate corresponding objects according to each target construction instruction to complete the Construction of virtual scenes.

綜上所述,本發明模型建模指令生成方法,藉由該系統端處理模組13自所接收的該輸入資訊(例:自然語言),利用該第一階段模型擷取出該使用者所欲建構的該至少一欲建構物件資訊,接著,根據該至少一欲建構物件資訊所包含的該至少一欲建構物件名稱,利用該第二階段模型,獲得指示出該至少一欲建構物件名稱的該第一向量,接著,根據該第一向量,利用該解碼模型,獲得分別指示出該至少一欲建構物件的該至少一第二向量,接著,利用每一欲建構物件特徵資訊調整相對應的該第二向量,以獲得調整後的該第二向量,最後產生每一調整後之第二向量對應於該虛幻引擎中之物件的該目標建構指令,以供該虛幻引擎產生物件,如此一來,該使用者便能夠透過簡單且直覺對話描述方式產生該目標建購指令,使得該虛幻引擎產生各種符合該使用者所描述之特徵的物件,以完成理想中的虛擬場景,故確實能達成本發明的目的。 To sum up, the model modeling instruction generation method of the present invention uses the system-side processing module 13 to extract the input information (for example: natural language) received by the user by using the first-stage model. The at least one to-be-constructed object information is constructed, and then, based on the at least one to-be-constructed object name included in the at least one to-be-constructed object information, the second-stage model is used to obtain the at least one to-be-constructed object name indicating the at least one to-be-constructed object name. the first vector, and then use the decoding model to obtain the at least one second vector respectively indicating the at least one object to be constructed according to the first vector, and then use the characteristic information of each object to be constructed to adjust the corresponding The second vector is used to obtain the adjusted second vector, and finally each adjusted second vector is generated corresponding to the target construction instruction of the object in the Unreal Engine, so that the Unreal Engine can generate the object. In this way, The user can generate the target construction and purchase instructions through a simple and intuitive dialogue description method, so that the Unreal Engine can generate various objects that conform to the characteristics described by the user to complete the ideal virtual scene, so the present invention can indeed be achieved. the goal of.

惟以上所述者,僅為本發明的實施例而已,當不能以此限定本發明實施的範圍,凡是依本發明申請專利範圍及專利說明書內容所作的簡單的等效變化與修飾,皆仍屬本發明專利涵蓋的範圍內。 However, the above are only examples of the present invention. They cannot be used to limit the scope of the present invention. All simple equivalent changes and modifications made based on the patent scope of the present invention and the contents of the patent specification are still within the scope of the present invention. within the scope covered by the patent of this invention.

61~66:步驟 61~66: Steps

Claims (12)

一種模型建模指令生成方法,藉由一經由一通訊網路連接一電子裝置的模型建模指令生成系統來實施,該模型建模指令生成系統儲存有一包含多個對應於多個由一虛幻引擎所建構之物件的物件標籤與多個對應該等物件標籤之物件向量的映射表、一包含多個可調整物件特徵資訊與多個對應該等可調整物件特徵資訊且分別由正負號中之一者表示之調整方向的物件特徵調整方向表,及一包含多個用於建構該等物件且對應該等物件向量之建構指令的指令集,該模型建模指令生成方法包含以下步驟:(A)根據一來自該電子裝置且指示出至少一欲建構物件的輸入資訊,利用一用於自一資訊擷取出關於至少一待建構物件之至少一物件資訊的第一階段模型,獲得該輸入資訊中的至少一欲建構物件資訊,該至少一欲建構物件資訊分別對應該至少一欲建構物件,每一欲建構物件資訊包含一欲建構物件名稱資訊及一欲建構物件特徵資訊;(B)根據該至少一欲建構物件名稱資訊,獲得一對應該至少一欲建構物件資訊的第一向量;(C)根據該第一向量,利用一用於將一待解碼向量進行解碼並轉換為該至少一待建構物件所指示出之至少一解碼後向量的解碼模型,獲得至少一指示出該至少一欲建構物件的第二向量;(D)對於每一第二向量,利用該第二向量對應之該 欲建構物件所對應的欲建構物件資訊中的欲建構物件特徵資訊、該映射表及該物件特徵調整方向表,對該第二向量進行調整,以獲得調整後的該第二向量;(E)對於每一調整後的第二向量,根據調整後的該第二向量及該映射表,自該等物件向量中,獲得一匹配調整後的該第二向量的目標物件向量,並將該目標物件向量所對應的該物件標籤作為一目標物件標籤;及(F)對於每一目標物件標籤,根據該目標物件標籤及該指令集,產生一用於在該虛幻引擎中建構該目標物件標籤所指示出之物件的目標建構指令。 A model modeling instruction generation method is implemented by a model modeling instruction generation system connected to an electronic device through a communication network. The model modeling instruction generation system stores a model containing a plurality of files corresponding to a plurality of files generated by an Unreal Engine. A mapping table between the object tag of the constructed object and a plurality of object vectors corresponding to the corresponding object tags, a mapping table containing multiple adjustable object characteristic information and multiple corresponding adjustable object characteristic information and each having one of the positive and negative signs. An object feature adjustment direction table representing the adjustment direction, and an instruction set including a plurality of construction instructions for constructing the objects and corresponding to the object vectors. The model modeling instruction generation method includes the following steps: (A) According to An input information from the electronic device indicating at least one object to be constructed, using a first-stage model for extracting at least one object information about at least one object to be constructed from an information, obtaining at least one of the input information One object information to be constructed, the at least one object information to be constructed respectively corresponds to at least one object to be constructed, each object information to be constructed includes one object name information to be constructed and one object characteristic information to be constructed; (B) According to the at least one object to be constructed To construct object name information, obtain a pair of first vectors corresponding to at least one object information to be constructed; (C) According to the first vector, use a vector to be decoded to decode and convert it into at least one object to be constructed The decoding model of the indicated at least one decoded vector obtains at least one second vector indicating the at least one object to be constructed; (D) for each second vector, using the second vector corresponding to the second vector The object characteristic information to be constructed in the object information to be constructed corresponding to the object to be constructed, the mapping table and the object characteristic adjustment direction table are used to adjust the second vector to obtain the adjusted second vector; (E) For each adjusted second vector, according to the adjusted second vector and the mapping table, a target object vector matching the adjusted second vector is obtained from the object vectors, and the target object is The object label corresponding to the vector serves as a target object label; and (F) for each target object label, generate an instruction for constructing the target object label in the Unreal Engine based on the target object label and the instruction set. The object's target construction command. 如請求項1所述的模型建模指令生成方法,其中,在步驟(B)中,根據該至少一欲建構物件名稱資訊,利用一用於將該至少一物件資訊轉換為該輸出向量的第二階段模型,獲得對應該至少一欲建構物件資訊的該第一向量。 The method for generating model modeling instructions as described in claim 1, wherein in step (B), according to the at least one object name information to be constructed, a third method for converting the at least one object information into the output vector is used. The two-stage model obtains the first vector corresponding to the information of at least one object to be constructed. 如請求項2所述的模型建模指令生成方法,該模型建模指令生成系統還儲存有多個訓練集,每一訓練集包含至少一對應於一待訓練建構物件的訓練物件名稱資訊及每一訓練物件名稱資訊所對應的該物件標籤,其中,在步驟(A)之前,還包含以下步驟:(G)對於每一訓練集中的每一訓練物件名稱資訊,根據該訓練物件名稱資訊所對應的物件標籤,利用該映射表,自該等物件向量中,獲得一對應該訓練物件名稱資訊的訓練物件向量;(H)對於每一訓練集,根據該訓練集中該至少一訓 練物件名稱資訊所對應的該至少一訓練物件向量,利用一相對於步驟(C)之該解碼模型的編碼模型,獲得一對應該訓練集的第三向量;(I)將每一訓練集與其對應的該第三向量作為一訓練資料,並根據所有訓練資料,對一監督式的基石模型進行微調訓練,以獲得步驟(B)的該第二階段模型;及在步驟(A)中,該第一階段模型為該基石模型。 As for the model modeling instruction generation method described in claim 2, the model modeling instruction generation system also stores multiple training sets. Each training set includes at least one training object name information corresponding to a construction object to be trained and each training set. The object label corresponding to the training object name information, wherein, before step (A), the following steps are also included: (G) For each training object name information in each training set, according to the training object name information corresponding to object labels, and use the mapping table to obtain a pair of training object vectors corresponding to the training object name information from the object vectors; (H) for each training set, according to the at least one training set in the training set Train the at least one training object vector corresponding to the object name information, and obtain a third vector corresponding to the training set using a coding model relative to the decoding model of step (C); (I) combine each training set with its The corresponding third vector is used as a training data, and a supervised cornerstone model is fine-tuned and trained based on all the training data to obtain the second-stage model of step (B); and in step (A), the The first stage model is the cornerstone model. 如請求項2所述的模型建模指令生成方法,其中,該模型建模指令生成系統還儲存有多個關於該等物件標籤的物件類別,每一物件標籤被歸類為該等物件類別中之一者,該映射表還包含每一物件向量中之每一元素所對應的該物件類別,步驟(D)還包含以下步驟:(D-1)對於每一第二向量,根據該第二向量及該映射表,自該等物件向量中,獲得一匹配該第二向量的待檢視物件向量,並將該待檢視物件向量所對應的該物件標籤作為一待檢視物件標籤,並將該待檢視物件標籤所屬於的該物件類別作為一目標物件類別;(D-2)對於每一第二向量,根據該目標物件類別及該映射表,自該第二向量中的所有元素中,獲得一與該目標物件類別具有相同之物件類別的待調整元素;(D-3)對於每一第二向量,根據該第二向量對應之該欲建構物件所對應的欲建構物件資訊中的欲建構物件特徵資訊,及該物件特徵調整方向表,自該物件特徵調整方向表的該等可調整物件特徵資訊中,獲得一匹配該 欲建構物件特徵資訊的目標調整物件特徵資訊,並將該目標調整物件特徵資訊所對應的該調整方向作為該目標調整方向;及(D-4)對於每一第二向量,利用一預設數值及該目標調整方向,調整該第二向量中的該待調整元素,以獲得調整後的該第二向量。 The model modeling instruction generation method as described in claim 2, wherein the model modeling instruction generation system also stores a plurality of object categories related to the object tags, and each object tag is classified into one of the object categories. Alternatively, the mapping table also includes the object category corresponding to each element in each object vector. Step (D) also includes the following steps: (D-1) For each second vector, according to the second vector and the mapping table, from the object vectors, obtain an object vector to be inspected that matches the second vector, and use the object label corresponding to the object vector to be inspected as an object label to be inspected, and use the object vector to be inspected to View the object category to which the object label belongs as a target object category; (D-2) for each second vector, obtain a value from all elements in the second vector according to the target object category and the mapping table An element to be adjusted that has the same object type as the target object type; (D-3) for each second vector, the object to be constructed in the information of the object to be constructed corresponding to the object to be constructed corresponding to the second vector Feature information, and the object feature adjustment direction table, obtain a matching object feature information from the object feature adjustment direction table The target adjustment object feature information that is to be constructed is the object feature information, and the adjustment direction corresponding to the target adjustment object feature information is used as the target adjustment direction; and (D-4) for each second vector, use a default value and the target adjustment direction, and adjust the element to be adjusted in the second vector to obtain the adjusted second vector. 如請求項1所述的模型建模指令生成方法,其中,在步驟(C)中,每一第二向量之維度彼此皆相同,且大於該第一向量之維度。 The method for generating model modeling instructions as described in claim 1, wherein in step (C), the dimensions of each second vector are the same as each other and are larger than the dimension of the first vector. 如請求項1所述的模型建模指令生成方法,其中,在步驟(A)中,該輸入資訊還包含一關於該至少一欲建構物件的瀏覽紀錄。 The method for generating model modeling instructions as described in claim 1, wherein in step (A), the input information also includes a browsing record about the at least one object to be constructed. 一種模型建模指令生成系統,包含:一通訊模組,經由一通訊網路連接一電子裝置;一儲存模組,儲存有一包含多個對應於多個由一虛幻引擎所建構之物件的物件標籤與多個對應該等物件標籤之物件向量的映射表、一包含多個可調整物件特徵資訊與多個對應該等可調整物件特徵資訊且分別由正負號中之一者表示之調整方向的物件特徵調整方向表,及一包含多個用於建構該等物件且對應該等物件向量之建構指令的指令集;一處理模組,電連接該通訊模組及該儲存模組;及其中,該處理模組根據該通訊模組所接收之一來自該電子裝置且指示出至少一欲建構物件的輸入資訊,利 用一用於自一資訊擷取出關於至少一待建構物件之至少一物件資訊的第一階段模型,獲得該輸入資訊中的至少一欲建構物件資訊,該至少一欲建構物件資訊分別對應該至少一欲建構物件,每一欲建構物件資訊包含一欲建構物件名稱資訊及一欲建構物件特徵資訊,該處理模組根據該至少一欲建構物件名稱資訊,獲得一對應該至少一欲建構物件資訊的第一向量,該處理模組根據該第一向量,利用一用於將一待解碼向量進行解碼並轉換為該至少一待建構物件所指示出之至少一解碼後向量的解碼模型,獲得至少一指示出該至少一欲建構物件的第二向量,對於每一第二向量,利用該第二向量對應之該欲建構物件所對應的欲建構物件資訊中的欲建構物件特徵資訊、該映射表及該物件特徵調整方向表,對該第二向量進行調整,以獲得調整後的該第二向量,對於每一調整後的第二向量,該處理模組根據調整後的該第二向量及該映射表,自該等物件向量中,獲得一匹配調整後的該第二向量的目標物件向量,並將該目標物件向量所對應的該物件標籤作為一目標物件標籤,對於每一目標物件標籤,該處理模組根據該目標物件標籤及該指令集,產生一用於在該虛幻引擎中建構該目標物件標籤所指示出之物件的目標建構指令。 A model modeling instruction generation system includes: a communication module connected to an electronic device via a communication network; a storage module storing a plurality of object tags corresponding to a plurality of objects constructed by an Unreal Engine and A mapping table of a plurality of object vectors corresponding to the object labels, an object characteristic including a plurality of adjustable object feature information and a plurality of adjustment directions corresponding to the adjustable object feature information and each represented by one of positive and negative signs. Adjust the direction table, and an instruction set including a plurality of construction instructions for constructing the objects and corresponding to the object vectors; a processing module electrically connected to the communication module and the storage module; and wherein, the processing The module uses input information received from the electronic device indicating at least one object to be constructed based on the communication module. Using a first-stage model for extracting at least one object information about at least one object to be constructed from an information, at least one object information to be constructed in the input information is obtained, and the at least one object information to be constructed respectively corresponds to at least An object to be constructed. Each object information to be constructed includes a name information of an object to be constructed and a characteristic information of an object to be constructed. The processing module obtains a pair of information corresponding to at least one object to be constructed based on the at least one object name information to be constructed. The first vector, the processing module uses a decoding model for decoding a vector to be decoded and converting it into at least one decoded vector indicated by the at least one object to be constructed, to obtain at least A second vector indicating the at least one object to be constructed, for each second vector, using the characteristic information of the object to be constructed in the object to be constructed corresponding to the object to be constructed corresponding to the second vector, and the mapping table and the object feature adjustment direction table, and adjust the second vector to obtain the adjusted second vector. For each adjusted second vector, the processing module uses the adjusted second vector and the adjusted second vector. The mapping table obtains a target object vector matching the adjusted second vector from the object vectors, and uses the object label corresponding to the target object vector as a target object label. For each target object label, The processing module generates a target construction instruction for constructing the object indicated by the target object tag in the Unreal Engine based on the target object tag and the instruction set. 如請求項7所述的模型建模指令生成系統,其中,該處理模組根據該至少一欲建構物件名稱資訊,利用一用於將該至少一物件資訊轉換為該輸出向量的第二階段模 型,獲得對應該至少一欲建構物件資訊的該第一向量。 The model modeling instruction generation system of claim 7, wherein the processing module uses a second-stage model for converting the at least one object information into the output vector according to the at least one object name information to be constructed. type to obtain the first vector corresponding to the information of the at least one object to be constructed. 如請求項8所述的模型建模指令生成系統,其中,該儲存模組還儲存有多個訓練集,每一訓練集包含至少一對應於一待訓練建構物件的訓練物件名稱資訊及每一訓練物件名稱資訊所對應的該物件標籤;其中,對於每一訓練集中的每一訓練物件名稱資訊,該處理模組根據該訓練物件名稱資訊所對應的物件標籤,利用該映射表,自該等物件向量中,獲得一對應該訓練物件名稱資訊的訓練物件向量,對於每一訓練集,該處理模組根據該訓練集中該至少一訓練物件名稱資訊所對應的該至少一訓練物件向量,利用一相對於該解碼模型的編碼模型,獲得一對應該訓練集的第三向量,該處理模組將每一訓練集與其對應的該第三向量作為一訓練資料,並根據所有訓練資料,對一監督式的基石模型進行微調訓練,以獲得該第二階段模型,且該第一階段模型為該基石模型。 The model modeling instruction generation system as described in claim 8, wherein the storage module also stores a plurality of training sets, each training set including at least one training object name information corresponding to a construction object to be trained and each The object label corresponding to the training object name information; wherein, for each training object name information in each training set, the processing module uses the mapping table to extract data from the object label corresponding to the training object name information. In the object vector, a training object vector corresponding to the training object name information is obtained. For each training set, the processing module uses a training object vector corresponding to the at least one training object name information in the training set. Relative to the encoding model of the decoding model, a pair of third vectors of the training set is obtained. The processing module uses each training set and the corresponding third vector as a training data, and based on all the training data, performs a supervision The cornerstone model of the formula is fine-tuned and trained to obtain the second-stage model, and the first-stage model is the cornerstone model. 如請求項8所述的模型建模指令生成系統,其中,該儲存模組還儲存有多個關於該等物件標籤的物件類別,每一物件標籤被歸類為該等物件類別中之一者,該映射表還包含每一物件向量中之每一元素所對應的該物件類別;其中,對於每一第二向量,該處理模組根據該第二向量及該映射表,自該等物件向量中,獲得一匹配該第二向量的待檢視物件向量,並將該待檢視物件向量所對 應的該物件標籤作為一待檢視物件標籤,並將該待檢視物件標籤所屬於的該物件類別作為一目標物件類別,對於每一第二向量,該處理模組根據該目標物件類別及該映射表,自該第二向量中的所有元素中,獲得一與該目標物件類別具有相同之物件類別的待調整元素,對於每一第二向量,該處理模組根據該第二向量對應之該欲建構物件所對應的欲建構物件資訊中的欲建構物件特徵資訊,及該物件特徵調整方向表,自該物件特徵調整方向表的該等可調整物件特徵資訊中,獲得一匹配該欲建構物件特徵資訊的目標調整物件特徵資訊,並將該目標調整物件特徵資訊所對應的該調整方向作為該目標調整方向,對於每一第二向量,該處理模組利用一預設數值及該目標調整方向,調整該第二向量中的該待調整元素,以獲得調整後的該第二向量。 The model modeling instruction generation system as described in claim 8, wherein the storage module also stores a plurality of object categories related to the object tags, and each object tag is classified as one of the object categories. , the mapping table also includes the object category corresponding to each element in each object vector; wherein, for each second vector, the processing module derives from the object vectors according to the second vector and the mapping table , obtain an object vector to be inspected that matches the second vector, and align the object vector to be inspected The corresponding object label is used as an object label to be viewed, and the object category to which the object label to be viewed is used as a target object category. For each second vector, the processing module uses the target object category and the mapping to Table, from all elements in the second vector, obtain an element to be adjusted that has the same object type as the target object type. For each second vector, the processing module uses the desired object type corresponding to the second vector. The object characteristic information to be constructed in the object information to be constructed corresponding to the construction object, and the object characteristic adjustment direction table, obtain a feature matching the object characteristic to be constructed from the adjustable object characteristic information in the object characteristic adjustment direction table The target adjustment object characteristic information of the information is used, and the adjustment direction corresponding to the target adjustment object characteristic information is used as the target adjustment direction. For each second vector, the processing module uses a preset value and the target adjustment direction, Adjust the element to be adjusted in the second vector to obtain the adjusted second vector. 如請求項7所述的模型建模指令生成系統,其中,每一第二向量之維度彼此皆相同,且大於該第一向量之維度。 The model modeling instruction generation system of claim 7, wherein the dimensions of each second vector are the same as each other and are larger than the dimension of the first vector. 如請求項7所述的模型建模指令生成系統,其中,該輸入資訊還包含一關於該至少一欲建構物件的瀏覽紀錄。The model modeling instruction generation system of claim 7, wherein the input information also includes a browsing record of the at least one object to be constructed.
TW112120367A 2023-05-31 2023-05-31 Model modeling instruction generation method and system TWI817921B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW112120367A TWI817921B (en) 2023-05-31 2023-05-31 Model modeling instruction generation method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW112120367A TWI817921B (en) 2023-05-31 2023-05-31 Model modeling instruction generation method and system

Publications (1)

Publication Number Publication Date
TWI817921B true TWI817921B (en) 2023-10-01

Family

ID=89857881

Family Applications (1)

Application Number Title Priority Date Filing Date
TW112120367A TWI817921B (en) 2023-05-31 2023-05-31 Model modeling instruction generation method and system

Country Status (1)

Country Link
TW (1) TWI817921B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201931163A (en) * 2017-10-10 2019-08-01 香港商阿里巴巴集團服務有限公司 Image search and index building
CN110162700A (en) * 2019-04-23 2019-08-23 腾讯科技(深圳)有限公司 The training method of information recommendation and model, device, equipment and storage medium
WO2022042125A1 (en) * 2020-08-26 2022-03-03 湖北亿咖通科技有限公司 Named entity recognition method
US20220198516A1 (en) * 2020-03-02 2022-06-23 Tencent Technology (Shenzhen) Company Limited Data recommendation method and apparatus, computer device, and storage medium
CN115239429A (en) * 2022-07-29 2022-10-25 广州华多网络科技有限公司 Attribute information encoding method, device, equipment, medium and product

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201931163A (en) * 2017-10-10 2019-08-01 香港商阿里巴巴集團服務有限公司 Image search and index building
CN110162700A (en) * 2019-04-23 2019-08-23 腾讯科技(深圳)有限公司 The training method of information recommendation and model, device, equipment and storage medium
US20220198516A1 (en) * 2020-03-02 2022-06-23 Tencent Technology (Shenzhen) Company Limited Data recommendation method and apparatus, computer device, and storage medium
WO2022042125A1 (en) * 2020-08-26 2022-03-03 湖北亿咖通科技有限公司 Named entity recognition method
CN115239429A (en) * 2022-07-29 2022-10-25 广州华多网络科技有限公司 Attribute information encoding method, device, equipment, medium and product

Similar Documents

Publication Publication Date Title
CN111339246B (en) Query statement template generation method, device, equipment and medium
EP3889912B1 (en) Method and apparatus for generating video
WO2017177766A1 (en) Virtual reality device control method and apparatus, and virtual reality device and system
JP2021192222A (en) Video image interactive method and apparatus, electronic device, computer readable storage medium, and computer program
CN112836064A (en) Knowledge graph complementing method and device, storage medium and electronic equipment
JP2021168139A (en) Method, device, apparatus and medium for man-machine interactions
CN113010740B (en) Word weight generation method, device, equipment and medium
US11158349B2 (en) Methods and systems of automatically generating video content from scripts/text
CN116797684B (en) Image generation method, device, electronic equipment and storage medium
CN113408208B (en) Model training method, information extraction method, related device and storage medium
WO2023197749A9 (en) Background music insertion time point determining method and apparatus, device, and storage medium
WO2024046189A1 (en) Text generation method and apparatus
CN114245099A (en) Video generation method and device, electronic equipment and storage medium
CN114328988A (en) Multimedia data feature extraction method, multimedia data retrieval method and device
JP7337172B2 (en) Voice packet recommendation method, device, electronic device and program
CN117635275A (en) Intelligent electronic commerce operation commodity management platform and method based on big data
Zhu Metaaid 2.0: An extensible framework for developing metaverse applications via human-controllable pre-trained models
TWI817921B (en) Model modeling instruction generation method and system
CN113360683A (en) Method for training cross-modal retrieval model and cross-modal retrieval method and device
CN116611496A (en) Text-to-image generation model optimization method, device, equipment and storage medium
CN109300472A (en) A kind of audio recognition method, device, equipment and medium
US20210224310A1 (en) Electronic device and story generation method thereof
JP7113000B2 (en) Method and apparatus for generating images
CN113536009A (en) Data description method and device, computer readable medium and electronic device
CN113239215A (en) Multimedia resource classification method and device, electronic equipment and storage medium