WO2023225777A1 - 将现实物件转换为虚拟实境的虚拟物件的方法 - Google Patents

将现实物件转换为虚拟实境的虚拟物件的方法 Download PDF

Info

Publication number
WO2023225777A1
WO2023225777A1 PCT/CN2022/094391 CN2022094391W WO2023225777A1 WO 2023225777 A1 WO2023225777 A1 WO 2023225777A1 CN 2022094391 W CN2022094391 W CN 2022094391W WO 2023225777 A1 WO2023225777 A1 WO 2023225777A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual
objects
real
virtual reality
environment
Prior art date
Application number
PCT/CN2022/094391
Other languages
English (en)
French (fr)
Inventor
曹承祥
黄相玮
黄麒瑾
林群贸
曾百庆
田嘉升
林保均
林咏章
林新庭
王光瑜
Original Assignee
伊甸数位股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 伊甸数位股份有限公司 filed Critical 伊甸数位股份有限公司
Priority to PCT/CN2022/094391 priority Critical patent/WO2023225777A1/zh
Publication of WO2023225777A1 publication Critical patent/WO2023225777A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics

Definitions

  • the present invention relates to virtual reality; in particular, it refers to a method of converting real objects into virtual objects in virtual reality.
  • Virtual Reality is realized by a head-mounted device, which is placed in front of the user's eyes and has a display.
  • the display is located in front of the user's eyes, and the virtual reality is displayed on the display. picture. Users can be immersed in virtual reality and engage in daily activities such as games, sports, meetings, and classes.
  • an object of the present invention is to provide a method for converting real objects into virtual objects in a virtual reality environment, so that the virtualization of real objects can be integrated into the virtual reality environment.
  • the present invention provides a method for converting real objects into virtual objects in virtual reality, which is applied to a head-mounted device.
  • the head-mounted device includes at least one camera module and a display module. ; The method includes the following steps:
  • E. Display a scene of a virtual reality in the display module, and attach the at least one virtual object to the scene.
  • the effect of the present invention is that it can convert real objects into virtual objects of virtual reality. Not only can the virtualization of real objects be integrated into the virtual reality, but also it can allow users to immerse themselves in the virtual reality. Realistic objects increase alertness and reduce the chance of colliding with real objects in the real environment.
  • Figure 1 is a usage scenario of the head-mounted device according to the first preferred embodiment of the present invention.
  • FIG. 2 is a system block diagram of the head-mounted device according to the first preferred embodiment of the present invention.
  • FIG. 3 is a flow chart of a method for converting real objects into virtual objects in a virtual reality according to the first preferred embodiment of the present invention.
  • Figure 4 is a schematic diagram showing real objects marked on the display module.
  • FIG. 5 is a schematic diagram showing a display module displaying virtual reality scenes and virtual objects.
  • FIG. 6 is a schematic diagram showing a display module displaying virtual reality scenes and virtual objects.
  • FIG. 7 is a schematic diagram showing a virtual reality scene and two virtual objects displayed on the display module.
  • Figure 8 is a schematic diagram illustrating the display module of a virtual reality scene and the replacement of virtual objects.
  • FIG. 9 is a schematic diagram showing a display module displaying virtual reality scenes, virtual objects and environmental images.
  • Figure 10 is a usage scenario of the head-mounted device according to the second preferred embodiment of the present invention.
  • FIG. 11 is a schematic diagram illustrating the display of virtual reality scenes and virtual objects on the display module.
  • FIG. 12 is a schematic diagram illustrating the display of virtual reality scenes and virtual objects on the display module.
  • Figure 13 is a schematic diagram illustrating the display of virtual reality scenes, virtual objects and environmental images on the display module.
  • FIG. 14 is a schematic diagram illustrating the display of virtual reality scenes, virtual objects and markers on the display module.
  • FIG. 1 is a usage scenario of the head-mounted device 10 applied to the method of converting real objects into virtual objects in a virtual reality according to the first preferred embodiment of the present invention.
  • the head-mounted device 10 is for use.
  • the device is worn on the head and includes at least one camera module 14 and a display module.
  • the head-mounted device 10 includes a processing module 12 , a plurality of photography modules 14 electrically connected to the processing module 12 , the display module 16 , and a speaker. 18.
  • the processing module 12 may be a central processing unit for executing a virtual reality program.
  • the plurality of photography modules 14 are controlled by the processing module 12 to capture environmental images of the environment where they are located, and transmit the captured environmental images to the processing module 12 .
  • Multiple photography modules 14 can increase the overall imaging range.
  • the processing module 12 integrates various environmental images into one environmental image. In practice, one photography module 14 can also be used.
  • the processing module 12 displays corresponding images on the display module 16 .
  • the displayed image includes a left image and a right image for the user to view.
  • the images displayed by the processing module 12 on the display module 16 may be virtual reality, environmental images, or a combination of the two.
  • the processing module 12 plays sound effects, music and other sounds through the speaker 18 .
  • the motion sensing module 20 is used to detect the user's motion and output corresponding detection signals, and may include an acceleration sensor and/or a gyroscope.
  • the processing module 12 correspondingly changes the viewing angle direction in the virtual reality according to the detection signal output by the motion sensing module 20.
  • the storage module 22 is used to store the virtual reality program, and the storage module 22 has a local database 222.
  • the database 222 includes a plurality of predetermined scenes of the virtual reality and a plurality of predetermined virtual objects.
  • Land the corresponding relationship between each of the predetermined scenes and its corresponding multiple predetermined virtual objects can be set in advance.
  • the predetermined scene is the wild, then the corresponding multiple predetermined virtual objects can be stones, trees, flowers, animals, etc., But it is not limited to this, and may also include other virtual objects such as monsters.
  • the plurality of predetermined scenes may also include seaside, space, indoors, factories, casinos, etc., and the predetermined virtual objects corresponding to each predetermined scene may be different.
  • the predetermined virtual objects corresponding to the factory can be tools, work tables, machines, etc., which are different from the predetermined virtual objects in the wild.
  • Some of the predetermined virtual objects can be common in all predetermined scenes.
  • the communication module 24 can be a wireless communication module, and the processing module 12 can communicate with an external server through the communication module 24 to obtain data from a database 302 of the server 30, for example, obtain new virtual reality data. environment program, new multiple scheduled scenes, and new multiple scheduled virtual objects.
  • the database 302 of the server 30 may be defined as an external database.
  • the processing module 12 can detect the user's hand through the photography module 14 and determine the user's hand as the input of the operation command. For example, the corresponding virtual option area is displayed in the display module 16, the user moves his hand within the imaging range of the photography module 14, and the processing module 12 determines the relative position of the user's hand and the virtual option area for corresponding purposes. selection operation.
  • the communication module 24 can also connect one or two controllers with signals, and the user can hold the controllers to operate.
  • the method of converting real objects into virtual objects of virtual reality in this embodiment can be performed.
  • the method includes the following steps shown in FIG. 3 .
  • Step S11 Obtain an environmental image of the environment through at least one photography module 14.
  • the processing module 12 controls the plurality of photography modules to capture the environment to continuously obtain images of the environment.
  • the processing module 12 simultaneously displays the environment image on the display module for the user to view.
  • the processing module 12 displays a prompt message on the display module 16 to prompt the user to look around so that the processing module 12 can obtain the surrounding environment image.
  • Step S12 Identify at least one real object from the environment image.
  • the processing module 12 uses image recognition to identify real objects from the acquired environmental images. For example, the processing module 12 calls an artificial intelligence program module to identify the characteristics of real objects. Features identified include the appearance of real-life objects and the ratio of width to height. Referring to FIG. 4 , there are multiple real objects 40 recognized by the processing module 12 , such as vases 41 and tables 42 .
  • a specific label element such as a two-dimensional barcode
  • the data of the two-dimensional barcode and the real object can be stored in the local database 222 or the external database 302.
  • the processing module 12 recognizes the two-dimensional barcode from the environmental image
  • the local database 222 or the external database 302 obtains the data of the real object.
  • Step S13 Select at least one real object 40.
  • the processing module 12 displays the environmental image in the display module 16, and marks the plurality of objects in the displayed environmental image.
  • the area of the real object 40 is marked with a frame line, for example.
  • the user may operate to select at least one of the plurality of real objects 40 , for example, the selected real object 40 is the table 42 .
  • the processing module 12 can also automatically select based on the recognized real object 40 , for example, automatically select a lower real object 40 , that is, the table 42 .
  • Step S14 According to the selected at least one real object 40, obtain the corresponding at least one virtual object 50 from the database.
  • the processing module 12 searches for a corresponding one from the predetermined virtual objects in the database 222 of the storage module 22 as the virtual object to be used.
  • this step includes selecting one of the plurality of predetermined scenes in the database 222 as the scene to be used subsequently. Since each of the predetermined scenes has a corresponding plurality of predetermined virtual objects, it can be selected from Select at least one of the corresponding plurality of predetermined virtual objects as at least one virtual object.
  • the processing module 12 displays the plurality of predetermined scenes in the display module 16 for the user to select one of them. Then, the processing module 12 displays a plurality of predetermined virtual objects corresponding to the selected scene in the display module 16 for the user to select one of them.
  • the processing module 12 can also select at least one predetermined feature that is similar to at least one of the aforementioned features according to the recognized features of the real object 40 (including appearance and/or the ratio of width and height).
  • the virtual object serves as the virtual object to be used.
  • the processing module 12 can also connect to the server 30 through the communication module 24, obtain other predetermined virtual objects from the database 302 of the server 30, and import them. to the local database 222 for selection.
  • Step S15 Display a virtual reality scene in the display module 16, and attach at least one virtual object to the scene.
  • the processing module 12 displays the scenes and virtual objects of the virtual reality in the display module 16 according to the scenes and virtual objects selected in step S14.
  • the scene selected by the user is the wild field
  • the virtual object 50 is a stone 51.
  • the real objects 40 in the user's environment can be converted into virtual objects 50 in the virtual reality, and displayed together with the virtual reality scene.
  • the user is immersed in the virtual reality environment, since he can see the virtual object 50 corresponding to the real object 40, he can pay attention to avoid the virtual object 50 when moving or acting in the virtual reality environment, effectively improving the existing virtual reality environment.
  • the disadvantage is that users can easily collide with real objects in the real world.
  • step S13 the user can also select multiple real objects 40, for example, select two real objects 40 in Figure 4.
  • step S14 the processing module 12 forms a group of the selected real objects 40 and obtains at least one virtual object 50 corresponding to the group from the local database 222 .
  • the processing module 12 may select the corresponding predetermined virtual object as the virtual object to be used according to the ratio of the width and height after forming the group, for example, select a large stone 52 with a taller shape.
  • the virtual object 50 displayed in step S15 is a big stone 52 (see FIG. 6 ).
  • the user can also choose the virtual object 50 to be used.
  • the user can also select two real objects 40 in FIG. 4 respectively.
  • the processing module 12 obtains corresponding virtual objects 50 according to the selected real objects 40, for example, selects two from the predetermined virtual objects in the database as the ones to be used.
  • Virtual objects 50 such as selected flowers and stones.
  • the two virtual objects 50 displayed in step S15 are a flower 53 and a stone 51 (refer to FIG. 7 ), and the processing module 12 displays the relative positions of the plurality of virtual objects 50 on the display module 16 corresponds to the relative positions of the plurality of real objects 40 in the environment.
  • this embodiment also includes the following steps.
  • Step S16 Detect the relative distance between the head-mounted device 10 and at least one real object 40 in the environment.
  • the processing module 12 determines the relative distance between the head-mounted device 10 and the real object 40 based on the environmental images continuously obtained by the multiple photography modules 14.
  • the head-mounted device 10 may also include a distance detection module for detecting relative distance.
  • the distance detection module may be, for example, an ultrasonic ranging module or a laser ranging module.
  • Step S17 When the relative distance between the head-mounted device 10 and the real object 40 in the environment is less than a first predetermined distance, the at least one virtual object 50 in the scene displayed in the display module 16 is Replace with at least one other virtual object 50.
  • the processing module 12 determines that the relative distance is less than or equal to the first predetermined distance
  • the original virtual object 50 stone 51
  • the first distance can be set, for example, between 80 and 120 centimeters, for example, 100 centimeters. This reminds the user that they are close to the real object.
  • a warning can also be issued in the head-mounted device 10 , for example, the processing module 12 controls the speaker 18 to emit a corresponding warning sound effect (such as the roar of the monster 54 ), or displays it on the display module 16 Warning message.
  • Step S18 When the relative distance between the head-mounted device 10 and the at least one real object 40 in the environment is less than a predetermined distance (ie, a second predetermined distance), the display module 16 displays the The environmental image obtained by at least one photography module 14 is added to the scene, wherein the second predetermined distance is smaller than the first predetermined distance.
  • a predetermined distance ie, a second predetermined distance
  • the processing module 12 when the user is closer to the real object 40 and the processing module 12 determines that the relative distance is less than or equal to the second predetermined distance, the processing module 12 adds the scene in the environment image to the virtual reality.
  • the second distance can be set to within 80 centimeters, for example, 60 centimeters. This allows the user to clearly see the real object 40 in the virtual reality scene, thereby reducing the chance of collision.
  • Figure 10 is a usage scenario of the head-mounted device 10 applied to the method of converting real objects into virtual objects in virtual reality according to the second preferred embodiment of the present invention.
  • the real object 40 is a cup as an example.
  • Container 43 the content of which is liquid.
  • the method of this embodiment is roughly the same as steps S11 to S15 of the first embodiment.
  • Real objects 40 can also be virtualized to form virtual objects 50 and cups 51 (see Figure 11), allowing them to exist in the virtual reality environment. It also allows the user to access real objects 40 at any time in the virtual reality environment without taking off the head-mounted device.
  • the processing module 12 allows the virtual object 50 to be used to be changed again, and the user can select the virtual object in the scene displayed by the display module 16 50.
  • the processing module allows the user to select another one from the predetermined virtual objects in the database as the virtual object to be replaced 50a (see FIG. 12).
  • step S15 includes:
  • the scene displayed in the display module 16 is added with the image obtained by the photography module 14 environmental images.
  • the processing module 12 determines from the environmental image that the relative distance between the hand 60 and the real object 40 in the environment is less than a predetermined distance.
  • the predetermined distance can be set to within 20 centimeters, and the environment image will be added to the scene. In this way, the user can clearly see the real object 40 and his/her hand 60 in the virtual reality scene, which reduces the chance of collision and facilitates the user to take the real object.
  • the processing module 12 when the processing module 12 determines that the recognized at least one real object 40 corresponds to a container, the processing module 12 also detects the contents of the at least one real object 40 The position of the top is the liquid level position of the detected liquid. If the top of the contents is not detected, it will not be marked. If the position of the top of the content is detected, the processing module 12 correspondingly marks the position of the top of the content on the virtual object 50 in the scene displayed in the display module 16 , that is, displays the corresponding liquid. A mark 62 for the surface position (refer to Figure 14). In this way, the virtual object 50 can better reflect the state of the real object 40, so that the user can more easily understand the remaining amount of the content in the container 43 in the virtual reality environment.
  • the present invention can convert real objects into virtual objects of virtual reality. Not only can the virtualization of real objects be integrated into virtual reality, but also it can allow users to immerse themselves in virtual reality.
  • the personalized real objects increase alertness and reduce the chance of colliding with real objects in the real environment.

Abstract

一种将现实物件转换为虚拟实境的虚拟物件的方法，所述方法包含下列步骤：通过头戴式装置的摄影模块取得环境的环境影像；从环境影像中辨识至少一个现实物件；选择所述至少一个现实物件；依据选择的所述至少一个现实物件，自一数据库中取得对应的至少一个虚拟物件；在头戴式装置的显示模块中显示一虚拟实境的一场景，且将所述至少一个虚拟物件附加至所述场景中。借此，将现实物件虚拟化整合至虚拟实境中。

Description

将现实物件转换为虚拟实境的虚拟物件的方法 技术领域
本发明与虚拟实境有关；特别是指一种将现实物件转换为虚拟实境的虚拟物件的方法。
背景技术
虚拟实境(Virtual Reality)是借由一头戴式装置实现，所述头戴式装置供使用者载于眼前且具有一显示器，显示器位于使用者眼晴的前方，在显示器上显示虚拟实境的画面。使用者便能沉浸在虚拟实境中，进行游戏、运动、会议、上课等日活动。
由于使用者沉浸于虚拟实境时，只能看到虚拟实境的画面，并无法看到周遭环境中的物件。例如使用者在房间内以头戴式装置游玩虚拟实境的游戏，房间中还有其它的物件，例如桌子、椅子等，但使用者在游玩虚拟实境的游戏时，并无法看到所述多个物件，可能一不小心就会碰撞到所述多个物件，而导致跌倒受伤的情形。因此，虚拟实境的开发业者，皆会提醒使用者在空旷的环境使用其设备，然而，确限制了虚拟实境的使用条件。
是以，现有的虚拟实境仍未臻完善，尚待改进。
发明内容
有鉴于此，本发明的目的在于提供一种将现实物件转换为虚拟实境的虚拟物件的方法，可以将现实物件虚拟化整合至虚拟实境中。
缘以达成上述目的，本发明提供的一种将现实物件转换为虚拟实境的虚拟物件的方法，是应用于一头戴式装置，所述头戴式装置包括至少一个摄影模块与一显示模块；所述方法包含下列步骤：
A.通过所述至少一个摄影模块取得环境的环境影像；
B.从环境影像中辨识至少一个现实物件；
C.选择所述至少一个现实物件；
D.依据选择的所述至少一个现实物件，自一数据库中取得对应的至少一个虚拟物件；
E.在所述显示模块中显示一虚拟实境的一场景，且将所述至少一个虚拟物件附加至所述场景中。
本发明的效果在于，可以将现实物件转换为虚拟实境的虚拟物件，不但可以将现实物件虚拟化整合至虚拟实境中，更可以让使用者沉浸在虚拟实境时，可以对虚拟化的现实物件提高警觉，减少真实环境中碰撞到现实物件的机会。
附图说明
图1为本发明第一优选实施例的头戴式装置的使用情境。
图2为本发明第一优选实施例的头戴式装置的系统方块图。
图3为本发明第一优选实施例的将现实物件转换为虚拟实境的虚拟物件的方法的流程图。
图4为一示意图，揭示在显示模块标示现实物件。
图5为一示意图，揭示在显示模块显示虚拟实境的场景及虚拟物件。
图6为一示意图，揭示在显示模块显示虚拟实境的场景及虚拟物件。
图7为一示意图，揭示在显示模块显示虚拟实境的场景及两个虚拟物件。
图8为一示意图，揭示在显示模块显示虚拟实境的场景及更换虚拟物件。
图9为一示意图，揭示在显示模块显示虚拟实境的场景、虚拟物件及环境影像。
图10为本发明第二优选实施例的头戴式装置的使用情境。
图11为一示意图，揭示在显示模块显示虚拟实境的场景及虚拟物件。
图12为一示意图，揭示在显示模块显示虚拟实境的场景及虚拟物件。
图13为一示意图，揭示在显示模块显示虚拟实境的场景、虚拟物件及环境影像。
图14为一示意图，揭示在显示模块显示虚拟实境的场景、虚拟物件及标记。
具体实施方式
为能更清楚地说明本发明，兹举优选实施例并配合附图详细说明如后。请参图1所示，为本发明第一优选实施例将现实物件转换为虚拟实境的虚拟物件的方法所应用的头戴式装置10的使用情境，所述头戴式装置10是供使用者戴于头上且包括至少一个摄影模块14与一显示模块。
请配合图2，于本实施例中，所述头戴式装置10包括一处理模块12、以及电性连接所述处理模块12的多个所述摄影模块14、所述显示模块16、一扬声器18、一动作感测模块20、一储存模块22与一通讯模块24。
所述处理模块12可为一中央处理器，用以执行一虚拟实境程序。所述多个摄影模块14受所述处理模块12控制，以拍摄所处的环境的环境影像，且将所拍摄的环境影像传送至所述处理模块12。多个摄影模块14可增加整体的取像范围，所述处理模块12将各个环境影像想整合为一个环境影像，实务上，亦可采用一个摄影模块14。
所述处理模块12在所述显示模块16上进行对应的画面的显示，所显示的画面包括左画面与右画面，以供使用者两眼观看。所述处理模块12在所述显示模块16显示的画面可为虚拟实境、环境影像、或为前述两者的结合。
所述处理模块12通过扬声器18播放音效、音乐等声音。
所述动作感测模块20用以侦测使用者的动作并输出对应的侦测讯号，其可包含加速感测器和/或陀螺仪。所述处理模块12依据所述动作感测模块20所输出的侦测讯号对应改变虚拟 实境的中的视角方向。
所述储存模块22用以储存所述虚拟实境程序，且所述储存模块22具有本地的一数据库222，所述数据库222包括虚拟实境的多个预定场景、及多个预定虚拟物件，优选地，可预先设定各所述预定场景与其对应的多个预定虚拟物件的对应关系，例如，预定场景为野外，则对应的多个预定虚拟物件可分别为石头、树木、花、动物等，但不以此为限，亦可包括其它的虚拟物件例如怪物等。所述多个预定场景亦可包括海边、太空、室内、工厂、赌场等，每个预定场景对应的预定虚拟物件可不相同。例如工厂对应的预定虚拟物件可为工具、工作桌、机台等，不同于野外的预定虚拟物件，当亦可有部分的预定虚拟物件在各预定场景皆为通用。
所述通讯模块24可为无线通信模块，所述处理模块12可通过所述通讯模块24与外部的服务器通讯，以自所述服务器30的一数据库302中取得数据，例如，取得新的虚拟实境程序、新的多个预定场景、新的多个预定虚拟物件。服务器30的数据库302可定义为外部的数据库。
此外，于本实施例中，所述处理模块12可以由摄影模块14侦测使用者的手部，且判断使用者的手部，作为操作指令的输入。例如，在显示模块16中显示对应的虚拟选项区域，使用者将手部移到摄影模块14的取像范围内，处理模块12判断使用者手部与虚拟选项区域的相对位置，以供进行对应的选取操作。
除了以手部作虚拟的操作之外，所述通讯模块24亦可讯号连接一或两个控制器，由使用者持拿控制器进行操作。
借由上述架构，即可进行本实施例的将现实物件转换为虚拟实境的虚拟物件的方法，所述方法包含图3所示的下列步骤。
步骤S11：通过至少一个摄影模块14取得环境的环境影像。
本实施例中，所述处理模块12控制所述多个摄影模块拍摄环境，以持续取得环境像。所述处理模块12同时在显示模块上显示环境影像，以供使用者观看。所述处理模块12在显示模块16上显示提示讯息，提示使用者环视四周围，以取供所述处理模块12取得四周围的环境影像
步骤S12：从环境影像中辨识至少一个现实物件。
本实施例中，所述处理模块12由取得的环境影像以影像辨识的方式辨识现实物件，例如所述处理模块12呼叫人工智能程序模块辨识现实物件的特征。所辨识的特征包括现实物件的外型、及宽度与高度的比例等。请参图4，所述处理模块12所辨识的现实物件40为多个，如花瓶41和桌子42。
在一实施例中，可预先在所要辨识的现实物件40上设置特定的标签元件，例如二维条形码，并建立二维条形码的与现实物件的数据储存于本地的数据库222或外部的数据库302，当处理模块12从环境影像中识别出二维条形码后，本地的数据库222或外部的数据库302取得现实物件的数据。
步骤S13：选择至少一个现实物件40。
本实施例中，请配合图4，当在环境影像中找出现实物件40时，所述处理模块12在显 示模块16中显示环境影像，且于所显示的环境影像中标示出所述多个现实物件40的区域，例如以框线标示。可由使用者进行操作以选择所述多个现实物件40中的至少一者，例如选择的现实物件40为桌子42。此外，亦可由所述处理模块12自动依据所辨识的现实物件40进行选择，例如，自动选择位置较低的一个现实物件40，即桌子42。
步骤S14：依据选择的所述至少一个现实物件40，自数据库中取得对应的至少一个虚拟物件50。
本实施例中，所述处理模块12是由储存模块22的数据库222的预定虚拟物件中寻找对应的一者作为所要使用的虚拟物件。优选地，本步骤中包含由所述数据库222中的所述多个预定场景中选择一者作为后续所要使用的场景，由于各所述预定场景皆具有对应的多个预定虚拟物件，故可从对应的所述多个预定虚拟物件中选择至少一者作为至少一个虚拟物件。举例而言，所述处理模块12在所述显示模块16中显示所述多个预定场景供使用者选择其中一者。接着，所述处理模块12在所述显示模块16中显示对应所选的场景的多个预定虚拟物件，供使用者选择其中一者。
除了由使用者选择之外，所述处理模块12亦可依照所辨识的现实物件40的特征(包括外型、和/或宽度与高度的比例)，选择与前述至少一个特征相近的至少一个预定虚拟物件作为欲使用的虚拟物件。
若本地的数据库222中无法选择合适的预定虚拟物件，所述处理模块12亦可经由通讯模块24连线至所述服务器30，由服务器30的数据库302中取得其它的预定虚拟物件，并汇入至本地的数据库222中，以供选择。
步骤S15：在所述显示模块16中显示一虚拟实境的场景，且将至少一个虚拟物件附加至所述场景中。
所述处理模块12依据在步骤S14中选择的场景及虚拟物件，在显示模块16中显示虚拟实境的场景及虚拟物件。如图5所示，使用者选择的场景为野外，虚拟物件50为石头51。
借由上述步骤，可以将使用者所处的环境中的现实物件40转换成虚拟实境中的虚拟物件50，并与虚拟实境的场景一同显示。当使用者沉浸在虚拟实境中，由于可以看到现实物件40对应的虚拟物件50，故在虚拟实境中移动或动作时，便可会注意要避开虚拟物件50，有效改善现有的虚拟实境中使用者易碰撞到现实物件的缺点。
另外，于步骤S13中，使用者亦可选择多个现实物件40，例如选择图4中的两个现实物件40。之后于步骤S14中，所述处理模块12将所选择的所述多个现实物件40形成一群组，并自本地的数据库222中取得对应所述群组的至少一个虚拟物件50。处理模块12可依据形成群组之后的宽度与高度的比例选择对应的预定虚拟物件作为所要使用的虚拟物件，例如选择具有较高形状的大石头52。于步骤S15中显示的虚拟物件50则为大石头52(参照图6)。当然，亦可由使用者自行选择要使用的虚拟物件50。
除了将多个现实物件40以群组选择之外，使用者亦可分别选择图4中的两个现实物件40。之后于步骤S14中，所述处理模块12依据选择的所述多个现实物件40分别取得对应的 多个所述虚拟物件50，例如从数据库中的预定虚拟物件中选择两个，作为所要使用的虚拟物件50，例如选择花和石头。于步骤S15中显示的两个虚拟物件50则为花53和石头51(图7参照)，且所述处理模块12在所述显示模块16上所显示的所述多个虚拟物件50的相对位置是对应所述多个现实物件40在环境中的相对位置。
为了更减少使用者碰撞现实物件40的机会，本实施例中，还包含下列步骤。
步骤S16，侦测所述头戴式装置10与至少一个现实物件40在环境中的相对距离。
本实施例中，所述处理模块12是基于所述多个摄影模块14持续取得的环境影像判断所述头戴式装置10与现实物件40的相对距离，但不以此为限，在其它实施例中，所述头戴式装置10亦可包括一距离侦测模块，用以侦测相对距离。距离侦测模块可例如是超音波测距模块或雷射测距模块。
步骤S17，在所述头戴式装置10与现实物件40在环境中的相对距离小于一第一预定距离时，将所述显示模块16中显示的所述场景中的所述至少一个虚拟物件50更换为另外至少一个虚拟物件50。
请配合图8，当使用者走近现实物件40时，所述处理模块12判断相对距离小于或等于所述第一预定距离时，则将原本的虚拟物件50(石头51)更换为另一个虚拟物件50(怪物54)，所述第一距离可例如设定为80～120公分之间，例如100公分。借此，提醒使用者已靠近现实物件。此外，亦可于所述头戴式装置10发出一警示，例如，所述处理模块12控制所述扬声器18发出对应的一警示音效(如怪物54的吼叫声)，或在显示模块16上显示警示讯息。
步骤S18，在所述头戴式装置10与所述至少一个现实物件40在环境中的相对距离小于一预定距离(即一第二预定距离)时，在所述显示模块16中显示的所述场景中附加至少一个摄影模块14取得的环境影像，其中所述第二预定距离小于所述第一预定距离。
本实施例中，当使用者更靠近现实物件40时，所述处理模块12判断相对距离小于或等于所述第二预定距离时，所述处理模块12将环境影像中附加至虚拟实境的场景中(参照图9)，所述第二距离可例如设定为80公分以内之间，例如60公分。借此，让使用者可在虚拟实境的场景中明显看到现实物件40，减少碰撞的机会。
图10为本发明第二优选实施例的将现实物件转换为虚拟实境的虚拟物件的方法所应用的头戴式装置10的使用情境，本实施例中，现实物件40为以杯子为例的容器43，其内容物为液体。本实施例的方法是以第一实施例的步骤S11～S15大致相同，同样可以将现实物件40虚拟化，形成虚拟物件50、杯子51(参照图11)，让其存在于虚拟实境中，并可以供使用者在不拿下头戴式装置的状态下，也能于虚拟实境中随时取用现实物件40。
本实施例中于步骤S15中显示虚拟物件50后(参照图11)，所述处理模块12允许再次更换所要使用的虚拟物件50，使用者可以操作选择显示模块16所显示的场景中的虚拟物件50，处理模块即可供使用者再从数据库中的预定虚拟物件选择其它一者作为欲更换的虚拟物件50a(参照图12)。
另外，于本实施例中，于步骤S15之后包含：
通过摄影模块14取得环境影像；
判断环境影像中具有使用者的手部，且使用者的手部与现实物件40在环境中的相对距离小于一预定距离时，在所述显示模块16中显示的场景中附加摄影模块14取得的环境影像。
如图13所示，当使用者的手部60进行摄影模块14的取像范围内，所述处理模块12从环境影像中判断手部60与现实物件40在环境中的相对距离小于预定距离，其中预定距离可设定为20公分以内，则在场景中附加环境影像。借此，让使用者可在虚拟实境的场景中明显看到现实物件40及自己的手部60，减少碰撞的机会，并且有利于使用者拿取现实物。
另外，于本实施例中还包含所述处理模块12判断所辨识的所述至少一个现实物件40对应于一容器时，所述处理模块12还侦测所述至少一个现实物件40中的内容物的顶部的位置，即侦测液体的液面位置。若未侦测到内容物的顶部，则不标示。若侦测到内容物的顶部的位置，则所述处理模块12在所述显示模块16中显示的所述场景中的虚拟物件50上对应标示所述内容物的顶部的位置，即显示对应液面位置的一标记62(参照图14)。借此，让虚拟物件50更能反应出现实物件40的状态，让使用者可以在虚拟实境中更容易了解容器43中内容物的剩余量。
据上所述，借由本发明可以将现实物件转换为虚拟实境的虚拟物件，不但可以将现实物件虚拟化整合至虚拟实境中，更可以让使用者沉浸在虚拟实境时，可以对虚拟化的现实物件提高警觉，减少真实环境中碰撞到现实物件的机会。
以上所述仅为本发明优选可行实施例而已，举凡应用本发明说明书及申请专利范围所为的等效变化，理应包含在本发明的专利范围内。
附图标记说明
10：头戴式装置
12：处理模块
14：摄影模块
16：显示模块
18：扬声器
20：动作感测模块
22：储存模块
222：数据库
24：通讯模块
30：服务器
302：数据库
40：现实物件
41：花瓶
42：桌子
43：容器
50：虚拟物件
50a：虚拟物件
51：石头
52：大石头
53：花
54：怪物
55：杯子
60：手部
62：标记
S11～S15：步骤

Claims (11)

  1. 一种将现实物件转换为虚拟实境的虚拟物件的方法，是应用于一头戴式装置，所述头戴式装置包括至少一个摄影模块与一显示模块；所述方法包含下列步骤：
    A.通过所述至少一个摄影模块取得环境的环境影像；
    B.从环境影像中辨识至少一个现实物件；
    C.选择所述至少一个现实物件；
    D.依据选择的所述至少一个现实物件，自一数据库中取得对应的至少一个虚拟物件；
    E.在所述显示模块中显示一虚拟实境的一场景，且将所述至少一个虚拟物件附加至所述场景中。
  2. 如权利要求1所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，步骤B中所辨识的所述至少一个现实物件为多个；步骤C中，包含在所述显示模块中显示环境影像，且在所显示的环境影像中标示所述多个现实物件；步骤C中是由使用者选择所述多个现实物件中的至少一个。
  3. 如权利要求2所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，步骤C中所选择的现实物件为多个；步骤D中是将所选择的所述多个现实物件形成一群组，并自所述数据库取得对应所述群组的所述至少一个虚拟物件。
  4. 如权利要求2所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，步骤C中所选择的现实物件为多个；步骤D中是依据选择的所述多个现实物件分别取得对应的多个所述虚拟物件；步骤E中是将所述多个虚拟物件附加至所述场景中。
  5. 如权利要求1所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，步骤D中包含从所述数据库中的多个预定场景中选择一个作为步骤E中所要显示的所述场景，各所述预定场景具有对应的多个预定虚拟物件；步骤D中是由所述多个预定虚拟物件中选择至少一者作为所述至少一个虚拟物件。
  6. 如权利要求1所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，步骤E之后包含：
    F.侦测所述头戴式装置与所述至少一个现实物件在环境中的相对距离；
    G.在所述头戴式装置与所述至少一个现实物件在环境中的相对距离小于一第一预定距离时，将所述显示模块中显示的所述场景中的所述至少一个虚拟物件更换为另外至少一个虚 拟物件。
  7. 如权利要求6所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，步骤G中，包含在所述头戴式装置与所述至少一个现实物件在环境中的相对距离小于所述第一预定距离时，在所述头戴式装置发出一警示。
  8. 如权利要求6所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，步骤G之后包含：
    H.在所述头戴式装置与所述至少一个现实物件在环境中的相对距离小于一第二预定距离时，在所述显示模块中显示的所述场景中附加所述至少一个摄影模块取得的环境影像，其中所述第二预定距离小于所述第一预定距离。
  9. 如权利要求1所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，步骤E之后包含：
    侦测所述头戴式装置与所述至少一个现实物件在环境中的相对距离；
    在所述头戴式装置与所述至少一个现实物件在环境中的相对距离小于一预定距离时，在所述显示模块中显示的所述场景中附加所述至少一个摄影模块取得的环境影像。
  10. 如权利要求1所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，步骤E之后包含：
    通过所述至少一个摄影模块取得环境影像；
    判断环境影像中具有使用者的手部，且使用者的手部与所述至少一个现实物件在环境中的相对距离小于一预定距离时，在所述显示模块中显示的所述场景中附加所述至少一个摄影模块取得的环境影像。
  11. 如权利要求1所述的将现实物件转换为虚拟实境的虚拟物件的方法，其中，还包含判断所辨识的所述至少一个现实物件对应于一容器时，从环境影像中侦测所述至少一个现实物件中的内容物的顶部的位置，且在所述显示模块中显示的所述场景中的所述至少一个虚拟物件上对应标示所述内容物的顶部的位置。
PCT/CN2022/094391 2022-05-23 2022-05-23 将现实物件转换为虚拟实境的虚拟物件的方法 WO2023225777A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/094391 WO2023225777A1 (zh) 2022-05-23 2022-05-23 将现实物件转换为虚拟实境的虚拟物件的方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/094391 WO2023225777A1 (zh) 2022-05-23 2022-05-23 将现实物件转换为虚拟实境的虚拟物件的方法

Publications (1)

Publication Number Publication Date
WO2023225777A1 true WO2023225777A1 (zh) 2023-11-30

Family

ID=88918115

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/094391 WO2023225777A1 (zh) 2022-05-23 2022-05-23 将现实物件转换为虚拟实境的虚拟物件的方法

Country Status (1)

Country Link
WO (1) WO2023225777A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120069051A1 (en) * 2008-09-11 2012-03-22 Netanel Hagbi Method and System for Compositing an Augmented Reality Scene
CN107850936A (zh) * 2015-01-28 2018-03-27 Ccp公司 用于提供物理环境的虚拟显示的方法和系统
CN108597033A (zh) * 2018-04-27 2018-09-28 深圳市零度智控科技有限公司 Vr游戏中现实障碍物的规避方法、vr设备及存储介质
CN110503001A (zh) * 2019-07-25 2019-11-26 青岛小鸟看看科技有限公司 一种虚拟现实vr设备及其避障方法、装置
CN113614609A (zh) * 2019-03-14 2021-11-05 微软技术许可有限责任公司 虚拟现实中的现实引导的漫游
CN113711165A (zh) * 2019-04-22 2021-11-26 微软技术许可有限责任公司 将虚拟环境与情境物理现实相混合

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120069051A1 (en) * 2008-09-11 2012-03-22 Netanel Hagbi Method and System for Compositing an Augmented Reality Scene
CN107850936A (zh) * 2015-01-28 2018-03-27 Ccp公司 用于提供物理环境的虚拟显示的方法和系统
CN108597033A (zh) * 2018-04-27 2018-09-28 深圳市零度智控科技有限公司 Vr游戏中现实障碍物的规避方法、vr设备及存储介质
CN113614609A (zh) * 2019-03-14 2021-11-05 微软技术许可有限责任公司 虚拟现实中的现实引导的漫游
CN113711165A (zh) * 2019-04-22 2021-11-26 微软技术许可有限责任公司 将虚拟环境与情境物理现实相混合
CN110503001A (zh) * 2019-07-25 2019-11-26 青岛小鸟看看科技有限公司 一种虚拟现实vr设备及其避障方法、装置

Similar Documents

Publication Publication Date Title
US11157070B2 (en) Massive simultaneous remote digital presence world
US10777016B2 (en) System and method of enhancing user's immersion in mixed reality mode of display apparatus
US11977670B2 (en) Mixed reality system for context-aware virtual object rendering
KR101917630B1 (ko) 증강 및 가상 현실을 위한 시스템 및 방법
CN105188516B (zh) 用于增强和虚拟现实的系统与方法
US20140002444A1 (en) Configuring an interaction zone within an augmented reality environment
EP2457627B1 (en) Portable type game device and method for controlling portable type game device
CN107209950A (zh) 从现实世界材料自动生成虚拟材料
WO2014050957A1 (ja) 表示装置、制御方法および制御プログラム
JP6656382B2 (ja) マルチメディア情報を処理する方法及び装置
WO2023225777A1 (zh) 将现实物件转换为虚拟实境的虚拟物件的方法
TWI830234B (zh) 將現實物件轉換為虛擬實境之虛擬物件的方法
JP6566209B2 (ja) プログラム及びアイウエア
JP2019101457A (ja) ヘッドマウントデバイスを介して情報を提供するためにコンピュータによって実行される方法、当該方法をコンピュータに実行させるプログラム、および、情報処理装置
JP2020103685A (ja) 動画配信システム、動画配信方法および動画配信プログラム
JP6431242B1 (ja) 視聴ユーザからのメッセージを含む動画を配信する動画配信システム
CN117677918A (zh) 增强现实体验的虚拟品尝和导览

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22942990

Country of ref document: EP

Kind code of ref document: A1