WO2022177005A1 - 拡張現実映像表示システム - Google Patents

拡張現実映像表示システム Download PDF

Info

Publication number
WO2022177005A1
WO2022177005A1 PCT/JP2022/006903 JP2022006903W WO2022177005A1 WO 2022177005 A1 WO2022177005 A1 WO 2022177005A1 JP 2022006903 W JP2022006903 W JP 2022006903W WO 2022177005 A1 WO2022177005 A1 WO 2022177005A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
virtual design
augmented reality
image
display system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/006903
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
晴久 加藤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Luck'a Inc
Original Assignee
Luck'a Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Luck'a Inc filed Critical Luck'a Inc
Priority to JP2023500956A priority Critical patent/JP7599001B2/ja
Publication of WO2022177005A1 publication Critical patent/WO2022177005A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A41—WEARING APPAREL
    • A41D—OUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES
    • A41D13/00—Professional, industrial or sporting protective garments, e.g. surgeons' gowns or garments protecting against blows or punches
    • A41D13/05—Professional, industrial or sporting protective garments, e.g. surgeons' gowns or garments protecting against blows or punches protecting only a particular body part
    • A41D13/11—Protective face masks, e.g. for surgical use, or for use in foul atmospheres
    • A—HUMAN NECESSITIES
    • A41—WEARING APPAREL
    • A41H—APPLIANCES OR METHODS FOR MAKING CLOTHES, e.g. FOR DRESS-MAKING OR FOR TAILORING, NOT OTHERWISE PROVIDED FOR
    • A41H43/00—Other methods, machines or appliances
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37—Details of the operation on graphic patterns
    • G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to an augmented reality video display system capable of creating and displaying a synthesized video in which at least part of an object to be designed displayed in the video is replaced with a virtual design.
  • Patent Literature 1 describes a viewing mirror that appropriately processes images of various view targets such as landscapes and provides them to users.
  • Storage means for storing a virtual image of an object for which is specified in association with a view target;
  • Image synthesizing means for extracting a corresponding virtual image from the storage means and synthesizing and displaying the captured image of the view target; and capable of quickly and reliably displaying images of things such as ruins in an actual view.
  • Patent Literature 2 discloses that a fitting garment capable of image display is rented out at a sales floor with a mirror such as a full-length mirror for trying on, and a large number of image data are electronically processed at the sales floor or in a wider area.
  • One or more image data selected to be tried on is used for image display of the clothes to be tried on, and the image data selected to be purchased is used for clothes such as T-shirts.
  • Disclosed is a method of selling garments that prints on a printed garment and sells the printed garment.
  • the above-described method of selling clothes has a problem that it is necessary to prepare clothes to be tried on which can be image-displayed.
  • people since people have various body shapes, it is practically difficult to prepare fitting clothes capable of displaying images suited to these body shapes.
  • the designs to be printed on clothes are limited to those prepared in advance.
  • the design could not be changed.
  • such a system is large in size and cannot be installed in a space-saving manner.
  • the present invention provides an augmented reality video display system that can easily change the virtual reality design of an object whose design you want to change and that can display an augmented reality video using it. for the purpose.
  • the inventor of the present invention as a result of diligent research and development on the above-described problems, has found the following epoch-making augmented reality video display system.
  • a first aspect of the present invention for solving the above problems is a photographing unit for photographing an object to be designed, and an augmented reality image obtained by replacing at least part of the image of the object to be designed photographed by the photographing unit with a virtual design.
  • An augmented reality video display system comprising an augmented reality video synthesizing unit that synthesizes video and a display unit that displays the augmented reality video, wherein an object to be designed is displayed on at least a part of the surface by the display unit.
  • a virtual design replacement unit that replaces the virtual design with a virtual design when the image is captured by the image capture unit; Confirmed by a virtual design storage unit that stores a plurality of designs, a specific part confirmation unit that confirms whether the specific part is included in the image of the object to be designed photographed by the photographing unit, and a specific part confirmation unit.
  • a specified part determination unit for determining whether the specified part is photographed so as to meet predetermined determination conditions
  • a virtual design extraction part for extracting a virtual design from a virtual design storage unit based on the determination of the specified part determination unit.
  • a synthetic image creating unit that creates an augmented reality image by replacing the virtual design replacing unit with the virtual design extracted by the virtual design extracting unit.
  • augmented reality video refers to an augmented reality video obtained by superimposing a virtual reality video on a real video.
  • the first aspect it is possible to easily change the virtual design of the object to be designed, and display an augmented reality image using it.
  • a second aspect of the present invention is that the predetermined judgment condition is that the specific portion confirmation unit does not confirm the specific portion for a predetermined period of time, and the virtual design extraction unit performs the virtual design storage unit according to the predetermined extraction condition.
  • the virtual design of the object to be designed can be changed more easily, and the augmented reality video using it can be easily displayed.
  • the synthetic image creation unit includes a center position calculation unit that calculates the position of the center of the virtual design replacement unit in the image of the design object photographed by the photographing unit, and the center of the virtual design. at the position of the center of the virtual design replacement section calculated by the center position calculation section, and the length of the predetermined portion of the virtual design replacement section in the image of the object to be designed captured by the imaging section and an adjusted virtual design for creating an adjusted virtual design obtained by adjusting the length of the virtual design corresponding to the predetermined portion based on the length of the predetermined portion of the virtual design replacement portion
  • the augmented reality video according to the first or second aspect, comprising: a virtual design creating unit; and a synthesizing unit that replaces the virtual design replacing unit with the adjusted virtual design and synthesizes the augmented reality video. in the display system.
  • the third aspect it is possible to easily create an augmented reality image that matches the shape and size of the virtual design replacing portion of the object to be designed photographed by the photographing portion.
  • a person wearing or holding up the T-shirt can clearly imagine wearing the T-shirt with the virtual design.
  • a fourth aspect of the present invention further has an invisible light irradiation unit capable of irradiating invisible light, and the specific part confirmation unit detects the invisible light reflected by the specific part, and detects the area of the part where the invisible light is reflected.
  • the augmented reality video display system according to any one of the first to third aspects, characterized in that whether or not the specific part is included is determined based on.
  • the specific portion can be detected more accurately without being affected by the external environment, as compared with the case where the specific portion is detected based on the color, shape, or the like.
  • a fifth aspect of the present invention has a clarification processing unit that clarifies the difference between the virtual design replacement portion of the object to be designed and the portion other than the virtual design replacement portion included in the image captured by the image capture unit.
  • the augmented reality video display system according to any one of the first to fourth aspects, characterized by:
  • the virtual design replacement portion and the portion other than the virtual design replacement portion are discriminated from the video imaged by the imaging unit.
  • the image captured by the shooting unit is affected by the external environment (external light wavelength, intensity, etc.). It can get difficult.
  • the image (video) processing by the clarification processing section enables accurate discrimination between the virtual design replacement section and the portion other than the virtual design replacement section even in such a situation. be able to.
  • the image (video) processing by the clarification processing section enables accurate discrimination between the virtual design replacement section and the portion other than the virtual design replacement section even in such a situation. be able to.
  • a sixth aspect of the present invention comprises an input unit for inputting information such as characters and pictures, and a virtual design adding unit for adding information input from the input unit to a virtual design.
  • the augmented reality video display system according to any one of 1 to 5 aspects. According to the sixth aspect, it is possible to create and display a virtual design to which new information is added and an augmented reality image using the virtual design.
  • a seventh aspect of the present invention is any one of the first to sixth aspects, characterized by comprising an image data creation unit that creates image data from the augmented reality video created by the synthetic video creation unit.
  • the image data of the created augmented reality video (predetermined image data of the continuous augmented reality video) can be created.
  • This image data is image data (augmented reality image) of a certain moment in the augmented reality video, and is image data obtained by cutting out a certain moment of augmented reality different from reality.
  • This image data can be printed by a printer or the like, or used as a background image for a personal computer or the like.
  • An eighth aspect of the present invention is a sound output unit that outputs sound based on sound data, a sound data storage unit that stores sound data, and extracts sound data from the sound data storage unit based on a virtual design. and a sound data extraction unit.
  • a ninth aspect of the present invention is the virtual design according to any one of the first to eighth aspects, characterized in that an article of the same type or different from the article to be designed has a printing unit for printing the virtual design. It is in the object synthesis image display system.
  • the ninth aspect by transmitting the virtual design to the printing unit, it is possible to produce an article of the same type as or different from the designed article on which the same design as the augmented reality video is printed.
  • a tenth aspect of the present invention further comprises an information terminal connected via a network. , and at least one of the predetermined judgment conditions of the specific part judging part can be controlled. be.
  • the behavior of the augmented reality video display system (power on/off, angle of the imaging unit with respect to the object to be designed, brightness and contrast of the display unit, and predetermined at least one of the criteria) can be controlled.
  • An eleventh aspect of the present invention is an augmented reality video display system characterized in that the virtual design object composite video display system according to any one of the first to tenth aspects is stored in a housing. be.
  • the size becomes compact, so that it can be installed in various environments and easily transported. be able to.
  • the housing has a door, a door detection unit for detecting opening and closing of the door, and a predetermined image on the display unit according to the state of the door detected by the door detection unit. and an effect improving unit for displaying.
  • an effective image can be displayed on the display unit when the door is opened and closed. As a result, it is possible to improve the amusement of the augmented reality video display system.
  • a thirteenth aspect of the present invention is the augmented reality video display system according to any one of the first to twelfth aspects, wherein the object to be designed is clothes, a towel, a mask, or a smartphone case. It is in.
  • the virtual design of clothes, towels, masks, or smart phone cases can be easily changed, and an augmented reality image using it can be displayed.
  • the terms "unit” and “system” do not simply mean physical means, but also include cases where the functions of the "unit” and “system” are realized by software.
  • the functions of one "part” or “system” are realized by two or more physical means or devices, the functions of two or more "parts” or “systems” may be combined into one physical means or device. It may be realized by an apparatus.
  • FIG. 1 is a schematic diagram of a T-shirt used in Embodiment 1.
  • FIG. FIG. 2 is a schematic conceptual diagram of an augmented reality video display system according to Embodiment 1.
  • FIG. 3 is a schematic diagram of a main body according to Embodiment 1.
  • FIG. 4 is a schematic conceptual diagram of an augmented reality video synthesizing unit according to the first embodiment.
  • FIG. 5 is a schematic conceptual diagram of a composite image creating unit according to the first embodiment.
  • FIG. 6 is a flow chart showing the operation of the augmented reality video display system according to the first embodiment.
  • the object to be designed includes virtual design replacement units 301 (301a and 301b) that replace the virtual design 410 when displayed on the display unit 30 of the augmented reality video display system 1, which will be described later, on at least part of the surface, and virtual design replacement units 301 (301a and 301b), which will be described later.
  • virtual design replacement units 301 301a and 301b
  • the object to be designed is not particularly limited as long as it can be printed.
  • the object to be designed includes, for example, clothes, towels, masks, and smart phone cases.
  • the virtual design replacement unit 301 is not particularly limited as long as it can be replaced with a virtual design when displayed on the display unit 30 of the augmented reality video display system 1 .
  • the virtual design replacement portion 301 may be, for example, a portion colored green or blue used for chromakey.
  • the specifying unit 302 is not particularly limited as long as it indicates that the image includes the object to be designed when photographed by the photographing unit 20 of the augmented reality image display system 1 .
  • the identification part 302 a part (part) colored with a paint that has a higher light reflectance than other parts, and a specific shape that can be recognized by image analysis as an image that includes the object to be designed. and the like (part).
  • a T-shirt is used as the object 300 to be designed.
  • a specific part 302 colored with a paint having a higher light reflectance than other parts is formed in the central part of the T-shirt.
  • the surface 301a (virtual design replacement portion) other than the specified portion 302 is dyed green, and the back surface 301b (virtual design replacement portion) is dyed blue.
  • the shape, size, and material of the T-shirt are not particularly limited as long as they can form the identification portion 302 and the virtual design replacement portions 301a and 301b described above. Also, this T-shirt may be actually worn by a person, or may be held over the photographing unit 20 in front of or behind the person.
  • FIG. 2 is a schematic conceptual diagram of an augmented reality video display system according to this embodiment.
  • the augmented reality video display system 1 includes a main body 10 having two doors 11 attached to open on the left and right sides from the center, and a printing unit connected to the main body 10 via a network 200. 100.
  • a plurality of main bodies 10 are connected to the printing section 100 via the network 200 .
  • FIG. 3 is a schematic diagram of the main body 10 with the door open.
  • the main body 10 has a rectangular parallelepiped housing 12 , and includes an imaging unit 20 , a display unit 30 , and an augmented reality video synthesizing unit 40 inside.
  • the imaging unit 20, the display unit 30, and the augmented reality video synthesizing unit 40 are connected by wire or wirelessly.
  • the photographing unit 20 is attached to the center of the door side (front side) of the top plate inside the housing 12, and is capable of photographing a person or an object to be designed located in front of the main body 10. there is
  • the photographing unit 20 is not particularly limited as long as it can photograph the identifying portion 302 and the virtual design replacing portions 301a and 301b of the object 300 to be designed.
  • the display unit 30 is attached to the inner rear panel of the housing 12, and is capable of displaying an augmented reality image, which will be described later.
  • the display unit 30 is not particularly limited as long as it can display an augmented reality image. Examples of the display unit 30 include a liquid crystal display and an organic EL display.
  • the augmented reality video synthesizing unit 40 will be described.
  • the augmented reality image synthesizing unit 40 is attached to the lower part of the inside of the housing 12, and replaces at least a part of the image of the object to be designed 300 photographed by the photographing unit 20 with a virtual design 410, which will be described later, to generate an augmented reality image. can be synthesized.
  • FIG. 4 is a schematic conceptual diagram of the augmented reality video synthesizing unit 40.
  • the augmented reality video synthesis unit 40 includes a virtual design storage unit 41, a specific part confirmation unit 42, a specific part determination unit 43, a virtual design extraction unit 44, a synthetic video creation unit 45, have.
  • the virtual design storage unit 41 is not particularly limited as long as it can store a plurality of virtual designs 410 .
  • Examples of the virtual design storage unit 41 include commercially available database software capable of storing a plurality of virtual designs 410 .
  • the virtual design 410 refers to image data to be replaced by the virtual design replacing portions 301 a and 301 b of the object to be designed 300 when displayed on the display portion 30 .
  • the shape of the virtual design 410 is preferably the same shape (including the same shape) as the shape of the virtual design replacement portions 301a and 301b of the object to be designed 300, but the shapes may not be the same.
  • the virtual design 410 in this embodiment includes, for example, video (image) data from the neck to the waist of a character appearing in manga or animation.
  • the virtual design is composed of two image data, the virtual design on the front side of the T-shirt and the virtual design on the back side of the T-shirt.
  • the virtual design includes information related to the virtual design (image data of the overall image of the virtual design, creator of the virtual design, information on the fee and size when making a T-shirt described later) and the virtual design.
  • Image data related to the design (such as image data of a “frame” displayed around the display unit) may be included.
  • the specific part confirming part 42 is particularly limited as long as it can confirm whether or not the specific part 302 is included in the image of the design object 300 photographed by the photographing part 20 by color, shape, or the like. not.
  • Examples of the specific part confirmation part 42 include a program having such functions.
  • the invisible light irradiating unit such as an infrared irradiator capable of irradiating invisible light rays
  • the invisible light beams reflected by the identifying unit 302 function as the identifying unit confirmation unit 42.
  • the specified portion 302 is included (the area of the portion that reflects the invisible ray is the area of the specified portion 302 that has been set in advance). (judgment by whether or not it can be regarded as the same as).
  • the specific portion confirmation unit 42 By configuring the specific portion confirmation unit 42 in this way, the specific portion can be detected more accurately without being affected by the external environment, compared to the case where the specific portion 302 is detected based on the color, shape, or the like. . Note that in this embodiment, a program is used that recognizes a portion having a higher brightness than other portions as the identification portion 302 .
  • the specified part determining unit 43 is not particularly limited as long as it can determine whether the specified part 302 checked by the specified part checking unit 42 is photographed so as to satisfy a predetermined determination condition.
  • a program or the like having such a function can be used as the specific part determination part 43 .
  • the predetermined condition is not particularly limited as long as the identifying portion 302 can be confirmed by the identifying portion confirming portion 42 (condition).
  • the specific part confirmation unit 42 continuously recognizes (photographs) the specific part 302 .
  • the virtual design extraction unit 44 is not particularly limited as long as it can extract the virtual design 410 from the virtual design storage unit 41 based on the judgment of the identification unit judgment unit 43 .
  • Examples of the virtual design extractor 44 include programs having such functions. In the present embodiment, when a predetermined condition (the identification portion 302 is continuously recognized (captured)) is satisfied, no new virtual design 410 is extracted, and the identification portion 302 is fixed. A program is used that extracts the virtual design 410 from the virtual design storage unit 41 according to a predetermined extraction condition when it is not recognized for a period of time (for example, 0.5 seconds).
  • the synthetic video creating unit 45 is not particularly limited as long as it can replace the virtual design replacing units 301a and 301b with the virtual design 410 extracted by the virtual design extracting unit 44 to create an augmented reality video.
  • the composite video creating unit 45 may be a program having such functions. This embodiment is configured as follows.
  • FIG. 5 is a schematic conceptual diagram of the composite image creation unit 45.
  • the synthetic video creation unit 45 has a center position calculation unit 450, an arrangement unit 451, a length detection unit 452, an adjusted virtual design creation unit 453, and a synthesis unit 454. ing.
  • the center position calculation unit 450 is not particularly limited as long as it can calculate the positions of the center portions of the virtual design replacement units 301a and 301b in the image of the design object 300 captured by the image capturing unit 20.
  • FIG. As the center position calculation unit 450, for example, a program having such functions can be used.
  • the position of the central portion in the vertical direction is calculated from the upper and lower ends of the virtual design replacement portions 301a and 301b captured by the imaging unit 20, and the horizontal direction is calculated from the right and left ends of the virtual design replacement portions 301a and 301b.
  • the placement unit 451 is not particularly limited as long as it can place the center of the virtual design at the position of the center of the virtual design replacement units 301 a and 301 b calculated by the center position calculation unit 450 .
  • the placement unit 451 may be, for example, a program having such functions.
  • a program for calculating the position of the central portion of the virtual design and matching the calculated position with the positions of the central portions of the virtual design replacing units 301a and 301b calculated by the central position calculating unit 450 is provided. I am using
  • the length detection unit 452 is not particularly limited as long as it can detect the length of the predetermined portions of the virtual design replacement units 301a and 301b in the image of the object to be designed 300 captured by the imaging unit 20.
  • FIG. Examples of the length detection unit 452 include a program having such functions.
  • the virtual design replacement sections 301a and 301b are evenly divided into a predetermined number (for example, 20) in the horizontal direction, and a program is used to calculate the width (the number of dots, etc.) of each divided section. there is
  • the adjusted virtual design creation unit 453 adjusts the length of the virtual design 410 corresponding to the predetermined portion based on the length of the predetermined portion of the virtual design replacement units 301a and 301b. is not particularly limited as long as it can create Examples of the adjusted virtual design creating unit 453 include a program having such functions.
  • the virtual design is evenly divided into a predetermined number (for example, 20) in the horizontal direction, and the width (the number of dots, etc.) of each divided portion is calculated. , so that the length of each part calculated by the length detection unit 452 is obtained, and then synthesized, and similar to the virtual design replacement units 301a and 301b in the image of the object to be designed 300 photographed by the photographing unit 20.
  • a program is used to create a calibrated virtual design adjusted to shape and size.
  • the synthesizing unit 454 is not particularly limited as long as it can replace the virtual design replacing units 301a and 301b with the adjusted virtual design and synthesize an augmented reality video.
  • the synthesizing unit 454 may be, for example, a program having such functions. A similar program is used in this embodiment as well.
  • the front and back sides of the T-shirt can be replaced with corresponding virtual designs based on the color of the front side of the T-shirt (the color of the front side determines whether it is the front side or the back side). It is possible.
  • the main body 10 is not particularly limited as long as it has the functions described above.
  • the main body 10 may be, for example, a commercially available personal computer or a dedicated video processing device.
  • the printing unit 100 shown in FIG. 2 is not particularly limited as long as it can print the virtual design 410 on an article of the same kind as or different from the article to be designed 300 .
  • Examples of the printing unit 100 include a printing machine, a printing company, and the like.
  • the network 200 is not particularly limited regardless of whether it is wired or wireless, as long as it can connect the main body 10 and the printing unit 100 .
  • Examples of the network 200 include the Internet and an intranet.
  • FIG. 6 is a flow chart showing the operation of the augmented reality video display system 1. As shown in FIG.
  • the image of the object to be designed 300 is captured by the imaging unit 20 (S1). Then, the identification part confirmation part 42 confirms whether the image of the identification part 302 is included in the image captured by the imaging part 20 (S2).
  • the central position calculator 450 calculates the positions of the central parts of the virtual design replacement parts 301a and 301b in the image of the object to be designed 300 (S4). After that, the placement unit 451 calculates the position of the center of the virtual design 410 (S5), and the length detection unit 452 detects the length of the predetermined portion (S6).
  • an augmented reality video is created by the synthesizing unit 454 (S8).
  • the augmented reality image is finally displayed on the display unit 30 (S9).
  • the virtual design-related information about the virtual design displayed on the display unit 30 may be displayed on the lower part of the display unit 30 together with the augmented reality video.
  • the virtual design extraction unit 44 extracts the virtual design 410 from the virtual design storage unit 41 according to the predetermined extraction condition (S11). Thereafter, similar processing is performed from S4. These operations are repeated until the end operation is performed (S10).
  • the augmented reality video display system 1 By configuring the augmented reality video display system 1 as described above, it is possible to easily change the virtual reality design of an object whose design is to be changed, and to display an augmented reality video using it. .
  • the synthesized image creation unit 45 by configuring the synthesized image creation unit 45 as described above, it is possible to easily create an augmented reality image that matches the shape and size of the virtual design replacement units 301a and 301b of the object to be designed 300 photographed by the photographing unit 20. can be created in As a result, by viewing the augmented reality video, the person wearing or holding up the T-shirt can clearly imagine wearing the T-shirt with the virtual design.
  • the virtual design extraction unit 44 cannot extract a new virtual design when a predetermined condition (the identification unit 302 is continuously recognized (captured)) is satisfied. If the identification unit 302 is not recognized for a certain period of time (for example, 0.5 seconds), the virtual design is extracted from the virtual design storage unit 41 according to predetermined extraction conditions. Therefore, in order to prevent the identification part 302 from being photographed by the photographing unit 20, the virtual design can be easily performed by holding a hand, an arm or an obstacle between the identifying part 302 and the photographing unit 20, or flapping a T-shirt. can be changed. This embodiment has such an excellent user interface.
  • the predetermined extraction condition is not particularly limited, and for example, the virtual designs may be extracted according to a predetermined order, or the virtual designs may be extracted at random.
  • the printing unit 100 by sending a favorite virtual design 410 to the printing unit 100, it is also possible to produce an article of the same type or different from the designed article on which the same design (virtual design 410) as the design displayed in the augmented reality video is printed.
  • the same kind of article as the object to be designed 300 may be completely the same kind as the one photographed by the photographing section 20, or may be of a partially different kind.
  • the augmented reality video display system 1 since the augmented reality video display system 1 is built in the housing 12, the size is compact, so it can be installed in various environments and can be easily transported. In other words, the augmented reality video display system 1 is also the world's smallest original T-shirt store that allows virtual try-on. (Embodiment 2)
  • the augmented reality video display system may further include an input unit for inputting information such as characters and pictures, and a virtual design adding unit for adding the information input from the input unit to the virtual design.
  • an augmented reality video display system may be configured. Note that the locations where the input section and the virtual design addition section are attached are not particularly limited.
  • the input unit is not particularly limited as long as it can input information such as characters and pictures.
  • Examples of input units include keyboards, smartphones, notebook computers, and dedicated input devices.
  • the virtual design adding unit is not particularly limited as long as it can add information input from the input unit to the virtual design.
  • Examples of the virtual design adding unit include programs having such functions. Note that the virtual design adding unit adds information input from the input unit to the virtual design extracted by the virtual design extracting unit, and uses it as a new virtual design to generate the augmented reality image according to the first embodiment. It can be integrated into the display system.
  • the augmented reality video display system By configuring the augmented reality video display system in this way, it is possible to create a virtual design to which new information is added and an augmented reality video using it. In this embodiment, it is possible to display an augmented reality image of an original T-shirt with new information added to the virtual design, and to create a T-shirt with the original design by transmitting the design to the printing unit. can also (Embodiment 3)
  • an augmented reality image can be displayed and a design object printed with a virtual design can be produced, but the present invention is not limited to this.
  • a sound output unit that outputs sound based on sound data
  • a sound data storage unit that stores the sound data
  • the augmented reality video display system may be configured to further include a sound data extraction unit for extracting sound data.
  • the sound output unit is not particularly limited as long as it can output sound based on sound data.
  • Examples of the sound output unit include a speaker and the like.
  • the sound data is not particularly limited as long as it is data related to sound. Sound data includes, for example, sound effect data and performance data of a predetermined tune.
  • the place where the sound output section is attached is not particularly limited, it is preferably attached to the back surface of the display section. By attaching the sound output unit at this position, the augmented reality image displayed on the display unit and the sound are combined, thereby improving the amusement.
  • the sound data storage unit is not particularly limited as long as it can store sound data.
  • Examples of the sound data storage unit include commercially available database software.
  • the sound data extraction unit is not particularly limited as long as it can extract sound data from the sound data storage unit based on the virtual design.
  • the sound data extraction unit for example, the virtual design and the sound data are uniquely (one-to-one) associated with each other, and a program for extracting the sound data associated with the virtual design extracted by the virtual design extraction unit. is mentioned.
  • the augmented reality video display system By configuring the augmented reality video display system in this way, it is possible to output sounds that match the augmented reality video displayed on the display unit. Specifically, for example, when an original T-shirt of a certain band is displayed on the display unit as an augmented reality image, music of that band can be output. As a result, it is possible to increase a person's desire to purchase a T-shirt having the same design (virtual design) as that displayed in the augmented reality image.
  • the virtual design storage section 41 may also serve as the sound data storage section, and the virtual design extraction section may also serve as the sound data extraction section. (Embodiment 4)
  • the image captured by the imaging unit is affected by the external environment (external light wavelength, intensity, etc.), and depending on the external environment, it becomes difficult to distinguish between the virtual design replacement portion and the portion other than the virtual design replacement portion. Sometimes.
  • an augmented reality video display is provided so as to have a clarification processing unit that clarifies the difference between the virtual design replacement part of the design object and the part other than the virtual design replacement part included in the video shot by the shooting unit.
  • system may be configured.
  • the clarification processing section is not particularly limited as long as it can clarify the difference between the virtual design replacement section of the object to be designed and the portion other than the virtual design replacement section.
  • a program or the like that can change the contrast, brightness, brightness, etc. of an image captured by the imaging unit can be used.
  • the clarification processing unit may be built in the photographing unit, or the augmented reality video display system may be configured to have a personal computer or the like in which the above program or the like is installed.
  • the virtual design can be generated based on the data in which the clarification processing unit clarifies the difference between the virtual design replacement portion of the object to be designed and the portion other than the virtual design replacement portion.
  • a distinction can be made between the replacement portion and the portion other than the virtual design replacement portion.
  • the augmented reality video display system can easily change the virtual design of the object to be designed and reliably display the augmented reality video using it, regardless of the external environment. can be done. (Embodiment 5)
  • the augmented reality video created by the synthetic video creation section is displayed from the display section, but the present invention is not limited to this.
  • the augmented reality video display system may be configured to have an image data creation unit that creates image data from an augmented reality video.
  • the image data created by this image data creation unit is image data (augmented reality image) of a certain moment in the augmented reality video, and is image data of a moment of augmented reality that is different from reality. .
  • the image data creation unit is not particularly limited as long as it can create image data from an augmented reality video. mentioned.
  • the image data created by the image data creation unit can be printed by a printer or the like, or can be used as a background image for a personal computer or the like. (Embodiment 6)
  • the method of controlling the power on/off, the angle of the imaging unit with respect to the object to be designed, the brightness, brightness and contrast of the display unit, and the predetermined judgment conditions of the specific unit judgment unit are not particularly limited.
  • the augmented reality video display system may be configured to be remotely controllable.
  • the information terminal can turn on/off the power, the angle of the imaging unit with respect to the object to be designed, the brightness, brightness and contrast of the display unit, and the determination of the specific unit. At least one of the predetermined judgment conditions of the part may be controlled.
  • a switch or the like that can turn the power on/off via a network may be attached.
  • an angle adjuster or the like with a built-in motor that can be controlled from the outside is attached, and it is controlled from the information terminal while viewing the image photographed by the photographing unit. Just do it.
  • the brightness, brightness and contrast of the display section and the predetermined judgment conditions of the specific section judging section can be adjusted by installing a personal computer or the like in which such a program is installed and controlling it from an information terminal.
  • the behavior of the augmented reality image display system can be controlled remotely.
  • At least one of the predetermined judgment conditions of the judging unit can be controlled.
  • a door detection unit that detects the opening and closing of the door, and a sound output unit that outputs a sound effect according to the state of the door detected by the door detection unit, and a display unit that outputs
  • the augmented reality video display system may be configured to further include an effect improving unit that displays a predetermined video (effect video).
  • effect video a predetermined video
  • the sound effect and the effect image are not particularly limited.
  • the door detection unit is not particularly limited as long as it can detect opening and closing of the door inside the housing.
  • Examples of the door detection unit include commercially available door sensors.
  • the effect improving unit can cause the sound output unit to output a sound effect and display a predetermined image (effect image) on the display unit according to the state of the door detected by the door detection unit. It is not particularly limited. Examples of the effect improving unit include a program having such functions.
  • the augmented reality video display system By configuring the augmented reality video display system in this way, it is possible to output effective sound and display an effective video on the display unit when the door is opened and closed. As a result, it is possible to improve the amusement of the augmented reality video display system.
  • the augmented reality video synthesizing unit is configured to have a virtual design storage unit, a specific part confirmation unit, a specific part determination unit, a virtual design extraction unit, and a synthetic video creation unit.
  • the invention is not limited to this.
  • the configuration of the augmented reality image synthesizing unit is not particularly limited as long as it can synthesize an augmented reality image by replacing at least part of the image of the object to be designed photographed by the photographing unit with a virtual design.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Textile Engineering (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Physical Education & Sports Medicine (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
PCT/JP2022/006903 2021-02-22 2022-02-21 拡張現実映像表示システム Ceased WO2022177005A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2023500956A JP7599001B2 (ja) 2021-02-22 2022-02-21 拡張現実映像表示システム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021026841 2021-02-22
JP2021-026841 2021-02-22

Publications (1)

Publication Number Publication Date
WO2022177005A1 true WO2022177005A1 (ja) 2022-08-25

Family

ID=82932242

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/006903 Ceased WO2022177005A1 (ja) 2021-02-22 2022-02-21 拡張現実映像表示システム

Country Status (2)

Country Link
JP (1) JP7599001B2 (https=)
WO (1) WO2022177005A1 (https=)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003041420A (ja) * 2001-07-25 2003-02-13 Gonshichi Shoten:Kk 衣類の販売方法および試着印刷システム
JP2010070889A (ja) * 2008-09-22 2010-04-02 Seiren Co Ltd 仮想試着装置
JP2016004564A (ja) * 2014-06-19 2016-01-12 大日本印刷株式会社 拡張現実を利用した試着支援システム
JP2018195038A (ja) * 2017-05-17 2018-12-06 学校法人早稲田大学 画像処理装置及び画像処理方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003041420A (ja) * 2001-07-25 2003-02-13 Gonshichi Shoten:Kk 衣類の販売方法および試着印刷システム
JP2010070889A (ja) * 2008-09-22 2010-04-02 Seiren Co Ltd 仮想試着装置
JP2016004564A (ja) * 2014-06-19 2016-01-12 大日本印刷株式会社 拡張現実を利用した試着支援システム
JP2018195038A (ja) * 2017-05-17 2018-12-06 学校法人早稲田大学 画像処理装置及び画像処理方法

Also Published As

Publication number Publication date
JPWO2022177005A1 (https=) 2022-08-25
JP7599001B2 (ja) 2024-12-12

Similar Documents

Publication Publication Date Title
JP7523615B2 (ja) 拡張現実表示装置及び拡張現実表示方法
EP3121793B1 (en) Method and apparatus for generating an artificial picture
KR102266361B1 (ko) 거울을 가상화하는 디바이스들, 시스템들 및 방법들
EP2478695B1 (en) System and method for image processing and generating a body model
KR101720016B1 (ko) 미러 디스플레이를 구비한 특징점 기반 의상 피팅 시스템 및 방법
EP3218878B1 (en) Image to item mapping
JP7499819B2 (ja) ヘッドマウントディスプレイ
CN109477966A (zh) 具有内-外位置跟踪、用户身体跟踪和环境跟踪的用于虚拟现实和混合现实的头戴式显示器
EP3408835A1 (en) Virtually trying cloths on realistic body model of user
CN108564612A (zh) 模型显示方法、装置、存储介质及电子设备
HK1219796A1 (zh) 试穿支援装置以及方法
TWI638191B (zh) Door with mirror and image display
KR20140130767A (ko) 실사 영상 기반의 스마트 피팅장치를 이용한 소셜 서비스시스템
JP2012108805A (ja) 試着システム
JP2003085411A (ja) 画像入出力装置
WO2022177005A1 (ja) 拡張現実映像表示システム
WO2022177007A1 (ja) 拡張現実デザイン印刷システム
JP7593098B2 (ja) 画像処理装置、画像処理システム、画像処理方法およびプログラム
JP2019125262A (ja) 情報処理装置及び情報処理方法並びに情報処理用プログラム
JP4708397B2 (ja) 情報端末及びコンピュータプログラム
JP6786899B2 (ja) 印画物作製装置及び画像データ提供システム
JP7781726B2 (ja) 合成映像提供システム
CN113016011A (zh) 用于基底、涂覆品、中空玻璃单元等的增强现实系统和方法
US12469241B2 (en) Image processing apparatus, image processing method, recording medium, and image processing system, with change instruction to change form of 3D data
CN121970367A (zh) 摄影输出装置、摄影输出装置的工作方法及摄影输出装置的工作程序

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22756322

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023500956

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22756322

Country of ref document: EP

Kind code of ref document: A1