WO2019017582A1 - Procédé et système de collecte de modèles de contenu de réalité augmentée en fonction d'une source en nuage et de génération automatique d'un contenu de réalité augmentée - Google Patents

Procédé et système de collecte de modèles de contenu de réalité augmentée en fonction d'une source en nuage et de génération automatique d'un contenu de réalité augmentée Download PDF

Info

Publication number
WO2019017582A1
WO2019017582A1 PCT/KR2018/006020 KR2018006020W WO2019017582A1 WO 2019017582 A1 WO2019017582 A1 WO 2019017582A1 KR 2018006020 W KR2018006020 W KR 2018006020W WO 2019017582 A1 WO2019017582 A1 WO 2019017582A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
information
virtual content
background image
virtual
Prior art date
Application number
PCT/KR2018/006020
Other languages
English (en)
Korean (ko)
Inventor
정유진
김정희
Original Assignee
네이버랩스 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 네이버랩스 주식회사 filed Critical 네이버랩스 주식회사
Publication of WO2019017582A1 publication Critical patent/WO2019017582A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Definitions

  • the following description relates to a technique for generating Augmented Reality (AR) content.
  • AR Augmented Reality
  • UGC User Generated Contents
  • the present invention provides a method and system for collecting content information generated in real situations or backgrounds by users and providing it as content presets that are automatically edited and applied to real space by other users.
  • a method of generating content by computer comprising: associating background information, which is information related to the background image, with virtual content information that is information related to the virtual content, with respect to AR (Augmented Reality) content generated by combining virtual content with a background image ; Analyzing the background information and the virtual content information to determine a ranking of the virtual content information; Recommending at least one virtual content information using the ranking of the virtual content information for the specific background image when a specific background image is input from the electronic device; And generating new AR contents by applying the virtual content information selected from the recommended user among the recommended virtual content information to the specific background image.
  • the storing step may store at least one of the type and number of objects in the background image, the layout information, the context information of the background image, the location information, and the time information as the background information.
  • the storing step may store the parameter value of the virtual content combined with the background image as the virtual content information.
  • the determining step includes vectorizing the background information and the virtual content information, and embedding space in which a background vector representing the background information and a virtual content vector representing the virtual content information are mapped, ; And assigning a ranking to the virtual content information based on a distance between a vector representing the specific background image and a vector representing the specific background image in the embedding space after mapping the embedded background image to the embedding space.
  • the recommending step may recommend the at least one virtual content information using ranking according to at least one of a frequency of use of the virtual content information, a freshness, a location similarity, and a user profile have.
  • the virtual content vector in the embedding space among the virtual content information may be adjusted to rank the virtual content information within a certain distance from the vector representing the specific background image, It is possible to exclude at least some of the virtual content information whose virtual content vector is within a certain distance from the vector representing the specific background image from the recommendation target.
  • the virtual content information having the same content parameter among the virtual content information may be excluded from the recommendation target.
  • the virtual content information selected from the user of the electronic device among the recommended virtual content information may be provided with a preview applied to the specific background image.
  • the storing step may analyze the face image and store the facial expression information acquired from the analysis result together .
  • the recommending step when a specific face photograph is input from the electronic device, 3D character content having facial expression information corresponding to a facial expression of the specific face photograph may be recommended.
  • a computer-implemented content creation system comprising: at least one processor configured to execute computer-readable instructions, the at least one processor comprising: A content storage unit for associating background information, which is information related to a background image, with virtual content information that is information related to the virtual content; A content ranking unit for analyzing the background information and the virtual content information to determine a ranking of the virtual content information; A content recommending unit for recommending at least one virtual content information using the ranking of the virtual content information with respect to the specific background image when a specific background image is input from the electronic device; And a content generation unit for generating new AR contents by applying the virtual content information selected from the user of the electronic device among the recommended virtual content information to the specific background image.
  • AR contents are easily and conveniently generated by collecting content information generated by users in real situations or backgrounds and providing them as content presets that are automatically edited and applied to other users .
  • FIG. 1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention.
  • FIG. 2 is a block diagram for explaining an internal configuration of an electronic device and a server in an embodiment of the present invention.
  • FIG. 3 is a diagram illustrating an example of a component that a processor of a server according to an embodiment of the present invention may include.
  • FIG. 4 is a flowchart illustrating an example of a method that a server according to an embodiment of the present invention can perform.
  • 5 to 6 are views for explaining an example of a process of collecting background information and virtual content information utilized in AR content production according to an embodiment of the present invention.
  • FIG. 7 to 8 are views for explaining an example of a process of assigning ranking of virtual content information according to an embodiment of the present invention.
  • 9 to 11 are views for explaining an example of a process of recommending virtual content information according to an embodiment of the present invention.
  • Embodiments of the present invention relate to techniques for generating AR content, and more particularly, to a method and system for collecting AR content templates based on cloud sourcing and automatically generating AR contents therefrom.
  • Embodiments including those specifically disclosed herein may automatically generate new AR content using a content template created by an AR content by another user, thereby increasing content expansion, efficiency, convenience, cost reduction, etc. In the aspects of the present invention.
  • 1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention. 1 shows an example in which a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170 are included. 1, the number of electronic devices and the number of servers are not limited to those shown in FIG.
  • the plurality of electronic devices 110, 120, 130, 140 may be a fixed terminal implemented as a computer device or a mobile terminal.
  • the first electronic device 110 may communicate with other electronic devices 120, 130, 140 and / or the servers 150, 160 via the network 170 using a wireless or wired communication scheme.
  • the communication method is not limited, and may include a communication method using a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network 170 may include, as well as a short-range wireless communication between the devices.
  • the network 170 may be a personal area network (LAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN) , A network such as the Internet, and the like.
  • the network 170 may also include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, It is not limited.
  • Each of the servers 150 and 160 is a computer device or a plurality of computers that communicate with a plurality of electronic devices 110, 120, 130 and 140 through a network 170 to provide commands, codes, files, Lt; / RTI > devices.
  • the server 160 may provide a file for installation of an application to the first electronic device 110 connected via the network 170.
  • the first electronic device 110 can install an application using a file provided from the server 160.
  • the server 150 is connected to the server 150 according to the control of an operating system (OS) included in the first electronic device 110 or at least one program (for example, a browser or an installed application) Services and contents can be provided.
  • OS operating system
  • the server 150 transmits a code corresponding to the service request message to the first
  • the first electronic device 110 can provide contents to the user by displaying and displaying a screen according to the code according to the control of the application.
  • FIG. 2 is a block diagram for explaining an internal configuration of an electronic device and a server in an embodiment of the present invention.
  • the internal configuration of the first electronic device 110 as an example of one electronic device and the server 150 as an example of one server will be described.
  • Other electronic devices 120, 130, 140 or server 160 may have the same or similar internal configurations.
  • the first electronic device 110 and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223 and input / output interfaces 214 and 224.
  • the memories 211 and 221 may be a computer-readable recording medium and may include a permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), and a disk drive.
  • the memory 211 and 221 may store an operating system or at least one program code (for example, codes for an application installed and driven in the first electronic device 110). These software components may be loaded from a computer readable recording medium separate from the memories 211 and 221.
  • Such a computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, and a memory card.
  • the software components may be loaded into memory 211, 221 via communication modules 213, 223 rather than a computer readable recording medium.
  • at least one program may be a program installed by a file distribution system (for example, the server 160 described above) that distributes installation files of developers or applications, May be loaded into the memory 211, 221 based on the application described above.
  • Processors 212 and 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations.
  • the instructions may be provided to the processors 212 and 222 by the memories 211 and 221 or the communication modules 213 and 223.
  • the processor 212, 222 may be configured to execute a command received in accordance with a program code stored in a recording device, such as the memory 211, 221.
  • the communication modules 213 and 223 may provide a function for the first electronic device 110 and the server 150 to communicate with each other through the network 170 and may be connected to other electronic devices ) Or another server (e.g., server 160).
  • the request generated by the processor 212 of the first electronic device 110 in accordance with the program code stored in the recording device such as the memory 211 is transferred to the server 170 via the network 170 under the control of the communication module 213.
  • control signals, commands, contents, files, and the like provided under the control of the processor 222 of the server 150 are transmitted to the communication module 223 of the first electronic device 110 via the communication module 223 and the network 170, May be received by the first electronic device (110) via the second network (213).
  • the control signal or command of the server 150 received through the communication module 213 may be transmitted to the processor 212 or the memory 211, and contents or files may be transmitted to the first electronic device 110, May also be stored as a storage medium.
  • the input / output interface 214 may be a means for interfacing with the input / output device 215.
  • the input device may include a device such as a keyboard or a mouse
  • the output device may include a device such as a display for displaying a communication session of the application.
  • the input / output interface 214 may be a means for interfacing with a device having integrated functions for input and output, such as a touch screen.
  • the processor 212 of the first electronic device 110 may use the data provided by the server 150 or the second electronic device 120 in processing the instructions of the computer program loaded into the memory 211.
  • a service screen or contents configured by the user can be displayed on the display through the input / output interface 214.
  • the input / output interface 224 can also output information configured using the data provided by the server 150 in processing the instructions of the computer program loaded in the memory 221 by the processor 222 of the server 150 have.
  • the first electronic device 110 and the server 150 may include more components than the components of FIG. However, there is no need to clearly illustrate most prior art components.
  • the first electronic device 110 may be implemented to include at least some of the input / output devices 215 described above, or may be implemented as a transceiver, a Global Positioning System (GPS) module, a camera, And may further include components. More specifically, when the first electronic device 110 is a smart phone, it may be an acceleration sensor, a gyro sensor, a camera, various physical buttons, buttons using a touch panel, input / output ports, It is understood that various components such as a vibrator may be further included in the first electronic device 110.
  • GPS Global Positioning System
  • FIG. 3 is a diagram illustrating an example of a component that a server of a server according to an exemplary embodiment of the present invention may include;
  • FIG. 4 illustrates an example of a method that a server can perform according to an exemplary embodiment of the present invention; Fig.
  • the processor 222 of the server 150 includes a content storage unit 310, a content ranking unit 320, a content recommendation unit 330, and a content generation unit 340 can do.
  • Such processor 222 and components of the processor 222 may control the server 150 to perform the steps S410 through S440 included in the method of FIG.
  • the components of the processor 222 and the processor 222 may be implemented to execute instructions according to the code of the operating system and the code of at least one program that the memory 221 contains.
  • components of processor 222 may be representations of different functions performed by processor 222 in accordance with control commands provided by the operating system or by at least one program.
  • the content storage unit 310 may be used as a functional representation for controlling the processor 222 to collect and store AR contents according to the control command described above.
  • the content storage unit 310 may associate and store the background information included in the content and the virtual content information for each of the AR content generated in the AR UGC service environment based on the 3D content.
  • the server 150 serves as a platform for providing AR UGC services based on 3D content to a plurality of electronic devices 110, 120, 130 and 140 as clients.
  • a 3D content editing tool capable of applying positioning, movement, orientation, various styles and motion sets in a background image.
  • a user can create AR contents by synthesizing various virtual contents matching the background image by using a 3D content editing tool.
  • the virtual contents may include a human real picture, an unrealistic character, a general object, and the like, and may include text information such as a caption, and motion or movement information of the character.
  • the AR contents are designed to be combined into a background image and a virtual image, and may include background information and virtual content information.
  • the background information may be information on the background image used to generate the AR contents.
  • Background information may be spatial information about a space, and may include object information in a background or angle information of parameters of 3D contents.
  • the content storage unit 310 may analyze the information of the background image such as the actual background or the virtual background used for generating the AR content, and store the analyzed information as background information.
  • the content storage unit 310 recognizes an object in the background image through image analysis and stores the type and number of the recognized object, the layout information, background information of the background, position information (e.g., global positioning system Etc.), time information, and the like.
  • the virtual content information may be information on virtual content that can be overlaid on the background image.
  • the content storage unit 310 stores the position, size, number, movement, tracking, motion, and style information of the virtual content manually edited in the background image through the 3D content editing tool to create the AR content
  • the virtual content information can be stored together with the background information.
  • GIFs graphics interchange format
  • moving picture data moving picture data
  • AR contents generated by users and to collect information available for creating new AR contents based on the analyzed contents.
  • the content ranking unit 320 may analyze the background information and the virtual content information to determine the ranking of the virtual content information based on the background information.
  • the content ranking unit 320 may correlate the background information and the virtual content information to give a ranking on which content is mainly enhanced on a certain background and how the content is edited.
  • the content ranking unit 320 may individually rank various parameters (e.g., number, size, position, motion, style, etc.) of the virtual content used to generate the AR content. A concrete method of assigning the ranking of the virtual content information will be described below again.
  • step S430 when a specific background image is input from the electronic device 110, the content recommendation unit 330 may generate at least one virtual content information using the ranking of the virtual content information for the background information corresponding to the specific background image And can be recommended to the user of the electronic device 110. If the user selects a background image from the electronic device 110 or captures an actual background through the camera, the content recommendation unit 330 analyzes the background image and stores the most matching background information stored in step S410 It is possible to provide some virtual contents as recommended contents applicable to the background image by using the ranking of the virtual contents information based on the selected and selected background information.
  • the content recommendation unit 330 uses the AR content produced by other users to directly apply the virtual content, which is mainly used in the background matched with the background image selected by the user of the electronic device 110, to the background image It can be provided as a possible content preset.
  • the content recommending unit 330 may recommend the virtual content according to the overall situation of the background image or the main object among the objects in the background image.
  • the content recommending unit 330 may analyze a scene corresponding to a specific background image, and recommend a virtual content frequently used in a scene most similar to the scene.
  • the content recommendation unit 330 may recommend virtual content that is frequently used at a location related to a specific background image based on the location information included in the background information.
  • the content recommendation unit 330 may sequentially provide the next ranked virtual content information according to the user selection based on the ranking of the virtual content information.
  • the content recommendation unit 330 uses the caption information collected as the virtual content information as well as the 3D content as the content template applicable to the background image specified by the user of the electronic device 110, Can be provided together.
  • step S440 the content generation unit 340 generates the virtual content information selected by the user of the electronic device 110 among the virtual content information recommended in step S430 as the background image specified by the user of the electronic device 110
  • the new AR contents can be generated.
  • the user of the electronic device 110 can confirm the recommended content template for a specific background image, select a desired content template among the selected content template, and easily edit and create his or her own AR contents based on the template.
  • the content generation unit 340 may provide a 3D content editing tool capable of positioning, moving, orienting, and editing various styles and motion sets of a recommended content template.
  • the user can further create new AR contents by further editing the position or motion of the virtual content in the content template recommended for the specific background image by using the 3D content editing tool.
  • 5 to 6 are views for explaining an example of a process of collecting background information and virtual content information utilized in AR content production according to an embodiment of the present invention.
  • a user may create an AR content 500 by synthesizing a virtual content 520 that matches a background image 510 using a 3D content editing tool provided by a server 150.
  • FIG. 5 When the user generates the AR content 500 as the UGC contents, the content storage unit 310 stores information about the background image 510 included in the AR content 500 (type, number, placement information, background information, (E.g., position, size, number, movement, tracking motion, style information, etc.) of virtual content 520 manually edited Content information) can be recorded. Accordingly, the content storage unit 310 analyzes the AR content generated by the users and generates background information 610, which is information on the background image, and information on the virtual content, which is applied to the background image, The virtual content information 620 can be simultaneously recorded.
  • background information 610 which is information on the background image
  • the virtual content information 620 can be simultaneously recorded.
  • FIG. 7 to 8 are views for explaining an example of a process of assigning ranking of virtual content information according to an embodiment of the present invention.
  • the content ranking unit 320 can vectorize the background information and the virtual content information stored by the content storage unit 310, respectively.
  • the background information may include [background image, position information, time information]
  • the virtual content information may include [kind of content, number, size, position, motion].
  • FIG. 7 exemplarily shows a state in which the background information 610 and the virtual content information 620 of FIG. 6 are vectorized and mapped into a vector space.
  • the content ranking unit 320 uses the deep learning learning model to generate an embedding space such that the background vector 710 and the virtual content vector 720 are mapped into one space as shown in FIG. You can learn. At this time, it is possible to learn using a loss function (for example, triplet loss) so that backgrounds and contents that are generated as AR contents and related to each other are close to each other, and non-related backgrounds and contents of different AR contents are mapped away.
  • a loss function for example, triplet loss
  • the content ranking unit 320 maps the specific background vector 801 to the embedded embedding space previously obtained after vectorizing the specific background image, The virtual content vector 720 and the virtual content vector 720.
  • a higher rank may be assigned to a virtual content vector 720 closer to a specific background vector 801 based on a specific background vector 801. It is also possible to assign a rank based on the frequency of use of the virtual content information, the latestness, the location similarity, the user profile, and the like.
  • the content recommendation unit 330 can recommend virtual content frequently used by other users on a background similar to the background image specified by the user by using the ranking of the virtual content information. It is possible to exclude similar contents among the high ranked virtual contents in order to provide various contents as much as possible for a specific background image. For example, the content recommendation unit 330 may adjust the ranking of the contents in the embedding space to a certain distance from the specific background vector 801 or adjust the ranking of the contents within a predetermined distance from the specific background vector 801 It is possible to exclude the remainder excluding the arbitrarily selected at least one content from the recommendation object. As another example, it is possible to exclude contents having the same parameters such as the type and number of contents from virtual contents.
  • the content recommendation unit 330 can apply various recommendation criteria to the ranking of the virtual content information. For example, the content recommendation unit 330 may notify the user of the frequency of use, freshness, positional similarity, user profile, The virtual content information can be recommended according to the ranking.
  • 9 to 11 are views for explaining an example of a process of recommending virtual content information according to an embodiment of the present invention.
  • the content recommending unit 330 may activate a 'virtual content recommendation' menu 911 for recommending virtual content information.
  • the content recommendation unit 330 may display the virtual content 910 applicable to the background image 910 as shown in FIG. 10, (1011) can be recommended.
  • the virtual content 1011 is a content template directly applicable to the background image 910, and includes the history content of the AR content generated by the other users, which has the history similar to the background image 910 .
  • the virtual content 1011 can be sequentially provided according to rankings based on the frequency of use, freshness, position similarity, and user profile of the virtual content information.
  • the content recommending unit 330 may provide a preview function for showing a specific content 1020 selected by the user on the background image 910 of the virtual content 1011 . Then, the content recommendation unit 330 may sequentially provide the next ranked content according to the user's selection of the virtual content 1011. If the user selects the next ranked virtual content 1120 as shown in FIG. 11 The content 1120 can provide a preview of how the content 1120 is applied on the background image 910.
  • the recommended virtual content 1011 for the background image 910 input by the user includes parameter values manually edited by other users (position, size, number, movement, tracking, motion, style information, etc.) And can provide a preview of the parameter applied to the background image 910 as it is.
  • 3D facial modeling or 3D avatar can be generated by using the face photograph of the user.
  • the user can share contents among users in a service environment in which contents are produced by applying various motions and styles to a background image which is an actual real-time camera image, thereby applying user's face photographs to contents created by other users, / RTI >
  • the user A may combine various styles and motions using 2D photographs on which his / her face is imaged to create 3D character contents.
  • the server 150 may convert the 3D character contents created by the user A into video And store various parameters (character size, position, motion, style, movement path, etc.) of the contents when storing the contents.
  • the server 150 can recommend the 3D character content produced by the user A as virtual content applicable to the face photograph of the user B.
  • the user B can request the content embedding (e.g., replay) by selecting the 3D character content created by the user A among the recommended contents, and the server 150 can transmit the stored parameters for the content to the electronic device of the user B ,
  • the face of the 3D character content created by the user A can be automatically replaced with the face of the user B caught by the camera image.
  • the content embedding function can share not only the character but also the entire content scene in 3D form.
  • the server 150 may analyze face photographs when storing 3D character contents using face photographs, store facial expression information acquired from the analysis results together, and recommend contents using facial expression information.
  • the server 150 can recommend the 3D character content having the most similar appearance to the expression shown in the face photograph of the user B as the virtual content applicable to the face photograph of the user B.
  • the server 150 recommends the 3D character content having the facial expression information corresponding to the anger among the 3D character contents stored on the server 150 to the user B
  • a new 3D character content can be constructed by applying a model with the closest expression to the face photograph of the user B.
  • the user can apply the 3D character content created by another user to his / her character and reproduce new contents based on the 3D character content, which can be effectively used for viral marketing.
  • AR contents are easily and conveniently generated by collecting content information generated by users in real situations or backgrounds and providing them as content presets that are automatically edited and applied to other users can do.
  • the apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components.
  • the apparatus and components described in the embodiments may be implemented as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit, a microprocessor, or any other device capable of executing and responding to instructions.
  • the processing device may execute an operating system (OS) and one or more software applications running on the operating system.
  • the processing device may also access, store, manipulate, process, and generate data in response to execution of the software.
  • the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG.
  • the processing unit may comprise a plurality of processors or one processor and one controller.
  • Other processing configurations are also possible, such as a parallel processor.
  • the software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded.
  • the software and / or data may be embodied in any type of machine, component, physical device, computer storage media, or device for interpretation by a processing device or to provide instructions or data to the processing device have.
  • the software may be distributed over a networked computer system and stored or executed in a distributed manner.
  • the software and data may be stored on one or more computer readable recording media.
  • the method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium.
  • the medium may be a program that continuously stores a computer executable program, or temporarily stores the program for execution or downloading.
  • the medium may be a variety of recording means or storage means in the form of a combination of a single hardware or a plurality of hardware, but is not limited to a medium directly connected to any computer system, but may be dispersed on a network.
  • the medium examples include a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as CD-ROM and DVD, a magneto-optical medium such as a floptical disk, And program instructions including ROM, RAM, flash memory, and the like.
  • a recording medium or a storage medium that is managed by a site or a server that supplies or distributes an application store or various other software is also enumerated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Tourism & Hospitality (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Graphics (AREA)
  • Processing Or Creating Images (AREA)

Abstract

L'invention concerne un procédé de génération de contenu qui peut consister : par rapport à un contenu de réalité augmentée (AR) généré en combinant un contenu virtuel avec une image d'arrière-plan, à associer et à mémoriser des informations d'arrière-plan qui sont des informations relatives à l'image d'arrière-plan et des informations de contenu virtuel qui sont des informations relatives au contenu virtuel ; à analyser les informations d'arrière-plan et les informations de contenu virtuel de façon à déterminer un classement des informations de contenu virtuel ; lorsqu'une image d'arrière-plan particulière est entrée à partir d'un dispositif électronique, à recommander, pour l'image d'arrière-plan particulière, au moins un élément d'informations de contenu virtuel en utilisant le classement des informations de contenu virtuel ; à générer un nouveau contenu d'AR en appliquant, à l'image d'arrière-plan particulière, des informations de contenu virtuel sélectionnées par un utilisateur du dispositif électronique parmi des informations de contenu virtuel recommandées.
PCT/KR2018/006020 2017-07-18 2018-05-28 Procédé et système de collecte de modèles de contenu de réalité augmentée en fonction d'une source en nuage et de génération automatique d'un contenu de réalité augmentée WO2019017582A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020170090840A KR101989089B1 (ko) 2017-07-18 2017-07-18 클라우드 소싱 기반의 ａｒ 컨텐츠 템플릿을 수집하여 ａｒ 컨텐츠를 자동으로 생성하는 방법 및 시스템
KR10-2017-0090840 2017-07-18

Publications (1)

Publication Number Publication Date
WO2019017582A1 true WO2019017582A1 (fr) 2019-01-24

Family

ID=65015151

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2018/006020 WO2019017582A1 (fr) 2017-07-18 2018-05-28 Procédé et système de collecte de modèles de contenu de réalité augmentée en fonction d'une source en nuage et de génération automatique d'un contenu de réalité augmentée

Country Status (2)

Country Link
KR (1) KR101989089B1 (fr)
WO (1) WO2019017582A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020171558A1 (fr) * 2019-02-19 2020-08-27 Samsung Electronics Co., Ltd. Procédé de fourniture de contenus de réalité augmentée et dispositif électronique associé
CN112422812A (zh) * 2020-09-01 2021-02-26 华为技术有限公司 图像处理方法、移动终端及存储介质
WO2023153834A1 (fr) * 2022-02-11 2023-08-17 주식회사 유룸 Système, procédé et programme de fourniture d'une plateforme de production de site web 3d ayant une fonction d'édition

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102270581B1 (ko) * 2019-05-30 2021-06-29 주식회사 아임클라우드 콘텐츠로부터 추출된 객체를 이용한 참조 콘텐츠 추천 시스템 및 방법
KR102270590B1 (ko) * 2019-05-30 2021-06-30 주식회사 아임클라우드 색상 코드를 이용한 참조 콘텐츠 추천 시스템 및 방법
KR102156899B1 (ko) * 2019-11-14 2020-09-16 한국광기술원 디자인 생성장치 및 방법
CN115803779A (zh) * 2020-06-29 2023-03-14 斯纳普公司 分析增强现实内容使用数据
WO2022099008A1 (fr) * 2020-11-05 2022-05-12 Computer Generated Solutions, Inc. Systèmes et procédés d'intégration et d'utilisation de technologies de réalité augmentée
KR102479950B1 (ko) * 2021-01-08 2022-12-21 주식회사 럭스로보 Ar을 통한 모듈 조립이 가능한 코딩 교육용 시스템

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005277989A (ja) * 2004-03-26 2005-10-06 Oki Electric Ind Co Ltd 通信端末装置およびその画像提供方法
KR20130140339A (ko) * 2012-06-14 2013-12-24 에이알비전 (주) 멀티 플랫폼을 위한 증강현실 콘텐츠 저작시스템
KR20150028377A (ko) * 2013-09-04 2015-03-16 한국전자통신연구원 Sns 기반의 컨텐츠 제작 시스템 및 방법
KR20170009792A (ko) * 2015-07-17 2017-01-25 세종대학교산학협력단 융합 콘텐츠를 위한 콘텐츠 저작 장치 및 콘텐츠 저작 장치의 융합 콘텐츠 생성 방법
KR20170057736A (ko) * 2015-11-17 2017-05-25 주식회사 글로브포인트 교육용 vr 콘텐츠 제작 시스템 및 그 제어방법

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9582516B2 (en) * 2013-10-17 2017-02-28 Nant Holdings Ip, Llc Wide area augmented reality location-based services
CN103942049B (zh) * 2014-04-14 2018-09-07 百度在线网络技术（北京）有限公司 增强现实的实现方法、客户端装置和服务器

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005277989A (ja) * 2004-03-26 2005-10-06 Oki Electric Ind Co Ltd 通信端末装置およびその画像提供方法
KR20130140339A (ko) * 2012-06-14 2013-12-24 에이알비전 (주) 멀티 플랫폼을 위한 증강현실 콘텐츠 저작시스템
KR20150028377A (ko) * 2013-09-04 2015-03-16 한국전자통신연구원 Sns 기반의 컨텐츠 제작 시스템 및 방법
KR20170009792A (ko) * 2015-07-17 2017-01-25 세종대학교산학협력단 융합 콘텐츠를 위한 콘텐츠 저작 장치 및 콘텐츠 저작 장치의 융합 콘텐츠 생성 방법
KR20170057736A (ko) * 2015-11-17 2017-05-25 주식회사 글로브포인트 교육용 vr 콘텐츠 제작 시스템 및 그 제어방법

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020171558A1 (fr) * 2019-02-19 2020-08-27 Samsung Electronics Co., Ltd. Procédé de fourniture de contenus de réalité augmentée et dispositif électronique associé
US11238622B2 (en) 2019-02-19 2022-02-01 Samsung Electronics Co., Ltd. Method of providing augmented reality contents and electronic device therefor
CN112422812A (zh) * 2020-09-01 2021-02-26 华为技术有限公司 图像处理方法、移动终端及存储介质
CN112422812B (zh) * 2020-09-01 2022-03-29 华为技术有限公司 图像处理方法、移动终端及存储介质
WO2023153834A1 (fr) * 2022-02-11 2023-08-17 주식회사 유룸 Système, procédé et programme de fourniture d'une plateforme de production de site web 3d ayant une fonction d'édition

Also Published As

Publication number Publication date
KR101989089B1 (ko) 2019-06-14
KR20190009081A (ko) 2019-01-28

Similar Documents

Publication Publication Date Title
WO2019017582A1 (fr) Procédé et système de collecte de modèles de contenu de réalité augmentée en fonction d'une source en nuage et de génération automatique d'un contenu de réalité augmentée
KR101968723B1 (ko) 카메라 이펙트를 제공하는 방법 및 시스템
KR101933558B1 (ko) 동영상 내 하이라이트 댓글을 처리하기 위한 방법 및 시스템
WO2019117583A1 (fr) Procédé de messagerie spatiale et de partage de contenu, et système associé
WO2015174729A1 (fr) Procédé et système de fourniture de réalité augmentée destinés à fournir des informations spatiales, ainsi que support d'enregistrement et système de distribution de fichier
KR20160112898A (ko) 증강현실 기반 동적 서비스 제공 방법 및 장치
CN109905592B (zh) 根据用户的交互控制或者合成的内容的提供方法及装置
KR20190089681A (ko) 파노라마 뷰에 대한 ３차원 모델을 생성하는 방법 및 시스템
KR102199735B1 (ko) 영상을 위한 효과 공유 방법 및 시스템
KR102189924B1 (ko) ３ｄ 지도를 이용한 원격 위치 기반 ａｒ 저작 방법 및 시스템
WO2021125578A1 (fr) Procédé et système de reconnaissance de position reposant sur un traitement d'informations visuelles
CN115062183A (zh) 服务器的控制方法、计算机可读记录介质及系统
WO2019066231A1 (fr) Génération d'image représentative
KR20210121515A (ko) 이미지 내 텍스트 색상과 배경 색상을 추출하여 제공하는 방법, 시스템, 및 컴퓨터 프로그램
CN110990106B (zh) 数据展示方法、装置、计算机设备及存储介质
CN106257528B (zh) 通过用户间的合作生成内容的方法和系统
CN109863746A (zh) 交互式数据可视化环境
KR102040392B1 (ko) 클라우드 기반의 증강현실 콘텐츠 서비스 제공 방법
US20190378335A1 (en) Viewer position coordination in simulated reality
WO2019124850A1 (fr) Procédé et système de personnification et d'interaction avec un objet
WO2019172463A1 (fr) Procédé, système et support d'enregistrement non transitoire lisible par ordinateur pour recommander une photo d'un profil
CN115731406A (zh) 基于页面图的视觉差异性检测方法、装置及设备
KR20190094879A (ko) 실외 증강현실 서비스를 위한 모듈식 콘텐츠 제작 방법 및 장치
WO2021075878A1 (fr) Procédé permettant de fournir un service d'enregistrement de réalité augmentée et terminal utilisateur
CN114117092A (zh) 远程协作方法、装置、电子设备和计算机可读介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18834825

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18834825

Country of ref document: EP

Kind code of ref document: A1