KR102625304B1 - Method and apparatus for generating 3d model catalog - Google Patents

Abstract

This disclosure provides a method for creating a 3D model catalog. A method of generating a 3D model catalog includes receiving a first user input for selecting a plurality of 3D models for a plurality of objects from a user, receiving information associated with each of the plurality of objects, and the first user input and the plurality of objects. A step of outputting on a display a 3D model catalog page for a plurality of objects generated based on information associated with each of the objects, wherein the 3D model catalog page includes a plurality of content areas corresponding to the plurality of objects. Includes.

Description

Method and apparatus for generating a 3D model catalog {METHOD AND APPARATUS FOR GENERATING 3D MODEL CATALOG}

The present disclosure relates to a method and apparatus for generating a 3D model catalog, and specifically, to displaying a 3D model catalog page generated based on user input for selecting a plurality of 3D models and information associated with each of the plurality of objects. It relates to a method and device for outputting to.

Extended reality (XR) is a virtual convergence technology that immersively expands the user's experience in a virtual space similar to reality using various technologies such as AR (augmented reality), VR (virtual reality), and MR (mixed reality). It can be referred to. In particular, in the case of AR content, it has the advantage of allowing users to easily immerse themselves in digital information by providing digital information in combination with real space, so its field of use is diversifying.

Meanwhile, in existing online shopping platforms or shopping catalogs for product sales, photos of a single product and detailed information about a single product are generally provided to users within one page. Therefore, it is difficult for users to compare/check and purchase multiple products at the same time, and it is difficult for users to easily recall the size of the product and how it is placed in space.

Additionally, even when there is XR content related to a product, there is the inconvenience of requiring separate additional development to display XR content for multiple products on one page or image. Even if such a page is implemented, the implemented page is created as a one-time thing, making it difficult to maintain and modify, and if the page needs to be changed, such as when a product is changed or a new model is released, there is a problem that additional time and cost are required. .

The present disclosure provides a method for generating a 3D model catalog, a computer program stored in a recording medium, and a device (system) to solve the above problems.

The present disclosure may be implemented in various ways, including as a method, system (device), or computer program stored in a readable storage medium.

According to an embodiment of the present disclosure, a method of generating a three-dimensional model catalog, performed by at least one processor, comprising: receiving a first user input selecting a plurality of three-dimensional models for a plurality of objects from a user; Receiving information associated with each of the plurality of objects and outputting a three-dimensional model catalog page for the plurality of objects generated based on the first user input and the information associated with each of the plurality of objects on a display. And, the 3D model catalog page includes a plurality of content areas corresponding to a plurality of objects.

In one embodiment of the present disclosure, after the 3D model catalog page is created, receiving a second user input for modifying data associated with a specific object among the plurality of objects from the user and specific content associated with the specific object It includes outputting a 3D model catalog page with an updated area on a display.

In one embodiment of the present disclosure, in response to the second user input, other 3D model catalog pages containing the specific object are also automatically updated.

In one embodiment of the present disclosure, a plurality of content areas included in a 3D model catalog page are arranged and displayed in the order in which the user selects a plurality of 3D models in the first user input.

In one embodiment of the present disclosure, after the 3D model catalog page is generated, receiving a third user input for deactivating a specific object among the plurality of objects from the user and deactivating a specific content area associated with the specific object or outputting the deleted 3D model catalog page on a display, and in response to a third user input, a specific content area is automatically deactivated or deleted from another 3D model catalog page containing a specific object.

In one embodiment of the present disclosure, an interactive 3D model viewer that provides at least one display control function among rotation, enlargement, reduction, or movement of the 3D model is displayed in each of the plurality of content areas.

In one embodiment of the present disclosure, an animation object indicating that display control of a 3D model is possible is displayed on each of a plurality of content areas.

In one embodiment of the present disclosure, receiving a fourth user input for selecting a first visual object in a first content area associated with a first object among a plurality of content areas from a user, receiving at least one image from an image sensor It further includes receiving and overlaying Augmented Reality (AR) content of the first object on at least one image and outputting it on a display.

In one embodiment of the present disclosure, receiving a fifth user input from a user for selecting a second visual object in a second content area associated with a second object among the plurality of content areas and displaying a first visual object on at least one image Further comprising the step of overlaying the AR content of the object and the AR content of the second object and outputting them on the display, wherein the AR content of the first object and the AR content of the second object are rotated, enlarged, reduced, or moved. Display control is possible.

In one embodiment of the present disclosure, the information associated with each of the plurality of objects includes the address of a web page selling each of the plurality of objects, and the third content area within the specific content area associated with the specific object among the plurality of content areas from the user. In response to receiving a sixth user input selecting a visual object, a web page selling the particular object is displayed on the display.

A computer program stored in a computer-readable recording medium is provided to execute the 3D model catalog generation method according to an embodiment of the present disclosure on a computer.

In the device according to an embodiment of the present disclosure, it includes a communication module, a memory, and at least one processor connected to the memory and configured to execute at least one computer-readable program included in the memory, and the at least one program includes , receiving a first user input for selecting a plurality of three-dimensional models for a plurality of objects from a user, receiving information associated with each of the plurality of objects, and receiving information associated with the first user input and each of the plurality of objects. It includes commands for outputting a 3D model catalog page for a plurality of objects generated based on the display on a display, and the 3D model catalog page includes a plurality of content areas corresponding to the plurality of objects.

In various embodiments of the present disclosure, a user can check a plurality of objects provided on a catalog page at an angle and size desired by the user by executing at least one display control function among rotating, enlarging, reducing, or moving the 3D model. there is.

In various embodiments of the present disclosure, simply modifying or deactivating information associated with an object in one catalog page updates all catalog pages associated therewith, allowing the creator of the catalog page to individually modify, deactivate, or delete a plurality of catalog pages. It can reduce the hassle of having to do it.

In various embodiments of the present disclosure, a plurality of AR contents are overlaid on an image captured by a camera, so that a user can compare a plurality of objects in one space using the plurality of AR contents.

The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned are clear to a person skilled in the art (referred to as “a person skilled in the art”) in the technical field to which the present disclosure pertains from the description of the claims. It will be understandable.

Embodiments of the present disclosure will be described with reference to the accompanying drawings described below, in which like reference numerals indicate like elements, but are not limited thereto.
1 is a diagram illustrating an example of a 3D model catalog page according to an embodiment of the present disclosure.
Figure 2 is a schematic diagram showing a configuration in which an information processing system is connected to communicate with a plurality of user terminals in order to provide a 3D model catalog creation service according to an embodiment of the present disclosure.
Figure 3 is a block diagram showing the internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure.
Figure 4 is a diagram illustrating an example of a content area included in a 3D model catalog page according to an embodiment of the present disclosure.
Figure 5 is a diagram illustrating an example of a display on which a detailed screen related to a 3D model is displayed according to an embodiment of the present disclosure.
Figure 6 is a diagram illustrating an example of a 3D model list according to an embodiment of the present disclosure.
FIG. 7 is a diagram illustrating an example in which a 3D model catalog page is created in response to selecting a plurality of 3D models according to an embodiment of the present disclosure.
FIG. 8 is a diagram illustrating an example of a modification screen for modifying data associated with a specific object according to an embodiment of the present disclosure.
Figure 9 is a diagram illustrating an example in which the display order of content areas within a catalog page is changed according to an embodiment of the present disclosure.
FIG. 10 is a diagram illustrating an example of a display on which AR content is output according to an embodiment of the present disclosure.
Figure 11 is a diagram illustrating an example of a web page selling a specific object being displayed according to an embodiment of the present disclosure.
Figure 12 is a diagram illustrating an example of a management screen of a plurality of catalog pages according to an embodiment of the present disclosure.
Figure 13 is a flowchart showing a method for generating a 3D model catalog according to an embodiment of the present disclosure.

Hereinafter, specific details for implementing the present disclosure will be described in detail with reference to the attached drawings. However, in the following description, detailed descriptions of well-known functions or configurations will be omitted if there is a risk of unnecessarily obscuring the gist of the present disclosure.

In the accompanying drawings, identical or corresponding components are given the same reference numerals. Additionally, in the description of the following embodiments, overlapping descriptions of identical or corresponding components may be omitted. However, even if descriptions of components are omitted, it is not intended that such components are not included in any embodiment.

Advantages and features of the disclosed embodiments and methods for achieving them will become clear by referring to the embodiments described below in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the present disclosure is complete and that the present disclosure does not convey the scope of the invention to those skilled in the art. It is provided only for complete information.

Terms used in this specification will be briefly described, and the disclosed embodiments will be described in detail. The terms used in this specification are general terms that are currently widely used as much as possible while considering the function in the present disclosure, but this may vary depending on the intention or precedent of a technician working in the related field, the emergence of new technology, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the relevant invention. Accordingly, the terms used in this disclosure should be defined based on the meaning of the term and the overall content of the present disclosure, rather than simply the name of the term.

In this specification, singular expressions include plural expressions, unless the context clearly specifies the singular. Additionally, plural expressions include singular expressions, unless the context clearly specifies plural expressions. When it is said that a certain part includes a certain element throughout the specification, this does not mean excluding other elements, but may further include other elements, unless specifically stated to the contrary.

Additionally, the term 'module' or 'unit' used in the specification refers to a software or hardware component, and the 'module' or 'unit' performs certain roles. However, 'module' or 'unit' is not limited to software or hardware. A 'module' or 'unit' may be configured to reside on an addressable storage medium and may be configured to run on one or more processors. Thus, as an example, a 'module' or 'part' refers to components such as software components, object-oriented software components, class components and task components, processes, functions and properties. , procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, or variables. Components and 'modules' or 'parts' may be combined into smaller components and 'modules' or 'parts' or further components and 'modules' or 'parts'. Could be further separated.

According to an embodiment of the present disclosure, a 'module' or 'unit' may be implemented with a processor and memory. 'Processor' should be interpreted broadly to include general-purpose processors, central processing units (CPUs), microprocessors, digital signal processors (DSPs), controllers, microcontrollers, state machines, etc. In some contexts, 'processor' may refer to an application-specific integrated circuit (ASIC), programmable logic device (PLD), field programmable gate array (FPGA), etc. 'Processor' refers to a combination of processing devices, for example, a combination of a DSP and a microprocessor, a combination of a plurality of microprocessors, a combination of one or more microprocessors in combination with a DSP core, or any other such combination of configurations. You may. Additionally, 'memory' should be interpreted broadly to include any electronic component capable of storing electronic information. 'Memory' refers to random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable-programmable read-only memory (EPROM), May also refer to various types of processor-readable media, such as electrically erasable PROM (EEPROM), flash memory, magnetic or optical data storage, registers, etc. A memory is said to be in electronic communication with a processor if the processor can read information from and/or write information to the memory. The memory integrated into the processor is in electronic communication with the processor.

In the present disclosure, 'creator' may refer to an entity that creates a 3D model catalog page by selecting a 3D model, and 'user' may refer to an entity that uses the generated 3D model catalog page. Additionally, 'user' may refer to a producer and/or user unless clearly specified in the context.

FIG. 1 is a diagram illustrating an example of a 3D model catalog page 110 and 120 according to an embodiment of the present disclosure. The 3D model catalog pages 110 and 120 may include a plurality of content areas 112 and 116 corresponding to a plurality of objects. The plurality of content areas 112 and 116 may be created based on user input for selecting a plurality of 3D models for a plurality of objects from the user and information associated with each of the plurality of selected objects. The created 3D model catalog page can be shared with users through URL links, etc.

In contrast, the plurality of content areas 112 and 116 contain at least some of the information associated with the object, such as a specific theme or topic (e.g., interior props, office supplies, etc.), a sales platform, and the price, color, and/or size of the object. It may be generated based on information associated with each of a plurality of three-dimensional models and a plurality of objects automatically selected based on a user input specifying .

Within the 3D model catalog pages 110 and 120, a plurality of content areas 112 and 116 may be arranged in a specific shape and/or order. In one embodiment, the plurality of content areas 112 and 116 may be arranged and displayed in the order in which the user selects the plurality of 3D models. For example, the plurality of content areas within the first page 110 allow the user to sequentially select a 3D model associated with a massage chair, a 3D model associated with a sofa, a 3D model associated with clothing, and a 3D model associated with a picture frame. By doing so, they may be displayed in sorted order. Additionally, the creator of the catalog pages 110 and 120 can change the display order of the plurality of content areas even after the catalog pages 110 and 120 are created.

An interactive 3D model viewer may be displayed in the content areas 112 and 116, and animation objects 114 and 118 indicating that display control of the 3D model is possible may be displayed in the interactive 3D model viewer. . As the animation objects 114 and 118 move, the corresponding 3D model animation objects 114 and 118 may move and/or rotate in the same direction as the movement direction.

The second page 120 shows an example in which the display control function is executed for the 3D model displayed in each of the content areas 112 and 116 of the first page 110. The user may execute at least one display control function among rotation, enlargement, reduction, or movement of the 3D model within each of the content areas 112 and 116 through the interactive 3D model viewer. For example, the first viewer 122 represents an example of a 3D model viewer displayed after the 3D model in the first content area 112 is rotated based on the user's rotation control input. The second viewer 124 represents an example of a 3D model viewer that is displayed after the 3D model in the second content area 116 is enlarged and moved based on the user's enlargement and movement control input. Through this, the user can easily and in detail check the three-dimensional shapes of a plurality of objects provided on the catalog pages 110 and 120 on a single page.

Information related to objects may be displayed in the content areas 112 and 116. For example, the name ('massage chair'), color ('white gold'), size, and price of the object can be seen displayed in the first content area 112.

In the content areas 112 and 116, a visual object ('View in AR') that outputs AR content on the display along with images captured by a camera and a web page selling the object is displayed on the display. An object ('Go to Buy') may be displayed. This will be described in detail later in Figure 4.

Figure 2 is a schematic diagram showing a configuration in which the information processing system 230 is connected to enable communication with a plurality of user terminals 210_1, 210_2, and 210_3 in order to provide a 3D model catalog creation service according to an embodiment of the present disclosure. . The information processing system 230 may include system(s) capable of providing a 3D model catalog creation service. In one embodiment, information processing system 230 may include one or more server devices and/or capable of storing, serving, and executing computer-executable programs (e.g., downloadable applications) and data related to three-dimensional model catalog creation services. It may include a database, or one or more distributed computing devices and/or distributed databases based on cloud computing services.

The 3D model catalog creation service provided by the information processing system 230 may be provided to users through applications installed on each of a plurality of user terminals 210_1, 210_2, and 210_3.

A plurality of user terminals 210_1, 210_2, and 210_3 may communicate with the information processing system 230 through the network 220. The network 220 may be configured to enable communication between a plurality of user terminals 210_1, 210_2, and 210_3 and the information processing system 230. Depending on the installation environment, the network 220 may be, for example, a wired network such as Ethernet, a wired home network (Power Line Communication), a telephone line communication device, and RS-serial communication, a mobile communication network, a wireless LAN (WLAN), It may consist of wireless networks such as Wi-Fi, Bluetooth, and ZigBee, or a combination thereof. The communication method is not limited, and includes communication methods that utilize communication networks that the network 220 may include (e.g., mobile communication networks, wired Internet, wireless Internet, broadcasting networks, satellite networks, etc.) as well as user terminals (210_1, 210_2, 210_3) ) may also include short-range wireless communication between

For example, a plurality of user terminals 210_1, 210_2, and 210_3 transmit a request to the information processing system 230 through the network 220, and the information processing system 230 receives it and responds to the request. A corresponding response may be transmitted to a plurality of user terminals 210_1, 210_2, and 210_3. For example, when the user terminal 210_1 transmits (request) a user input for selecting a plurality of 3D models for a plurality of objects and a 3D model catalog creation/output request to the information processing system 230 (request), the information processing system ( 230) may transmit the received user input and information related to a plurality of objects or information related to a 3D model catalog page generated based thereon to the user terminal 210_1 (response).

In Figure 2, the mobile phone terminal 210_1, tablet terminal 210_2, and PC terminal 210_3 are shown as examples of user terminals, but they are not limited thereto, and the user terminals 210_1, 210_2, and 210_3 use wired and/or wireless communication. This can be any computing device capable of installing and running a 3D model catalog creation/output application, etc. For example, user terminals include medical devices, smartphones, mobile phones, navigation devices, computers, laptops, digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), tablet PCs, game consoles, It may include wearable devices, IoT (internet of things) devices, VR (virtual reality) devices, AR (augmented reality) devices, etc. In addition, in Figure 2, three user terminals (210_1, 210_2, 210_3) are shown as communicating with the information processing system 230 through the network 220, but this is not limited to this, and a different number of user terminals are connected to the network ( It may be configured to communicate with the information processing system 230 through 220).

Figure 3 is a block diagram showing the internal configuration of the user terminal 210 and the information processing system 230 according to an embodiment of the present disclosure. The user terminal 210 may refer to any computing device capable of executing a 3D model catalog creation/output application and capable of wired/wireless communication, for example, the mobile phone terminal 210_1 of FIG. 2 and a tablet terminal. (210_2), PC terminal (210_3), etc. As shown, the user terminal 210 may include a memory 312, a processor 314, a communication module 316, and an input/output interface 318. Similarly, information processing system 230 may include memory 332, processor 334, communication module 336, and input/output interface 338. As shown in FIG. 3, the user terminal 210 and the information processing system 230 are configured to communicate information and/or data through the network 220 using respective communication modules 316 and 336. It can be. Additionally, the input/output device 320 may be configured to input information and/or data to the user terminal 210 through the input/output interface 318 or to output information and/or data generated from the user terminal 210.

Memories 312 and 332 may include any non-transitory computer-readable recording medium. According to one embodiment, the memories 312 and 332 are non-permanent mass storage devices such as read only memory (ROM), disk drive, solid state drive (SSD), flash memory, etc. It can be included. As another example, non-perishable mass storage devices such as ROM, SSD, flash memory, disk drive, etc. may be included in the user terminal 210 or the information processing system 230 as a separate persistent storage device that is distinct from memory. Additionally, an operating system and at least one program code (eg, code for a 3D model catalog creation/output application, etc.) may be stored in the memories 312 and 332.

These software components may be loaded from a computer-readable recording medium separate from the memories 312 and 332. This separate computer-readable recording medium may include a recording medium directly connectable to the user terminal 210 and the information processing system 230, for example, a floppy drive, disk, tape, DVD/CD- It may include computer-readable recording media such as ROM drives and memory cards. As another example, software components may be loaded into the memories 312 and 332 through the communication modules 316 and 336 rather than computer-readable recording media. For example, at least one program is a computer program (e.g., 3D model catalog creation/ Output application, etc.) may be loaded into memory 312, 332.

The processors 314 and 334 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to the processors 314 and 334 by memories 312 and 332 or communication modules 316 and 336. For example, the processors 314 and 334 may be configured to execute instructions received according to program codes stored in a recording device such as the memory 312 and 332.

The communication modules 316 and 336 may provide a configuration or function for the user terminal 210 and the information processing system 230 to communicate with each other through the network 220, and may provide a configuration or function for the user terminal 210 and/or information processing. The system 230 may provide a configuration or function for communicating with other user terminals or other systems (for example, a separate cloud system, etc.). For example, a request or data generated by the processor 314 of the user terminal 210 according to a program code stored in a recording device such as the memory 312 is transmitted through the network 220 under the control of the communication module 316. It may be delivered to processing system 230. Conversely, a control signal or command provided under the control of the processor 334 of the information processing system 230 is transmitted through the communication module 316 of the user terminal 210 through the communication module 336 and the network 220. It may be received by the user terminal 210.

The input/output interface 318 may be a means for interfacing with the input/output device 320. As an example, input devices may include devices such as cameras, keyboards, microphones, mice, etc., including audio sensors and/or image sensors, and output devices may include devices such as displays, speakers, haptic feedback devices, etc. You can. As another example, the input/output interface 318 may be a means for interfacing with a device that has components or functions for performing input and output, such as a touch screen, integrated into one. In FIG. 3 , the input/output device 320 is shown not to be included in the user terminal 210, but the present invention is not limited to this and may be configured as a single device with the user terminal 210. Additionally, the input/output interface 338 of the information processing system 230 may be connected to the information processing system 230 or means for interfacing with a device (not shown) for input or output that the information processing system 230 may include. It can be. In FIG. 3, the input/output interfaces 318 and 338 are shown as elements configured separately from the processors 314 and 334, but the present invention is not limited thereto, and the input/output interfaces 318 and 338 may be configured to be included in the processors 314 and 334. there is.

The user terminal 210 and information processing system 230 may include more components than those in FIG. 3 . However, there is no need to clearly show most prior art components. In one embodiment, the user terminal 210 may be implemented to include at least some of the input/output devices 320 described above. Additionally, the user terminal 210 may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, and a database. For example, if the user terminal 210 is a smartphone, it may include components generally included in a smartphone, such as an acceleration sensor, a gyro sensor, a microphone module, a camera module, and various physical devices. Various components such as buttons, buttons using a touch panel, input/output ports, and vibrators for vibration may be implemented to be further included in the user terminal 210.

According to one embodiment, the processor 314 of the user terminal 210 may be configured to operate an application or a web browser application that provides a 3D model catalog creation/output service. At this time, the program code associated with the application may be loaded into the memory 312 of the user terminal 210. While the application is operating, the processor 314 of the user terminal 210 receives information and/or data provided from the input/output device 320 through the input/output interface 318 or the information processing system ( Information and/or data may be received from 230), and the received information and/or data may be processed and stored in the memory 312. Additionally, such information and/or data may be provided to information processing system 230 via communication module 316.

While the application is running, the processor 314 inputs or selects voice data, text, and images through input devices such as a touch screen, keyboard, camera including an audio sensor and/or an image sensor, and a microphone connected to the input/output interface 318. , video, etc. can be received, and the received voice data, text, image and/or video, etc. are stored in the memory 312 or provided to the information processing system 230 through the communication module 316 and the network 220. can do.

The processor 314 of the user terminal 210 may transmit information and/or data to the input/output device 320 through the input/output interface 318 and output the information. For example, the processor 314 of the user terminal 210 processes information through the output device 320, such as a display output capable device (e.g., touch screen, display, etc.), an audio output capable device (e.g., speaker), etc. and/or data may be output.

The processor 334 of the information processing system 230 may be configured to manage, process, and/or store information and/or data received from a plurality of user terminals 210 and/or a plurality of external systems. Information and/or data processed by processor 334 may be provided to user terminal 210 through communication module 336 and network 220.

FIG. 4 is a diagram illustrating an example of a content area 400 included in a 3D model catalog page according to an embodiment of the present disclosure. A 3D model catalog page may include a plurality of content areas, and each of the plurality of content areas may correspond to a specific object.

The content area 400 includes an interactive 3D model viewer 410 that displays the 3D model 412 and provides at least one display control function of rotating, enlarging, reducing, or moving the 3D model 412, and a specific object. a description area 420 in which information related to the object is displayed, a first visual object 430 that overlays AR (Augmented Reality) content of a specific object on an image captured by a camera and outputs it on a display, a web that sells the object The page may include a second visual object 440 that causes the page to be displayed on the display. Not limited to this, visual objects included in the content area 400 may be configured differently in location or form from those shown in FIG. 4, and may be configured differently (for example, visual objects that display reviews about objects). object) may be additionally included or some components may be omitted. For example, if the 3D model catalog page is not for the purpose of selling a specific product, the second visual object 440 may be omitted. As an example, the second visual object 440 is omitted from the 3D model catalog page for works/objects displayed at an art museum or exhibition, and a web page containing a detailed description of the relevant works/objects is displayed on the display. Other visual objects may be displayed as long as possible.

The interactive 3D model viewer 410 can display a 3D model 412 associated with a specific object. In one embodiment, the 3D model 412 may be a model selected by the catalog page creator to display on the catalog page among a plurality of models pre-stored in a 3D model database. At this time, when data associated with the model (massage chair) stored in the 3D model database is updated (e.g., change in color or shape of at least part of the model, replacement of model file, change in attribute information, etc.), the interactive 3D model The 3D model 412 in the viewer 410 may also be automatically updated. Additionally, when data associated with a model (massage chair) stored in the 3D model database is deleted, the content area 400 may be automatically deleted or deactivated from the catalog page.

The user can perform at least one display control among rotation, enlargement, reduction, or movement of the 3D model on the interactive 3D model viewer 410, and such display control is possible on the interactive 3D model viewer 410. An animation object 414 may be displayed. Through this, the 3D model 412 can be displayed on the interactive 3D model viewer 410 at an angle and size desired by the user.

A magnification icon 416 may be displayed on the interactive 3D model viewer 410 to display a detailed screen related to the 3D model 412 on the display. That is, in response to the magnification icon 416 being selected, a detailed screen that allows you to check the 3D model and/or information associated with the 3D model in detail may be displayed on the display, which will be described in detail later in FIG. 5. do.

Information related to a specific object may be displayed in the description area 420. For example, information associated with a specific object may include the object's name, color, size, price, material, weight, category, out of stock status, available options (e.g. different colors to choose from), brand name, and customer reviews. , may include, but is not limited to, additional services (warranty, etc.), shipping information, sales pages or links, etc. The type of information displayed in the description area 420 may be selected by the catalog page creator from among the types of information associated with the specific object described above, or may be selected by a user who accesses the catalog page after creation of the catalog page. In other words, the creator of the catalog page may select a specific type of information related to the object and provide it to the user, or the user of the catalog page may directly select and receive the desired information.

In one embodiment, the information displayed in the description area 420 may be information previously stored in a 3D model database along with a 3D model associated with a specific object. That is, the information displayed in the description area 420 may be extracted along with the 3D model from a 3D model database when the creator of the catalog page selects a 3D model to create the catalog page. At this time, when pre-stored information is modified in the 3D model database, information displayed in the description area 420 may also be automatically updated. Additionally or alternatively, the information displayed in the description area 420 may be information in which pre-stored information has been modified or added by the creator of the catalog page. This will be described in detail later in FIG. 8.

The first visual object 430 may be a visual object that overlays Augmented Reality (AR) content of a specific object on an image received from an image sensor and outputs it on a display. That is, in response to the user selecting the first visual object 430, AR content of a specific object (massage chair) may be overlaid on the image received from the image sensor of the user terminal and displayed on the display of the user terminal. . AR content displayed when the first visual object 430 is selected will be described in detail later with reference to FIG. 10 .

The second visual object 440 may be a visual object that causes a web page selling a specific object (massage chair) to be displayed on the display. That is, in response to the user selecting the second visual object 440, a web page selling a specific object (massage chair) may be displayed on the display of the user terminal. At this time, the information related to the web page may be stored along with the 3D model in a 3D model database or may be input by the creator of the catalog page.

In one embodiment, when a specific object (massage chair) cannot be purchased due to being out of stock, etc., the second visual object 440 is deactivated or the content area 400 associated with the specific object (massage chair) is removed from the catalog page. It can be.

FIG. 5 is a diagram illustrating an example of a display 500 on which a detailed screen 510 associated with a 3D model is displayed according to an embodiment of the present disclosure. Additionally, interfaces 520 and 530 that can change options of the detailed screen 510 may be displayed on the display 500.

The detail screen 510 may be displayed by selecting an enlargement icon (for example, 416 in FIG. 4) on the content area associated with a specific object in the catalog page. The detail screen 510 may display a 3D model 512 of a specific object and an animation object 514 indicating that at least one display control among rotation, enlargement, reduction, or movement of the 3D model can be performed. Content already described in Figures 1 and 4 will be omitted.

The detail screen 510 may display a visual object 516 indicating a length associated with a specific object. For example, the visual object 516 may represent the width, length, and height information of a specific object using the 3D model 512 as shown in FIG. 5 . At this time, length information associated with a specific object may be pre-stored along with the 3D model 512. Alternatively, the user may select a specific part for which length information is to be obtained on the detail screen 510, and the length information of the selected part may be displayed using the 3D model 512.

The 3D model 512 may be displayed differently by the first interface 520 that can set or change virtual lighting options illuminated on the 3D model 512. For example, when the user selects 'basic lighting' in the first interface 520, virtual lighting modeling natural light may be illuminated on the 3D model 512 and displayed on the detailed screen 510, and 'studio' When 'lighting' is selected, the three-dimensional model 512 may be displayed on the detailed screen as if a specific object is located in a virtual studio environment in which the position and/or intensity of one or more lights are modeled. With this configuration, users can check the three-dimensional shape of products/objects in various lighting environments.

The length information displayed by the visual object 516 is expressed in different ways based on the length unit (e.g., cm (centimeter), m (meter), inch, etc.) set in the second interface 530. It can be. For example, when 'meter(m)' is selected in the second interface 530, information on the visual object 516 may be displayed as 1.94m, 0.89m, and 0.93m, respectively.

FIG. 6 is a diagram illustrating an example of a 3D model list 600 according to an embodiment of the present disclosure. Information related to a 3D model for a specific object may be displayed in each of the plurality of areas 610, 620, and 630 in the 3D model list 600. The 3D model and information related to the 3D model displayed in the 3D model list 600 may have been previously uploaded/stored by the producer in the 3D model database of the 3D model catalog production/management platform.

Information related to the 3D model may include the 3D model's name, extension, capacity, update date, category, and information related to the object in the 3D model (e.g., object size, color, sales link), etc. It is not limited to this. Information associated with the 3D model can be modified by the creator. For example, the creator can change the name of the 3D model (or object) associated with the first area 610 by selecting the first icon 614. In another example, the creator may change the sales link of the 'decoration' object by selecting the second icon 616.

Toggle buttons 612, 622, and 632 may be displayed in each of the plurality of areas 610, 620, and 630 to select whether to disclose AR content and/or 3D models to users of the catalog page. In FIG. 6, one toggle button 612, 622, and 632 is shown in each of the plurality of areas 610, 620, and 630, but the present invention is not limited thereto. For example, in each of the plurality of areas 610, 620, and 630, a toggle button for selecting whether to disclose AR content and a toggle button for selecting whether to disclose a 3D model are separately displayed, or AR content and/or Whether or not to disclose the 3D model may be selected through another type of interface.

Based on information related to whether the AR content and/or 3D model is public, the AR content and/or 3D model of a specific object included when creating a 3D model catalog page may not be displayed. For example, after a catalog page is created to include a 3D model of 'Statue', as the creator selects the third toggle button 632 to 'OFF', the content area of 'Statue' is deleted from the catalog page. /Can be disabled, or AR content and/or 3D models can be excluded.

The creator of the catalog page may delete at least some of the 3D models included in the 3D model list 600 using the model delete button 640. If a specific 3D model is deleted from the entire model list, the content area related to that 3D model may be deleted or disabled on all catalog pages containing the deleted 3D model.

FIG. 7 is a diagram illustrating an example in which a 3D model catalog page 720 is created in response to selecting a plurality of 3D models 712, 714, and 716 according to an embodiment of the present disclosure. In the 3D model list 710, a plurality of 3D models 712, 714, and 716 for a plurality of objects may be selected from the 3D model list. At this time, the plurality of 3D models 712, 714, and 716 may be selected in a specific order by the creator of the catalog page 720. For example, in Figure 7, the manufacturer selected the third 3D model 716, the second 3D model 714, and the first 3D model 716 in that order.

The 3D model catalog page 720 may display a plurality of content areas 722, 724, and 726 associated with a plurality of objects. The description of the content area shown and described in FIGS. 1 and 4, etc. will be omitted.

In one embodiment, the plurality of content areas 722, 724, and 726 may be displayed in the order in which the plurality of 3D models 712, 714, and 716 are selected. For example, first content area 722 includes a first selected first three-dimensional model 716 and information associated therewith, and second content area 724 includes a second selected three-dimensional model 714. and information related thereto, and the third content area 726 may include the last selected first 3D model 712 and information related thereto.

FIG. 8 is a diagram illustrating an example of a modification screen 800 for modifying data associated with a specific object according to an embodiment of the present disclosure. The modification screen 800 may be a screen for modifying data associated with an object on a specific 3D model catalog page. In each of the areas 810, 820, and 830 displayed on the modification screen 800, data associated with a specific object displayed on a specific 3D model catalog page may be modified.

In each of the areas 810, 820, and 830, data for modifying the product name, detailed description (e.g., information associated with the specific object, such as color, size, price, etc.), sales link, etc. of a specific object may be input. In response to user input to modify data associated with a specific object in each of areas 810, 820, and 830, a specific content area associated with a specific object in the 3D model catalog page may be updated. Information input to each of the areas 810, 820, and 830 may be displayed in the content area instead of information previously stored together with the 3D model, or may be displayed in the content area together with the pre-stored information.

Additionally, other 3D model catalog pages containing objects with modified data can be automatically updated according to the creator's selection. Through this, just by modifying information related to an object on one catalog page, all catalog pages related to it are updated, reducing the inconvenience of having to edit multiple catalog pages one by one.

In one embodiment, specific objects within the 3D model catalog page may be deactivated through each of areas 810, 820, and 830. For example, depending on whether the upper left check box of each of the areas 810, 820, and 830 is checked, whether a specific object is activated in the 3D model catalog page may be determined. For example, in response to receiving a user input that unchecks the check box in the upper left corner of the first area 810 (i.e., an input to deactivate the 'model car' object), an object associated with 'model car' is displayed from the 3D model catalog page. Content areas may be disabled or deleted. Additionally, depending on the creator's selection, the content area associated with 'model car' may be automatically deactivated or deleted on other 3D model catalog pages that include 'model car'. Through this, just by deactivating a specific object on one catalog page, all catalog pages related to it are updated, reducing the inconvenience of having to deactivate or delete specific objects one by one on multiple catalog pages.

Figure 9 is a diagram illustrating an example in which the display order of content areas within a catalog page is changed according to an embodiment of the present disclosure. The first screen 910 represents the display order before the display order of the content area is changed, and the second screen 920 responds to receiving a user input that changes the display order of the content area on the first screen 910. This indicates the display order of the content area after the display order has been changed.

Before the display order of the content areas is changed, the content area associated with the statue, the content area associated with the model car, and the content area associated with the ornament may be displayed in order within the catalog page (e.g., 720 in FIG. 7 ).

After the display order of the content areas is changed according to the second screen 920, within the catalog page 930, there is a content area 932 associated with a model car, a content area 934 associated with an ornament, and a content area 936 associated with a statue. ) can be displayed sequentially.

FIG. 10 is a diagram illustrating an example of a display 1000 on which AR content 1020 is output according to an embodiment of the present disclosure. AR content 1020 may be overlaid on at least one image (or video) sequentially captured from an image sensor. In one embodiment, the AR content 1020 is displayed on the display 1000 in response to a user input selecting a visual object (e.g., 430 in FIG. 4) for outputting the AR content within a content area associated with a specific object. It can be displayed on the screen.

The AR content 1020 may be displayed in a form in which an object related to the AR content 1020 is placed in a specific area 1010 in the space displayed in the image (that is, the object touches the area 1010). The area 1010 may be determined based on information associated with the image captured from the image sensor and the AR content 1020. For example, based on information such as the size of the object associated with the AR content 1020 and the installation height relative to the ground, one or more objects in which the object associated with the AR content 1020 can be placed in the space displayed in the image. Areas are identified, and one of the identified areas may be determined to be area 1010. Additionally or alternatively, area 1010 may be determined/moved/zoomed/reduced/rotated by the user. Alternatively, AR content 1020 may be displayed floating in space.

Additionally, one or more additional AR content different from the existing overlaid AR content 1020 is overlaid on the image on which the AR content 1020 is overlaid, so that a plurality of AR content can be simultaneously overlaid on one image. Through this, users can use multiple AR contents to compare multiple objects in the same image or in one space.

Additionally, the AR content 1020 overlaid on the image and one or more additional AR content different from the AR content 1020 may be subject to at least one display control of rotation, enlargement, reduction, or movement.

FIG. 11 is a diagram illustrating an example in which a web page 1120 selling a specific object is displayed according to an embodiment of the present disclosure. Web page 1120 may be displayed on the display in response to receiving user input that selects a visual object 1112 within content area 1110 associated with a particular object. The address of the web page 1120 may be pre-stored along with a 3D model associated with a specific object, or may be input by the user.

Alternatively, in response to receiving user input selecting a visual object 1112, a purchase process for that object may proceed within the catalog page on which content area 1110 is displayed.

FIG. 12 is a diagram illustrating an example of a management screen 1200 of a plurality of catalog pages according to an embodiment of the present disclosure. The interface of the management screen 1200 is illustrative and is not limited to the method shown and may be implemented in various ways, or some components may be omitted or added.

The management screen 1200 displays the title, status, last modification date, or publication date of the catalog page, a button 1210 for deleting the selected catalog page, a search box 1220 for searching a specific catalog page, and a plurality of catalog pages. Drop-down boxes 1230 and 1240 for sorting may be displayed. For example, using the drop-down boxes 1230 and 1240, a plurality of catalog pages can be selected based on status information (e.g., whether the catalog page has been issued, whether the catalog page is temporarily stored, etc.) and/or the date of publication or last modification date. Catalog pages can be sorted.

In the first area 1250 of the management screen 1200, status information of a plurality of catalog pages can be displayed and changed, and in the second area 1260, a link or icon for accessing the published catalog page may be displayed. You can. Additionally, the creator can use the toggle button in the first area 1250 to change the catalog page between the published state and the deactivated state.

In one embodiment, catalog pages ('interior', 'chair') that have been published in the first area 1250 are released to the outside through a link in the second area 1260, and any user can access the page. can do. In contrast, catalog pages may be provided to users through QR codes or the like.

Figure 13 is a flowchart showing a method 1300 for creating a 3D model catalog according to an embodiment of the present disclosure. The method 1300 may be performed by at least one processor (eg, a processor of a user terminal, a processor of an information processing system, or a processor of a 3D model catalog creation device, etc.).

The method 1300 may be initiated by the processor receiving a first user input selecting a plurality of 3D models for a plurality of objects from the user (S1310).

Afterwards, the processor may receive information associated with each of the plurality of objects (S1320).

Thereafter, the processor may output a 3D model catalog page for a plurality of objects generated based on the first user input and information associated with each of the plurality of objects on the display (S1330). At this time, the 3D model catalog page may include a plurality of content areas corresponding to a plurality of objects. In one embodiment, a plurality of content areas included in a 3D model catalog page may be displayed in sorted order in the order in which the user selects the plurality of 3D models in the first user input.

In one embodiment, after the 3D model catalog page is generated, the processor receives a second user input from the user to modify data associated with a specific object among the plurality of objects, and updates a specific content area associated with the specific object. The 3D model catalog page can be output on the display. Additionally, in response to the second user input, other 3D model catalog pages containing a particular object may also be automatically updated.

In one embodiment, after a 3D model catalog page is created, the processor receives a third user input from the user to deactivate a specific object among the plurality of objects, and determines that a specific content area associated with the specific object is deactivated or deleted. The 3D model catalog page can be output on the display. Additionally, in response to third-party user input, specific content areas may be automatically deactivated or deleted from other 3D model catalog pages that contain specific objects.

In one embodiment, an interactive 3D model viewer that provides at least one display control function among rotation, enlargement, reduction, or movement of the 3D model may be displayed in each of the plurality of content areas. At this time, an animation object indicating that display control of the 3D model is possible may be displayed on each of the plurality of content areas.

In one embodiment, the processor receives a fourth user input from a user selecting a first visual object in a first content area associated with a first object among the plurality of content areas, and receiving at least one image from an image sensor. ; and

Augmented Reality (AR) content of the first object may be overlaid on at least one image and output on the display. Additionally, the processor receives a fifth user input from the user to select a second visual object in a second content area associated with the second object among the plurality of content areas, and selects the AR content of the first object on the at least one image and the second visual object. AR content of two objects may be overlaid and output on a display, and the AR content of the first object and the AR content of the second object may be subject to display control in at least one of rotation, enlargement, reduction, or movement.

In one embodiment, the information associated with each of the plurality of objects includes the address of a web page selling each of the plurality of objects, and the user selects a third visual object within a specific content area associated with the specific object among the plurality of content areas. In response to receiving a sixth user input, a web page selling a specific object may be displayed on the display.

The flowchart shown in FIG. 13 and the above description are only examples and may be implemented differently in some embodiments. For example, one or more steps may be omitted, the order of each step may be changed, one or more steps may be performed in an overlapping manner, or one or more steps may be performed repeatedly multiple times.

The above-described method may be provided as a computer program stored in a computer-readable recording medium for execution on a computer. The medium may continuously store a computer-executable program, or may temporarily store it for execution or download. Additionally, the medium may be a variety of recording or storage means in the form of a single piece of hardware or a combination of several pieces of hardware. Examples of media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, And there may be something configured to store program instructions, including ROM, RAM, flash memory, etc.

The methods, operations, or techniques of this disclosure may be implemented by various means. For example, these techniques may be implemented in hardware, firmware, software, or a combination thereof. Those skilled in the art will understand that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented in electronic hardware, computer software, or combinations of both. To clearly illustrate this interchange of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the specific application and design requirements imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementations should not be interpreted as causing a departure from the scope of the present disclosure.

In a hardware implementation, the processing units used to perform the techniques may include one or more ASICs, DSPs, digital signal processing devices (DSPDs), programmable logic devices (PLDs). ), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, and other electronic units designed to perform the functions described in this disclosure. , a computer, or a combination thereof.

Accordingly, the various illustrative logical blocks, modules, and circuits described in connection with this disclosure may be general-purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or It may be implemented or performed as any combination of those designed to perform the functions described in. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, such as a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other configuration.

For firmware and/or software implementations, techniques include random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), and PROM ( on computer-readable media such as programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage devices, etc. It may also be implemented as stored instructions. Instructions may be executable by one or more processors and may cause the processor(s) to perform certain aspects of the functionality described in this disclosure.

Although the above-described embodiments have been described as utilizing aspects of the presently disclosed subject matter in one or more standalone computer systems, the disclosure is not limited thereto and may also be implemented in conjunction with any computing environment, such as a network or distributed computing environment. . Furthermore, aspects of the subject matter of this disclosure may be implemented in multiple processing chips or devices, and storage may be similarly effected across the multiple devices. These devices may include PCs, network servers, and portable devices.

Although the present disclosure has been described in relation to some embodiments in this specification, various modifications and changes may be made without departing from the scope of the present disclosure as can be understood by a person skilled in the art to which the invention pertains. Additionally, such modifications and changes should be considered to fall within the scope of the claims appended hereto.

110: first page 112: first content area
114: Animation object 116: Content area
118: Animation object 120: Second page
122: first viewer 124: second viewer

Claims (12)

A method of generating a three-dimensional model catalog, performed by at least one processor, comprising:
Receiving first user input from a user selecting a first set of three-dimensional models for a first set of objects, the first set of objects comprising a first object;
receiving information associated with each of the first set of objects;
outputting on a display a first three-dimensional model catalog page for the first set of objects generated based on the first user input and information associated with each of the first set of objects;
receiving a second user input from a user selecting a second set of three-dimensional models for a second set of objects, the second set of objects comprising the first objects;
receiving information associated with each of the second set of objects; and
Outputting on a display a second three-dimensional model catalog page for the second set of objects generated based on the second user input and information associated with each of the second set of objects.
Including,
the first three-dimensional model catalog page includes a plurality of content areas corresponding to the first set of objects,
The above method is,
After the first 3D model catalog page and the second 3D model catalog page are created,
receiving a third user input from the user to modify data associated with the first object;
outputting a first 3D model catalog page with an updated specific content area associated with the first object on the display; and
Outputting a second 3D model catalog page with an updated specific content area associated with the first object on the display.
It further includes,
In response to the third user input, a second 3D model catalog page containing the first object is also automatically updated,
The first 3D model catalog page and the second 3D model catalog page are different from each other,
A third user input for modifying data associated with the first object is a user input for changing a virtual lighting option illuminated on the 3D model for the first object.
delete delete According to paragraph 1,
The plurality of content areas included in the first 3D model catalog page are arranged and displayed in the order in which the user selects the first set of 3D models in the first user input.
According to paragraph 1,
After the first 3D model catalog page is created,
receiving a fourth user input from the user to deactivate or delete a second object of the first set of objects; and
Outputting a first 3D model catalog page on the display in which a specific content area associated with the second object is deactivated or deleted.
Including,
In response to the fourth user input, the specific content area is automatically deactivated or deleted even on the second 3D model catalog page including the second object.
According to paragraph 1,
A method of generating a 3D model catalog, wherein an interactive 3D model viewer that provides at least one display control function among rotation, enlargement, reduction, or movement of the 3D model is displayed in each of the plurality of content areas.
According to clause 6,
A method of generating a 3D model catalog, wherein an animation object indicating that display control of a 3D model is possible is displayed on each of the plurality of content areas.
According to paragraph 1,
Receiving a fifth user input from the user selecting a first visual object in a first content area associated with a first object among the plurality of content areas;
Receiving at least one image from an image sensor; and
Overlaying AR (Augmented Reality) content of the first object on the at least one image and outputting it on the display.
A method for generating a 3D model catalog, further comprising:
According to clause 8,
receiving a sixth user input selecting a second visual object in a second content area associated with a second object among the plurality of content areas from the user; and
Overlaying the AR content of the first object and the AR content of the second object on the at least one image and outputting the AR content on the display.
It further includes,
A method for generating a 3D model catalog, wherein the AR content of the first object and the AR content of the second object can be displayed at least one of rotation, enlargement, reduction, or movement.
According to paragraph 1,
the information associated with each of the objects in the first set includes the address of a web page selling each of the objects in the first set,
In response to receiving a seventh user input from the user selecting a third visual object within a specific content area associated with the third object among the plurality of content areas, a web page selling the third object is displayed on the display. Displayed, how to create a 3D model catalog.
A computer program stored in a computer-readable recording medium for executing the method according to any one of claims 1 and 4 to 10 on a computer.
In the device,
communication module;
display;
Memory; and
At least one processor connected to the memory and configured to execute at least one computer-readable program included in the memory
Including,
The at least one program is,
receive first user input from a user selecting a first set of three-dimensional models for a first set of objects, the first set of objects comprising a first object;
receive information associated with each of the first set of objects;
output on the display a first three-dimensional model catalog page for the first set of objects generated based on the first user input and information associated with each of the first set of objects;
receive a second user input from a user selecting a second set of three-dimensional models for a second set of objects, the second set of objects comprising the first objects;
receive information associated with each of the second set of objects;
instructions for outputting on a display a second three-dimensional model catalog page for the second set of objects generated based on the second user input and information associated with each of the second set of objects;
the first three-dimensional model catalog page includes a plurality of content areas corresponding to the first set of objects,
The at least one program is,
After the first 3D model catalog page and the second 3D model catalog page are created,
receive third user input from the user to modify data associated with the first object;
Outputting a first 3D model catalog page with an updated specific content area associated with the first object on the display,
Further comprising instructions for outputting a second 3D model catalog page with an updated specific content area associated with the first object on the display,
In response to the third user input, a second 3D model catalog page containing the first object is also automatically updated,
The first 3D model catalog page and the second 3D model catalog page are different from each other,
The third user input for modifying data associated with the first object is a user input for changing a virtual lighting option illuminated on the three-dimensional model for the first object.

Images