KR101705812B1 - Apparatus for producing mixed reality content and method thereof - Google Patents

Abstract

According to the present invention, an apparatus and a method for producing MR content are disclosed. The apparatus produces MR content by adding one or more markers to information on a panoramic image based on the information of the panoramic image photographed through a camera, thereby providing various types of additional information related to an object included in information on the corresponding panoramic image. Therefore, the apparatus enables a user to get interested in, and to have improved convenience.

Description

[0001] MR APPARATUS AND METHOD [0002]

The present invention relates to an MR content production apparatus and method, and more particularly, to an MR content production apparatus and method for producing MR content by adding one or more markers to the panorama image information based on panorama image information photographed through a camera .

VRML (Virtual Reality Modeling), VRML97, Java3D based on Java, Cult3D, MetaStream by Microsoft, and QuickTimeVR by Apple are examples of technologies used in virtual reality realized on the web.

Because these technologies use their own formats, they are not easily accessible to many developers and the general public, making it difficult to develop a wide range of technologies and their usability is limited.

Korean Patent No. 10-0860673 [Title: Apparatus and method for generating image for three-dimensional image generation]

It is an object of the present invention to provide an MR content production apparatus and method for producing MR content by adding one or more markers to the panorama image information based on panorama image information photographed through a camera.

A method of producing an MR content according to an embodiment of the present invention includes: displaying a list of one or more pieces of panorama image information on one side in a list / list display area in an app execution result screen by a display unit; Displaying the selected panorama image information including one or more temporary markers on a video display area of the display unit when any one of the panorama image information displayed on the display unit is selected by the control unit; When a first object marker selected from a plurality of object markers displayed in an object marker display area of the display unit is dropped into a first area on the image display area by a drag and drop function, Determining whether a code type corresponding to a first area where the first object marker is dropped matches a type of the selected first object marker; Wherein when the code type corresponding to the first area where the first object marker is dropped matches the type of the selected first object marker, the control unit causes the control unit to display, in the first area, Placing one object marker; And setting attribute information for the selected first object marker based on a user input by the control unit when a first object marker disposed in the image display area is selected.

As an example related to the present invention, the application execution result screen may include the image display area for displaying the panorama image, the category area for displaying the category classification, the object marker display area for displaying the object marker, And a list / list display area for displaying a list including at least one panorama image information.

In one embodiment of the present invention, the panorama image information includes at least one of an image / moving image, a code related to an object included in the image / moving image, unique identification information of the code, a type of code, A temporary marker corresponding to the type of the code, location information of the temporary marker in the image / moving picture, category information related to the image / moving picture, camera number, panorama image file number, photographing date and time information, And image type information.

As an example related to the present invention, the temporary marker indicates the code type in relation to the code, and may include at least one of a camera temporary marker, a product temporary marker, a business temporary marker, and an event information temporary marker.

As an example related to the present invention, the temporary marker may be in a state in which a border is dotted to distinguish the object marker from the object marker, and the object marker may be in a state in which a border is solidly processed.

In one embodiment of the present invention, the step of checking whether a code type corresponding to the first area matches a type of the selected first object marker may include: Selecting the first object marker according to user selection; Selecting the first area on the image display area of the display unit; And checking whether a code type preset for the selected first region matches a type of the selected first object marker.

As an example related to the present invention, if it is determined that the code type corresponding to the first area is not related to preset data, or if the code type corresponding to the first area and the type of the first object marker do not match Displaying information indicating that object marker setting has failed in a pop-up form in a part of the display unit, by the control unit; And returning to the process of selecting an object marker from among the plurality of object markers when a preset menu displayed on a partial area of the display unit is selected.

In one embodiment of the present invention, the step of arranging the first object marker in the first area may include: matching a code type corresponding to the first area where the first object marker is dropped with a type of the selected first object marker A temporary marker located in the first area; And disposing the first object marker in the first area in which the temporary marker is located.

As an example related to the present invention, when the object marker is a product, the attribute information of the first object marker includes an image, a product name, a product unique code, price information, a moving picture link related to the product, And at least one camera link among at least one camera associated with the panoramic image information when the object marker is a shop camera, wherein the object marker is a shop camera, And at least one of a business name, an image for a business, a business logo, a vendor unique code, a video link related to a business, a business description, a catalog, and a business detail description page address link stored outside, When, event name, image / video for event, event unique code, event description and external And a stored event detail description page address link.

According to an embodiment of the present invention, the step of setting the attribute information for the first object marker includes: when the temporary marker is changed to the object marker in a state that the panorama image information is a moving image, The information related to the temporary marker and the code included in the moving picture may be all changed into the attribute information of the object marker set.

As an example related to the present invention, when a preset preview menu displayed on the display unit is selected, the control unit displays a result screen for one or more object markers arranged in the panorama image information of the image display area in a pop- To the display unit.

As an example related to the present invention, when the preset storage menu displayed on the display unit is selected, the control unit generates MR content including one or more object markers disposed on the panorama image information of the image display area The method comprising the steps of:

As an example related to the present invention, the step of generating the MR content may include the step of, when the preset storage menu displayed on the display unit is selected, for all the temporary markers included in the panorama image information of the image display area, Checking whether the object markers according to the object markers and the object markers are set in the completed state; And, when it is determined that the attribute information of the object markers and the object markers are completely set for all the temporary markers included in the panorama image information, the MRs including one or more object markers disposed on the panorama image information, And generating a content.

As an example related to the present invention, the MR contents may include at least one of an image / moving picture, a code related to an object included in the image / moving picture, unique identification information of a code, a type of code, The location information of the temporary marker in the image / moving picture, the category information related to the image / moving picture, the camera number, the panorama image file number, the photographing date and time information, the runtime information, Image type information, an object marker placed in place of the temporary marker, position information of the object marker in the image / moving image, and attribute information of the object marker.

An apparatus for producing an MR content according to an embodiment of the present invention includes a storage unit for storing one or more pieces of panorama image information; A display unit for displaying a list of at least one panorama image information stored in the storage unit in a list / list display area in an application execution result screen; And displaying the selected panorama image information including one or more temporary markers on a video display area of the display unit when one of the panorama image information displayed on the display unit is selected, When a first object marker selected from a plurality of object markers displayed in a marker display area is dropped in a first area on the image display area by a drag and drop function, Code type corresponding to the first region where the first object marker is dropped and the type of the selected first object marker coincide with each other, , Placing the first object marker in a first area in the image display area, When the first object when the marker disposed in the area to be selected, may be a control unit for setting the attribute information for the selected first object marker based on the user input.

In one embodiment of the present invention, when the code type corresponding to the first region in which the first object marker is dropped matches the type of the selected first object marker, the control unit sets a temporary marker located in the first region The first object marker can be changed to the first object marker.

As an example related to the present invention, when the panorama image information is a moving image and the temporary marker is changed to the object marker, the control unit may include the temporary marker in the moving image based on the unique identification information of the code corresponding to the temporary marker The information on the temporary marker and code can be changed to attribute information of the set object marker.

As an example related to the present invention, when the preset storage menu displayed on the display unit is selected, the controller generates MR content including one or more object markers disposed on the panorama image information of the image display area .

According to the present invention, one or more markers are added to the panorama image information on the basis of panorama image information photographed by a camera to provide various additional information related to an object included in the panorama image information, And it is possible to improve convenience.

1 is a block diagram showing a configuration of an MR content production apparatus according to an embodiment of the present invention.
FIG. 2 is a flowchart illustrating a method of producing MR content according to an embodiment of the present invention.
3 to 11 are views showing screens of an MR content production apparatus according to an embodiment of the present invention.

It is noted that the technical terms used in the present invention are used only to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be construed in a sense generally understood by a person having ordinary skill in the art to which the present invention belongs, unless otherwise defined in the present invention, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in the present invention is an erroneous technical term that does not accurately express the concept of the present invention, it should be understood that technical terms that can be understood by a person skilled in the art can be properly understood. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Furthermore, the singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. The term "comprising" or "comprising" or the like in the present invention should not be construed as necessarily including the various elements or steps described in the invention, Or may further include additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in the present invention can be used to describe elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

1 is a block diagram showing a configuration of an MR content production apparatus 100 according to an embodiment of the present invention.

1, the MR content production apparatus 100 includes a communication unit 110, a storage unit 120, a display unit 130, a sound output unit 140, and a control unit 150. All of the components of the MR content production apparatus 100 shown in FIG. 1 are not essential components, and the MR content production apparatus 100 may be implemented by more components than the components shown in FIG. 1, The MR content production apparatus 100 may be implemented by a smaller number of components.

The MR content production apparatus 100 may be a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) A mobile terminal, a telematics terminal, a navigation terminal, a personal computer, a notebook computer, a slate PC, a tablet PC, an ultrabook, a wearable device A Smart TV, a Smart Glass, a HMD (Head Mounted Display), a WiBro terminal, an Internet Protocol Television (IPTV) terminal, a smart TV, a digital broadcasting terminal, an AVN Video Navigation (A / V) terminal, an A / V (Audio / Video) system, and a flexible terminal.

The communication unit 110 communicates with at least one terminal of an external arbitrary component through a wired / wireless communication network. At this time, the external arbitrary terminal may include a server (not shown), another terminal (not shown), and the like. Here, the wireless Internet technology includes a wireless LAN (WLAN), a digital living network alliance (DLNA), a wireless broadband (Wibro), a world interoperability for a microwave (WiMAX), a high speed downlink packet access ), HSUPA (High Speed Uplink Packet Access), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS) And the communication unit 110 transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above. In addition, the near field communication technology includes Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC) , Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, and Wi-Fi Direct. The wired communication technology may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, an optical / coaxial cable, and the like.

In addition, the communication unit 110 can transmit information with an arbitrary terminal through a universal serial bus (USB).

In addition, the communication unit 110 may be a mobile communication system such as a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (E.g., Long Term Evolution-Advanced), and the like.

In addition, the communication unit 110 receives one or more panorama image information provided from the server under the control of the controller 150. Here, the panoramic image information includes an image, a moving image, and the like. In addition to the image / moving picture, the panorama image information may include a code related to an object included in the image / moving picture, unique identification information of a code, a type of a code, a location information of a code in an image / (For example, a major classification, an intermediate classification, a small classification information, and the like) related to the image / video, a camera number, a panorama image file number , Shooting date and time information, runtime information, image type information (for example, VOD, live broadcasting, unsetting, etc.).

The storage unit 120 stores various user interfaces (UI), a graphical user interface (GUI), and the like.

Also, the storage unit 120 stores data and programs necessary for the MR content production apparatus 100 to operate.

That is, the storage unit 120 stores a plurality of application programs (application programs or applications) driven by the MR content production apparatus 100, data for operation of the MR content production apparatus 100, Can be stored. At least some of these applications may be downloaded from an external server via wireless communication. At least a part of these application programs may be stored on the MR content production apparatus 100 from the time of shipment for the basic functions of the MR content production apparatus 100 (for example, a telephone call reception function, a message reception function, a message reception function, Can exist. The application program is stored in the storage unit 120 and installed in the MR content production apparatus 100 to be operated by the control unit 150 to perform the operation (or function) of the MR content production apparatus 100 .

The storage unit 120 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory And a PROM (Programmable Read-Only Memory). Also, the MR content production apparatus 100 may operate a web storage for performing a storage function of the storage unit 120 on the Internet, or may operate in association with the web storage.

In addition, the storage unit 120 stores one or more pieces of panorama image information received through the communication unit 110.

The storage unit 120 displays (or outputs) the panorama image information provided from the server under the control of the controller 150, or edits the panorama image information to generate MR content (Mixed Reality Contents) (Or installing) a specific application (or application) for generating the MR image.

The display unit 130 may display various contents such as various menu screens using the user interface and / or graphical user interface stored in the storage unit 120 under the control of the controller 150. [ Here, the content displayed on the display unit 130 includes various text or image data (including various information data), a menu screen including data such as an icon, a list menu, and a combo box. Also, the display unit 130 may be a touch screen.

The display unit 130 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) And may include at least one of a flexible display, a 3D display, an e-ink display, and an LED (Light Emitting Diode).

The display unit 130 displays one or more pieces of panorama image information received through the communication unit 110 through a specific application installed in the MR content production apparatus 100 under the control of the controller 150. [

The voice output unit 140 outputs voice information included in the signal processed by the controller 150. [ Here, the audio output unit 140 may include a receiver, a speaker, a buzzer, and the like.

Also, the voice output unit 140 outputs the guidance voice generated by the controller 150.

The audio output unit 140 outputs audio information corresponding to at least one panorama image information received through the communication unit 110 by the control unit 150. [

The control unit 150 executes the overall control function of the MR content production apparatus 100. [

The control unit 150 executes the overall control function of the MR content production apparatus 100 using the program and data stored in the storage unit 120. [ The control unit 150 may include a RAM, a ROM, a CPU, a GPU, and a bus, and the RAM, the ROM, the CPU, and the GPU may be connected to each other via a bus. The CPU accesses the storage unit 120 and performs booting using the O / S stored in the storage unit 120. The CPU 120 performs various operations using various programs, contents, data stored in the storage unit 120, Can be performed.

Also, the controller 150 receives one or more pieces of panorama image information provided from the server through the communication unit 110.

In the embodiment of the present invention, the panorama image information is received from the server or another terminal, but the controller 150 may generate the panorama image information.

That is, the control unit 150 recognizes a code (or a sticker) included in an image photographed through a 360-degree camera (not shown) provided in a specific store. Here, the code (or sticker) is related to a product in a shop, a point of purchase (POP), a leaflet, a banner advertisement, a bulletin board advertisement, a billboard, a signboard, Information (or category information), and may be generated by a combination of numbers, letters, symbols, figures, and the like. At this time, the 360-degree camera can take two-dimensional or three-dimensional panoramic images.

The control unit 150 may further include a temporary marker corresponding to the type of the recognized code, positional information of the temporary marker in the video, information on the image (e.g., image, moving image, etc.) Camera number of the 360-degree camera, file number of the image (or panorama image), photographing date and time information, run time information, image type information (for example, (For example, VOD, live, unset, etc.).

In addition, the control unit 150 may determine whether the recognized marker, the unique identification information of the recognized code, the type of the recognized code, the position information of the code in the image, (For example, a major classification, a middle classification, a small classification information, and the like) related to the image (for example, an image and a moving image), a camera number, a panorama image file number, (For example, image, video, and the like) associated with the information such as the date and time of shooting, the date and time of shooting, the date and time of shooting, the runtime information, and the image type information (for example, VOD, do.

Also, the controller 150 stores the panorama image information generated on the basis of the image photographed through the specific 360-degree camera provided in the specific store, in the storage unit 120.

In addition, the controller 150 transmits the panorama image information generated based on the image photographed through the specific 360-degree camera provided in the specific store to the server, the other terminal, and the like through the communication unit 110.

As described above, the panorama image information can be generated by the server or the other terminal, and then provided to the MR content production apparatus 100 or generated by the MR content production apparatus 100 itself.

When the received panoramic image information is displayed on the display unit 130, the controller 150 determines whether the app for displaying the panoramic image information is installed in the MR content production apparatus 100 Check.

If it is determined that the application for displaying the panorama image information is not installed in the MR content production apparatus 100, the control unit 150 may link the application with the server to generate the MR content Is installed in the apparatus (100).

As a result of checking, when the application installed in the MR content production apparatus 100 is executed, the control unit 150 displays an application execution result screen on the display unit 130. [ Here, the app execution result screen includes an exhibition management item (or menu / button) for exhibition management (for example, including exhibition creation, deletion, modification, addition, etc.), an MR content management item for editing and creating MR contents, An MR content distribution item for sharing MR contents, and the like. The application execution result screen may further include a member information item for receiving or transmitting member information, a setting item for setting a function of the application, a My Page item for managing the MR content editing history information, and the like. At this time, the MR content production apparatus 100 communicates with a server related to the corresponding application in the background state.

In addition, the controller 150 generates a panorama image information request signal for requesting panorama image information related to a specific store, a specific exhibition, and the like.

The control unit 150 transmits the generated panorama image information request signal, identification information of the MR content production apparatus 100, and the like to the server through the communication unit 110. Here, the identification information of the MR content production apparatus 100 includes a mobile directory number (MDN), a mobile IP, a mobile MAC, a SIM (subscriber identity module) card unique information, and a serial number.

Also, the controller 150 receives specific panorama image information related to a specific store, a specific exhibition, and the like transmitted from the server through the communication unit 110 in response to the transmitted panorama image information request signal.

In addition, the controller 150 stores the received specific panorama image information in the storage unit 120. [

When the predetermined menu (or button) in the application execution result screen displayed on the display unit 130 is selected, the control unit 150 stores the menu (or button) stored in the storage unit 120 in the list / list display area of the display unit 130 A list (or list) of one or more panoramic image information is displayed. Here, the panoramic image information includes an image, a moving image, and the like. In addition to the image / moving picture, the panorama image information may include a code related to an object included in the image / moving picture, unique identification information of a code, a type of a code, a location information of a code in an image / (For example, a major classification, an intermediate classification, a small classification information, and the like) related to the image / video, a camera number, a panorama image file number , Shooting date and time information, runtime information, image type information (for example, VOD, live broadcasting, unsetting, etc.). At this time, the screen according to the preset menu selection includes a first area (or an image display area) for displaying a panorama image, a second area (or a category area) for displaying a category classification, A fourth area (or a setting area) for displaying a setting menu, a fifth area (or a list / list display area) for displaying a list including one or more panorama image information, and the like .

The first area (or the image display area) is an area for displaying an image, a moving image, or the like corresponding to the panoramic image. At this time, if the panorama image is a moving image, the moving image is displayed on one side of the first area, and a menu for playing, pausing, 2x fast forward / reverse playback of the moving image is displayed on the other side of the first area A menu indicating a highlight reproduction point, a menu indicating the total run time of the moving picture and the time of the reproduction point, and the like.

The second area (or category area) is an area for displaying one or more exhibition items set (or registered) through the exhibition management menu or the like in the form of a list box, a combo box, or the like. At this time, the category region can be divided into a plurality of category regions by a major category, a middle category, and a small category. In addition, when any category is selected through the category region, the controller 150 displays the list including the panorama image information corresponding to the selected category in the fifth region.

The third area (or the object marker display area) is an area for displaying predetermined object markers (for example, a shop camera, a product, a vendor, event information, etc.) that can be added to the panorama image information. In this case, when a specific object marker is selected (or a touch / double click is included) after the specific object marker is disposed in the panorama image information, the controller 150 displays, on one side of the third region, And further displays a screen for setting the attribute information for the user.

The fourth area (or setting area) is an area for displaying menu items such as a preview function, a delete function, a storage function, and a cancel function for the panorama image information being edited.

The fifth area (or list / list display area) is an area for displaying a list (or list) of one or more pieces of panorama image information stored in the storage unit 120.

When one of the panorama image information displayed on the display unit 130 is selected, the controller 150 displays the selected panorama image information on the first region (or the first region) of the display unit 130 Video display area). At this time, the panorama image information displayed in the first area of the display unit 130 may include an image or a moving image including a code photographed through a camera (not shown), one or more temporary markers related to the code have. Here, the temporary marker is for displaying the code type in relation to the code, and is for displaying a camera, a commodity, a business, an event information, and the like. The temporary marker may be a shop camera temporary marker (for example, indicated as 'CM') for indicating a shop camera, a product temporary marker (for example, indicated as 'PD') for indicating a product, (For example, 'EV') for displaying event information, and a temporary marker (e.g., 'EV') for displaying event information. In order to distinguish the temporary marker from the object marker, the border of the temporary marker is processed by dotted line, the background color is set to be transparent or the color is set to a specific color before being replaced (or replaced / changed) with the actual object marker State.

At this time, the controller 150 may display the one or more panorama image information corresponding to the one or more panorama image information displayed in the second area (or category area) in the screen displayed on the display unit 130 according to the user selection (or user touch / Category, and may display any one of the panorama image information selected from the at least one panorama image information corresponding to the selected category information in the first area (or the image display area) of the display unit 130 have.

In addition, the controller 150 may be configured to display any one or more of the one or more object markers displayed in the third area (or the object marker display area) according to user input (or control / operation command / user touch / When a specific region (or a specific position) on the first region (or the image display region) is selected after one object marker is selected, a code type corresponding to the selected specific region (or specific position) . Here, the code type (or the type of the temporary marker corresponding to the code type) corresponding to the specific region (or the specific position) may be any of camera, product, vendor, event information, and no related data. In addition, the type of the object marker may be any of camera, product, vendor, and event information.

That is, when one of the object markers displayed on the display unit 130 is selected and the selected object marker is to be arranged in a specific area on the panorama image information displayed on the display unit 130, The control unit 150 confirms (or determines) whether or not the code type set in advance for the specific area (or the type of the temporary marker corresponding to the code type) matches the type of the selected object marker.

At this time, the controller 150 uses one of the object markers in the third region (or the object marker display region) to select one of the object markers using the drag and drop function for the display unit 130 (Or a specific position) on the first area (or the image display area) by the drag-and-drop function after the object marker is dropped (or dragged) And the type of the selected one of the object markers may be compared with each other.

In this way, the control unit 150 determines whether or not the object marker to be placed in the specific area (or the specific position) is the same as the temporary marker set in advance corresponding to the specific area (or the same / similar area / Category).

If the code type corresponding to the selected specific region (or specific position) is no related data or the code type corresponding to the selected specific region (or specific position) and the code type corresponding to the selected specific region If the types of the object markers do not coincide with each other, the controller 150 displays information indicating that the object marker setting has failed in a pop-up form or the like on a part of the display unit 130 or displays the information in the image display area.

In addition, when a preset confirmation button displayed on one side of the information indicating that the object marker setting on the display unit 130 has failed is selected, the controller 150 releases (or releases the selected object marker) The object markers are deleted, the temporary markers corresponding to the selected specific regions (or specific positions) are continuously displayed, and the state is switched to the state for selecting the object markers.

If the code type corresponding to the selected specific region (or specific position) matches the type of the selected object marker, the control unit 150 determines whether the code region corresponding to the specific region (or the specific position) Or a specific position). Here, the controller 150 may arrange the object marker at another predetermined position corresponding to the specific area / specific position. At this time, the control unit 150 deletes the temporary marker located at the specific region (or the specific location) according to the arrangement of the object markers.

When the verification (or confirmation) of the object marker to be placed in the specific area is completed normally, the controller 150 replaces the temporary marker corresponding to the specific area with the object marker (or updates / / Change).

When the object marker positioned (or arranged) in the first area (or the image display area) displayed on the display unit 130 is selected (or touched / double-clicked) (Or the user touch / user selection), the attribute information for the selected object marker is set. Here, the attribute information for the object marker may differ depending on the type of the object marker.

That is, when the object marker is a commodity, the control unit 150 displays an image, a commodity name, a commodity unique code, price information, a moving picture link / addition, a detailed description, a catalog, (Or edit / modify / delete / add).

If the object marker is a shop camera, the control unit 150 sets (or edits / corrects / deletes / adds) at least one camera link among at least one camera related to the corresponding panorama image.

When the object marker is a business (or business information), the control unit 150 displays a business name, an image of the business, a business logo, a vendor unique code, a video link / addition related to the business, Set (or edit / modify / delete / add) the details of stored company details page address link.

When the object marker is an event (or event information), the control unit 150 sets an event name, an image / animation of the event, an event specific code, an event description, an event detail description page address link stored externally, (Or edit / modify / delete / add).

In addition, the controller 150 may select an object marker according to the user input, arrange the selected object marker in a specific area on the first area (or the image display area), and set property information on the disposed object marker , And arranges object markers and attribute information for all temporary markers included in the selected panorama image information to edit (or create / author) the MR contents.

In this way, in the state where the panorama image information including one or more temporary markers is displayed in the first area (or the image display area) of the display unit 130, The process of arranging the object markers by replacing the at least one temporary marker according to the touch point, and setting the attribute information for the disposed object markers is performed for all temporary markers included in the panorama image information.

When the object marker is disposed on the display unit 130 or when the setting of the attribute information for the object marker disposed on the display unit 130 is completed, the controller 150 displays the image corresponding to the object marker / The object included in the moving picture (or the code related to the object, the temporary marker related to the object / code) and the object marker are linked and stored.

At this time, the controller 150 extends the outline of the disposed object marker to the outline of the object corresponding to the temporary marker related to the object marker included in the image / moving image. That is, the controller 150 stores the coordinate values of the outline of the disposed object markers in correspondence with the coordinate values of the outline of the object corresponding to the temporary marker related to the object marker.

For example, when the event information object marker is disposed by replacing the temporary marker related to the object corresponding to the ABCD signboard, and the property information setting for the disposed event information object marker is completed, (Or extend) the coordinate value of the outline of the event information object marker with the coordinate value of the outline of the ABCD signboard.

In this way, by extending the outline of the object marker to the outline of the object related to the object marker, it is possible to obtain the effect of selecting the object marker even if the object is later selected.

When the preset preview menu (or button) displayed on the display unit 130 is selected, the controller 150 displays the result screen for one or more object markers arranged in the panorama image information in a pop- And displays it on the display unit 130.

That is, when a preset preview menu (or button) displayed on the display unit 130 is selected, the controller 150 displays the result image of the MR content (or the one or more object markers disposed in the panorama image information) Attribute information) on the display unit 130 in a preview form.

When the predetermined storage menu (or button) displayed on the display unit 130 is selected, the controller 150 displays a plurality of panorama image information on the panorama image information of the first region (or the image display region) (Or one or more) object markers. At this time, the MR content may include at least one of the panorama image information (e.g., a code related to an object included in an image / a moving picture, an image / a moving picture, unique identification information of a code, a type of a code, Location information of the temporary marker in the image / video, category information related to the image / video (including major classification, sub-classification, sub classification information, etc.), camera number, panorama image file number, shooting date And information such as time information, run-time information, and image type information (for example, VOD, live broadcast, unsettled, etc.)), object markers corresponding to the types of codes, positional information of object markers in the image / Attribute information of the object marker, and the like.

That is, when a preset storage menu displayed on the display unit 130 is selected, the controller 150 displays an arrangement of object markers according to a user selection, for all temporary markers included in the panorama image information of the first area, It is determined whether or not the attribute information setting of the object marker is completed.

That is, when the preset storage menu is selected, the controller 150 controls the arrangement of the object markers according to the user selection and the property information setting of the object markers for all the temporary markers included in the panorama image information of the first area Check whether it is completed or not.

If it is determined that all the temporary markers included in the panorama image information of the first area are not completely set in accordance with the user's selection and the attribute information setting of the object marker, ) Displays, on the display unit 130, temporary markers in which object marker placement and / or attribute setting of the object markers are not completed among all the temporary markers, and attribute information setting of the object markers and / or object markers is completed Guidance information on the arrangement of the object markers for the temporary markers which are not provided and / or the attribute information setting of the object markers is displayed on one side of the display unit 130.

If it is determined that all the temporary markers included in the panorama image information of the first area have been set according to the user's selection and the attribute information setting of the object marker has been completed, (Or one or more) object markers disposed on the panoramic image information of the region 1 (or the image display region).

When the panorama image information is a moving image and the preset storage button is selected in a state that one or more object marker arrangements and object marker property information setting in a specific screen (or a specific image) in the moving picture is completed, the controller 150 ) Includes code and temporary markers included in the moving picture based on the unique identification information of the code related to the temporary marker in which the object marker is disposed (or the unique identification information of the code related to the area / position where the object marker is disposed) (Or matching / updating / updating / updating) the related information to the set object markers (or the property information of the object markers).

In this case, even if the object marker arrangement and attribute information setting process are not completed for all the temporary markers included in the panorama image information in the state where the temporary storage item is additionally included in the setting area, The control unit 150 may temporarily store the object marker arrangement and property information set up to that point in time, information on remaining temporary markers that are not set as object markers, and the like in the storage unit 120 .

When the exhibition management item included in the application execution result screen displayed on the display unit 130 is selected, the controller 150 newly adds one or more pieces of exhibition-related information based on the user's input.

In addition, when the exhibition management item displayed on the display unit 130 is selected, the control unit 150 displays the category information of the specific panorama image information selected from the one or more panorama image information stored in advance in the storage unit 120, (Or interlocking / matching), changing (or updating), or deleting an exhibit item, and the like.

When the MR content distribution item included in the application execution result screen displayed on the display unit 130 is selected, the control unit 150 controls one or more of the other terminals, the server, the MR (Or shares) at least one of the MR contents stored in the storage unit 120 to the Social Networking Service (SNS) related to the content production apparatus 100.

In this manner, the MR content can be created by adding one or more markers to the panorama image information based on the panorama image information photographed through the camera.

Hereinafter, an MR content production method according to the present invention will be described in detail with reference to FIGS. 1 to 11. FIG.

FIG. 2 is a flowchart illustrating a method of producing MR content according to an embodiment of the present invention.

First, when a preset menu (or a button) in an application execution result screen displayed on the display unit 130 is selected, the control unit 150 stores the list / list display area of the display unit 130 in the storage unit 120 A list (or list) of one or more panoramic image information is displayed. Here, the panoramic image information includes an image, a moving image, and the like. In addition to the image / moving picture, the panorama image information may include a code related to an object included in the image / moving picture, unique identification information of a code, a type of a code, a location information of a code in an image / (For example, a major classification, an intermediate classification, a small classification information, and the like) related to the image / video, a camera number, a panorama image file number , Shooting date and time information, runtime information, image type information (for example, VOD, live broadcasting, unsetting, etc.). At this time, the screen according to the preset menu selection includes a first area (or an image display area) for displaying a panorama image, a second area (or a category area) for displaying a category classification, A fourth area (or a setting area) for displaying a setting menu, a fifth area (or a list / list display area) for displaying a list including one or more panorama image information, and the like .

For example, when the MR content management menu, which is a preset menu in the application execution result screen displayed on the display unit 130, is selected, the controller 150 controls the first area (or the image display A second region (or category region) 320, a third region (or object marker display region) 330, a fourth region (or setting region) 340, and a fifth region / List display area) 350 is displayed on the display unit 130. The MR contents management screen 300 shown in FIG. 3, the controller 150 displays five pieces of panorama image information (for example, image information) stored in the storage unit 120 in the fifth area (or the list / list display area) (For example, first to fifth panoramic image information), displays information for category classification (for example, a major category, an intermediate category, and the like) in the second area 320, (Or edit) the MR content related to the panoramic image information, and displays the one or more object markers on the fourth region 340 for performing preview, delete, A menu is displayed (S210).

When one of the panorama image information is selected from the one or more panorama image information displayed on the display unit 130, the controller 150 displays the selected panorama image information on the first region (or the first region) of the display unit 130 Video display area). At this time, the panoramic image information displayed in the first area of the display unit 130 may include a temporary marker related to the code, in addition to an image or a moving image including a code photographed through a camera (not shown). Here, the temporary marker is for displaying the code type in relation to the code, and is for displaying a camera, a commodity, a business, an event information, and the like. The temporary marker may be a shop camera temporary marker (for example, indicated as 'CM') for indicating a shop camera, a product temporary marker (for example, indicated as 'PD') for indicating a product, (For example, 'EV') for displaying event information, and a temporary marker (e.g., 'EV') for displaying event information. In order to distinguish the temporary marker from the object marker, the border of the temporary marker is dotted, the background color is set to transparent, or the color of the specific marker is changed to a specific color Displayed as set. In addition, the controller 150 may display an enlarged item, a reduced item, and the like on one side of the panorama image information displayed on the display unit 130. In addition, the controller 150 may display a panning button for panning the 360 degrees panoramic image up / down / left / right on the other side of the panorama image information displayed on the display unit 130. [

At this time, the controller 150 may display the one or more panorama image information corresponding to the one or more panorama image information displayed in the second area (or category area) in the screen displayed on the display unit 130 according to the user selection (or user touch / Category, and may display any one of the panorama image information selected from the at least one panorama image information corresponding to the selected category information in the first area (or the image display area) of the display unit 130 have.

4, when the fourth panorama image information is selected from among the first to fifth panorama image information shown in FIG. 3, the controller 150 controls the first And displays the selected fourth panorama image information 410 in the area. In this case, the fourth panorama image information may include at least one temporary marker (for example, CM, PD, CO, EV, etc.) associated with one or more codes included in the fourth panorama image information, (S220).

Then, the controller 150 determines which one of the one or more object markers displayed in the third area (or the object marker display area) according to the user input (or control / operation command / user touch / When a specific region (or a specific position) on the first region (or the image display region) is selected after one object marker is selected, a code type corresponding to the selected specific region (or specific position) . Here, the code type (or the type of the temporary marker corresponding to the code type) corresponding to the specific region (or the specific position) may be any of camera, product, vendor, event information, and no related data. In addition, the type of the object marker may be any of camera, product, vendor, and event information. In addition, the object marker can perform solid line processing on the border of the object marker to distinguish the object marker from the temporary marker.

That is, when one of the object markers displayed on the display unit 130 is selected and the selected object marker is to be arranged in a specific area on the panorama image information displayed on the display unit 130, The control unit 150 confirms (or determines) whether or not the code type set in advance for the specific area (or the type of the temporary marker corresponding to the code type) matches the type of the selected object marker.

At this time, when the controller 150 determines that any one of the object markers in the third region (or the object marker display region) is selected (or dragged) by using the drag and drop function for the display unit 130 (Or a specific position) dropped on the first area (or the specific display area) by the drag and drop function, the code marker corresponding to the specific area And the type of any one of the selected object markers.

For example, when the shop camera object marker 331 is selected from a plurality of object markers included in the third area (or the object marker display area) 330 shown in FIG. 4, When the product temporary marker area 510 on the side of the television on the first area (or the video display area) 310 is selected, the controller 150 displays the code type corresponding to the selected commercial temporary marker area (E.g., a product code corresponding to the temporary marker) and the type of the selected shop camera object marker 331 (e.g., 'camera', which is an object marker type corresponding to the shop camera object marker).

In another example, after the event information object marker 334 is dragged from a plurality of object markers included in the third area (or the object marker display area) 330 shown in FIG. 4, The control unit 150 displays the selected (or dragged) event information object marker 334 (or the dragged event information object marker) in the event information temporary marker area 520 next to the business name on the first area (or the image display area) (For example, 'event information' which is an object marker type corresponding to an event information object marker) and a code type corresponding to the dropped event information temporary marker area 520 (for example, corresponding to an event information temporary marker) Quot; event information ", which is a code type, for example).

In another example, after the event information object marker 334 is dragged from among a plurality of object markers included in the third area (or the object marker display area) 330 shown in FIG. 4, Similarly, when the control unit 150 drops an area 530 on an empty background on the first area (or the image display area) 310, the controller 150 displays the type of the selected (or dragged) event information object marker 334 (For example, 'event information' which is an object marker type corresponding to an event information object marker) and a code type corresponding to an area 530 on the dropped blank background No data ') (S230).

If the code type corresponding to the selected specific region (or specific position) is no related data or the code type corresponding to the selected specific region (or specific position) and the code type corresponding to the selected specific region If the types of the object markers do not coincide with each other, the controller 150 displays information indicating that the object marker setting has failed in a pop-up form or the like on a part of the display unit 130 or displays the information in the image display area.

In addition, when a preset confirmation button displayed on one side of the information indicating that the object marker setting on the display unit 130 has failed is selected, the controller 150 releases (or releases the selected object marker) The object markers are deleted, the temporary markers corresponding to the selected specific regions (or specific positions) are continuously displayed, and the state is switched to the state for selecting the object markers.

For example, a code type corresponding to the selected product temporary marker area (for example, a code type corresponding to a product temporary marker) and a type of the selected shop camera object marker 331 (for example, The controller 150 displays information 610 indicating that the object marker has failed to be displayed on the display unit 130 as shown in FIG. 6, when the object marker type 'camera' corresponding to the marker does not match. In a pop-up form. When the preset confirmation item 611 in the information 610 indicating that the object marker setting is unsuccessful displayed on the display unit 130 is selected, the control unit 150 displays a previous screen 4) is displayed on the display unit 130.

In another example, when the code type corresponding to the dropped area 530 on the blank background corresponds to a preset 'no related data', the controller 150 transmits information indicating that object marker setting has failed, In the form of a pop-up on a part of the display area 130 (S240).

If the code type corresponding to the selected specific region (or specific position) matches the type of the selected object marker, the control unit 150 determines whether the code region corresponding to the specific region (or the specific position) Or a specific position). Here, the controller 150 may arrange the object marker at another predetermined position corresponding to the specific area / specific position. At this time, the control unit 150 deletes the temporary marker located at the specific region (or the specific location) according to the arrangement of the object markers.

For example, the type of the selected (or dragged) event information object marker 334 (for example, 'event information' which is an object marker type corresponding to the event information object marker) and the dropped event information temporary marker area 520 (E.g., 'event information' which is a code type corresponding to the event information temporary marker), the control unit 150 determines that the event information is the previously displayed event information as shown in FIG. 7 (The 'EV marker' in FIG. 4) and deletes the temporary marker ('EV marker' in FIG. 4) (Or position / display) the event information object markers.

As another example, the type of the selected (or dragged) event information object marker 334 (for example, 'event information' which is an object marker type corresponding to the event information object marker) and the dropped event information temporary marker area When the code type corresponding to the code type (e.g., 'event information', which is a code type corresponding to the event information temporary marker), coincides with each other, the control unit 150 displays the previously displayed event information (The 'EV marker' in FIG. 4) corresponding to the region (or point / position) in which the temporary marker ('EV marker' in FIG. 4) The selected (or dragged) event information object markers are placed in a specific area (or point / position) 810 (S250).

When the object markers positioned (or arranged) in the first area (or the image display area) displayed on the display unit 130 are selected (or touched / double-clicked) (Or the user touch / user selection), the attribute information for the selected object marker is set. Here, the attribute information for the object marker may differ depending on the type of the object marker.

That is, when the object marker is a commodity, the control unit 150 displays an image, a commodity name, a commodity unique code, price information, a moving picture link / addition, a detailed description, a catalog, (Or edit / modify / delete / add).

If the object marker is a shop camera, the control unit 150 sets (or edits / corrects / deletes / adds) at least one camera link among at least one camera related to the corresponding panorama image.

When the object marker is a business (or business information), the control unit 150 displays a business name, an image of the business, a business logo, a vendor unique code, a video link / addition related to the business, Set (or edit / modify / delete / add) the details of stored company details page address link.

When the object marker is an event (or event information), the control unit 150 sets an event name, an image / animation of the event, an event specific code, an event description, an event detail description page address link stored externally, (Or edit / modify / delete / add).

In addition, the controller 150 may select an object marker according to the user input, arrange the selected object marker in a specific area on the first area (or the image display area), and set property information on the disposed object marker , And arranges object markers and attribute information for all temporary markers included in the selected panorama image information to edit (or create / author) the MR contents.

If the temporary marker is changed (or replaced / replaced / arranged) with the object marker in the state that the panorama image information is moving, the control unit 150 displays the unique identification information of the code corresponding to the temporary marker (Or the unique identification information of the code related to the area / position in which the object marker is disposed)), information related to the corresponding temporary marker and code included in the moving picture is set to the object markers (or attribute information of the object markers) All change (or match / synchronize / update) at once.

7, when the object marker 710 is double-clicked in a state where the event information object marker 710 is disposed on the display unit 130, as shown in FIG. 9, , The controller 150 displays one or more event information 910 related to the selected object marker 710 in the third area (or the object marker display area). Also, when the special sale event information 912 is selected from among one or more event information 910 related to the object marker 710 shown in FIG. 9, the controller 150 displays the selected special sale event information 912 Is set as the attribute information of the object marker 710. Here, the special sale event information 912 includes an event name (for example, a special sale), an image for an event, an event specific code (for example, 2016100100001), an event description (for example, .31.), 10% off all items, etc.).

In addition, the controller 150 edits the MR content as shown in FIG. 10 by repeating the process of selecting and arranging the object markers and setting the attribute information of the object markers in FIGS. 5, 7 to 9 (S260) .

Thereafter, when a preset preview menu (or button) is selected, the controller 150 displays a result screen for one or more object markers arranged in the panorama image information on the display unit 130 in a pop-up form.

That is, when the preset preview menu (or button) is selected, the controller 150 displays a result image of MR content authoring (or a screen for attribute information of one or more object markers disposed in the panorama image information) And displayed on the display unit 130 in a preview form.

For example, when a preview menu 341 included in the fourth area (or setting area) shown in FIG. 10 is selected, as shown in FIG. 11, the control unit 150 controls the fourth panorama A company marker 1010 and an event information marker 1020 relating to the ABCD name, a product marker 1030 related to the television product, a product marker 1040 and a shop camera marker 1050 relating to the first monitor, The result image 1110 of MR content authoring corresponding to the product markers 1060 and the shop camera markers 1070 related to the two monitors is displayed on the display unit 130 in a pop-up form at step S270.

When the predetermined storage menu (or button) is selected, the controller 150 displays a plurality of (or more than one) object markers disposed on the panorama image information of the first area (or the image display area) And generates the MR content including the MR content. At this time, the MR content may include at least one of the panorama image information (e.g., a code related to an object included in an image / a moving picture, an image / a moving picture, unique identification information of a code, a type of a code, Location information of the temporary marker in the image / video, category information related to the image / video (including major classification, sub-classification, sub classification information, etc.), camera number, panorama image file number, shooting date And information such as time information, run-time information, and image type information (for example, VOD, live broadcast, unsettled, etc.)), object markers corresponding to the types of codes, positional information of object markers in the image / Attribute information of the object marker, and the like.

That is, when the preset storage menu is selected, the controller 150 controls the arrangement of the object markers according to the user selection and the property information setting of the object markers for all the temporary markers included in the panorama image information of the first area Check whether it is completed or not.

If it is determined that all the temporary markers included in the panorama image information of the first area are not completely set in accordance with the user's selection and the attribute information setting of the object marker, ) Displays, on the display unit 130, temporary markers in which object marker placement and / or attribute setting of the object markers are not completed among all the temporary markers, and attribute information setting of the object markers and / or object markers is completed Guidance information on the arrangement of the object markers for the temporary markers which are not provided and / or the attribute information setting of the object markers is displayed on one side of the display unit 130.

If it is determined that all the temporary markers included in the panorama image information of the first area have been set according to the user's selection and the attribute information setting of the object marker has been completed, (Or one or more) object markers disposed on the panoramic image information of the region 1 (or the image display region).

When the panorama image information is a moving image and the preset storage button is selected in a state that one or more object marker arrangements and object marker property information setting in a specific screen (or a specific image) in the moving picture is completed, the controller 150 ) Includes code and temporary markers included in the moving picture based on the unique identification information of the code related to the temporary marker in which the object marker is disposed (or the unique identification information of the code related to the area / position where the object marker is disposed) (Or matching / updating / updating / updating) the related information to the object markers (or attribute information of the object markers) set therein.

For example, when the storage menu 343 included in the fourth area (or setting area) shown in FIG. 10 is selected, the controller 150 stores the fourth panorama image information as the fourth panorama image information A company marker 1010 and an event information marker 1020 relating to the ABCD name added to the first monitor, a product marker 1030 related to the television product, a product marker 1040 and a shop camera marker 1050 relating to the first monitor, The position information of each of the plurality of markers 1010 to 1070 in the fourth panorama image information, the position information of each of the plurality of markers 1010 to 1070 in the second panorama image information, the product marker 1060 and the shop camera marker 1070 related to the second monitor, (Or interlocked) with the respective attribute information of the first MR content to generate the fourth MR content. At this time, the controller 150 changes the information about temporary markers related to all the ABCD names included in the fourth panorama image information to the company marker 1010 and the event information marker 1020 related to the ABCD name.

Alternatively, when the preset storage menu is selected in a state where the arrangement of the marker and the property information are not set for the television product, the controller 150 replaces all the temporary markers included in the corresponding fourth panorama image information In step S280, the display unit 130 displays guide information on the marker arrangement and attribute information setting for the television product to inform that the arrangement of the markers and the setting of the attribute information are not completed.

As described above, in the embodiment of the present invention, one or more markers are added to the panorama image information based on the panorama image information photographed through the camera to produce the MR content, and the MR content is related to the object included in the panorama image information Thereby providing a variety of additional information, and it can induce the user's interest and improve the convenience.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

According to the present invention, one or more markers are added to the panorama image information on the basis of panorama image information photographed by a camera to provide various additional information related to an object included in the panorama image information, (MR) field, terminal field, panoramic image field, shopping information providing field, marketing field, server field, and the like, which can induce the interest of the user and improve the convenience. .

100: MR content production apparatus 110:
120: storage unit 130: display unit
140: audio output unit 150:

Claims (18)

In an MR content production method,
Displaying a list of one or more pieces of panoramic image information on one side in a list / list display area in an app execution result screen by the display unit;
Displaying the selected panorama image information including one or more temporary markers on a video display area of the display unit when any one of the panorama image information displayed on the display unit is selected by the control unit;
When a first object marker selected from a plurality of object markers displayed in an object marker display area of the display unit is dropped into a first area on the image display area by a drag and drop function, Determining whether a code type corresponding to a first area where the first object marker is dropped matches a type of the selected first object marker;
Wherein when the code type corresponding to the first area where the first object marker is dropped matches the type of the selected first object marker, the control unit causes the control unit to display, in the first area, Placing one object marker; And
And setting attribute information for the selected first object marker based on a user input by the control unit when a first object marker disposed in the image display area is selected. The method according to claim 1,
The application execution result screen includes:
A category area for displaying a category classification, an object marker display area for displaying an object marker, a setting area for displaying a setting menu, and a list including at least one panorama image information for displaying the panorama image And the list / list display area for displaying the MR contents. The method according to claim 1,
The panorama image information includes:
A code relating to an object included in the image / moving picture, a unique identification information of the code, a kind of code, a position information of the code in the image / moving picture, a temporary marker corresponding to the type of the code, A location information of a temporary marker in the moving image, category information related to the image / moving image, a camera number, a panorama image file number, photographing date and time information, run time information and image type information. MR content creation method. The method according to claim 1,
Wherein the temporary marker comprises:
A code temporary marker, a commercial temporary marker, a manufacturer temporary marker, and an event information temporary marker, in association with the code. The method according to claim 1,
Wherein the temporary marker comprises:
In order to distinguish the object marker from the object marker,
Wherein the object marker comprises:
And the border is solid-line-processed. The method according to claim 1,
Wherein the step of checking whether a code type corresponding to the first area matches a type of the selected first object marker,
Selecting the first object marker according to user selection among a plurality of object markers displayed in the object marker display area of the display unit;
Selecting the first area on the image display area of the display unit; And
And checking whether a code type set in advance for the selected first area matches a type of the selected first object marker. The method according to claim 1,
When the code type corresponding to the first area is not related to the predetermined data or when the code type corresponding to the first area and the type of the first object marker do not match, Displaying information indicating that the object marker setting has failed in a pop-up form in a partial area of the display unit; And
Further comprising returning to selecting an object marker among the plurality of object markers when a preset menu displayed on a part of the display unit is selected. The method according to claim 1,
Wherein the step of arranging the first object marker in the first area comprises:
Deleting a temporary marker located in the first area when a code type corresponding to a first area where the first object marker is dropped matches a type of the selected first object marker; And
And arranging the first object marker in the first area in which the temporary marker is located. The method according to claim 1,
The attribute information for the first object marker may include:
And at least one of an image, a product name, a product unique code, price information, a moving picture link related to a product, a detailed description, a catalog, and an externally stored detailed page address link when the object marker is a product,
And at least one camera link among at least one camera associated with the panoramic image information when the object marker is a shop camera,
When the object marker is a business, includes at least one of a business name, an image of a business, a business logo, a business code, a video link related to a business, a business description, a catalog,
When the object marker is event information, at least one of an event name, an image / animation of an event, an event specific code, an event description, and an event detail description page address link stored externally. The method according to claim 1,
Wherein the setting of the attribute information for the first object marker comprises:
Wherein when the temporary marker is changed to the object marker in the state that the panorama image information is moving image, information related to the temporary marker and the code included in the moving image, based on the unique identification information of the code corresponding to the temporary marker, And the attribute information of the object marker to be set. The method according to claim 1,
Displaying on the display unit a result screen for one or more object markers arranged in the panorama image information of the image display area in a pop-up form by the control unit when a preset preview menu displayed on the display unit is selected Further comprising the steps of: The method according to claim 1,
Further comprising generating MR content including one or more object markers disposed on the panorama image information of the image display area by the control unit when a preset storage menu displayed on the display unit is selected The method comprising: 13. The method of claim 12,
Wherein the generating the MR content comprises:
When the preset storage menu displayed on the display unit is selected, the arrangement of the object markers according to the user selection and the setting of the property information of the object markers are completed for all the temporary markers included in the panorama image information of the image display region ; And
[0031] As a result of the determination, when all of the temporary markers included in the panorama image information are in a state in which the object marker arrangement and the property marker information setting of the object marker are completed, the MR marker including one or more object markers disposed on the panorama image information And generating the MR content. 13. The method of claim 12,
Wherein the MR content comprises:
A code relating to an object included in the image / moving picture, a unique identification information of the code, a kind of code, a position information of the code in the image / moving picture, a temporary marker corresponding to the type of the code, A location information of a temporary marker in the moving picture, category information related to the image / moving picture, a camera number, a panorama image file number, photographing date and time information, runtime information, image type information, An object marker, position information of an object marker in the image / moving image, and attribute information of the object marker. In an MR content production apparatus,
A storage unit for storing at least one panorama image information;
A display unit for displaying a list of at least one panorama image information stored in the storage unit in a list / list display area in an application execution result screen; And
When one of the at least one panorama image information displayed on the display unit is selected, displaying the selected panorama image information including at least one temporary marker on the image display area of the display unit, When a first object marker selected from a plurality of object markers displayed in a display area is dropped in a first area on the image display area by a drag and drop function, a code corresponding to a first area in which the first object marker is dropped The type of the selected first object marker matches the type of the selected first object marker, and if the type of the selected first object marker matches the type of the code corresponding to the first region in which the first object marker is dropped , Arranging the first object marker in a first area in the image display area, And setting attribute information for the selected first object marker based on a user input when a first object marker disposed in the region is selected. 16. The method of claim 15,
Wherein,
And changing the temporary marker located in the first area to the first object marker when the code type corresponding to the first area where the first object marker is dropped matches the type of the selected first object marker. MR content creation device. 16. The method of claim 15,
Wherein,
Wherein when the temporary marker is changed to the object marker in the state that the panorama image information is moving image, information related to the temporary marker and the code included in the moving image, based on the unique identification information of the code corresponding to the temporary marker, And changes all of the attribute information of the object markers to be set. 16. The method of claim 15,
Wherein,
And generates MR content including one or more object markers disposed on the panorama image information of the image display area when a preset storage menu displayed on the display unit is selected.

Images