KR20230121695A - Method and apparatus for performing storytelling based on 360 degree image - Google Patents

Abstract

The present invention is an image processing method for providing an image of a specific space, comprising the steps of obtaining input information from a user, determining another image among a set of images of the specific space based on the input information and a current image provided to the user. and providing the determined other image to the user, wherein at least one piece of spatial information in the spatial information set may include object information and information indicating an object into which the object information is inserted.

Description

Method and apparatus for performing storytelling based on 360-degree images

The present invention relates to a method and apparatus for performing storytelling based on 360-degree images, and more particularly, to a method for processing a specific space into a plurality of 360-degree images according to locations and performing storytelling based thereon, and It's about the device.

A 360-degree image may refer to an image showing all directions at a certain position, unlike an existing image in one direction. Recently, the field of VR (virtual reality) is attracting attention, and 360-degree images for VR are also attracting attention.

Since these 360-degree images include information beyond the user's field of view, they can cover all movements of the user's gaze, thereby providing a high sense of immersion. However, in recent years, there has been an increase in research to provide more than simply providing a wide range of images by utilizing 360-degree images.

On the other hand, individually composed photos are discontinuous, giving a segmented impression to the viewer, and videos, compared to photos, give continuous and integrated images as each scene is continuous. However, in order to find the part containing the information the viewer is looking for, the video must be looked at before and after at different playback times, and only the flow of time is shown according to the video playback. Therefore, there is a limit to immediately and intuitively giving the viewer desired information.

In addition, various conventional technologies based on 360-degree images generally simply arrange photos taken of real spaces in succession, such as Naver Street View/Daum Road View, and allow the user to move in the space.

An object of the present invention to solve the above problems is to provide a method of processing 360-degree images to perform storytelling.

Another object of the present invention to solve the above problems is to provide a device for processing 360-degree images to perform storytelling.

Another object of the present invention to solve the above problems is a method of processing 360-degree images to perform storytelling that overcomes the limitations of photographic media giving a segmented impression and the limitations of non-intuitive impressions of video media, or a method thereof. to provide the device.

Another object of the present invention for solving the above problems is to reduce boredom for users by differentiating displayed objects such as characters and characters and their operations for each image when performing storytelling based on 360-degree images Like storytelling, it is to enable users to more accurately deliver intentions or messages.

An image processing method for providing an image of a specific space according to an embodiment of the present invention for achieving the above object includes obtaining input information from a user, and processing the image based on the input information and a current image provided to the user. Determining another image from among a set of images for a specific space and providing the determined other image to a user, wherein at least one piece of spatial information in the spatial information set indicates object information and an object into which the object information is inserted. information may be included.

Here, the input information may include any one of location change request information, time change request information, and space change request information.

Here, when the input information is time change request information or space change request information, the other image may include an image of the same specific space as the current image or different object information.

Here, the method may further include acquiring correction information from a user and correcting the object information and information indicating an object into which the object information is inserted based on the correction information.

Here, the image set may include at least one other image whose location is changed from the current image, at least one other image whose location is changed from the current image, and another image whose location is changed from the current image.

An image processing device for providing an image of a specific space according to an embodiment of the present invention for achieving the above object includes a processor and a memory storing at least one command executed through the processor, . The image is provided to the user, and at least one piece of spatial information in the spatial information set may include object information and information indicating an object into which the object information is inserted.

Here, the input information may include any one of location change request information, time change request information, and space change request information.

Here, when the input information is time change request information or space change request information, the other image may include an image of the same specific space as the current image or different object information.

Here, the at least one command may be executed to obtain modification information from a user, and may be executed to modify the object information and information indicating an object into which the object information is inserted based on the modification information.

Here, the image set may include at least one other image whose location is changed from the current image, at least one other image whose location is changed from the current image, and another image whose location is changed from the current image.

According to the present invention, various views of the same space can be provided based on a plurality of 360-degree images.

According to the present invention, by adding object information and additional information to an image, storytelling can be added to a specific space and the value of space consumed by a user can be improved.

According to the present invention, it is possible to provide high efficiency in promotion and advertisement by adding storytelling to a specific space based on an image.

According to the present invention, since a user is provided with an omnidirectional image for each location while moving a location within a specific space, it is possible to provide a high sense of immersion in directly exploring a specific space.

According to the present invention, it is possible to provide a user with a more intuitive access to content compared to photos and non-intuitive video media that give a segmented impression.

According to the present invention, in the storytelling, the displayed objects such as characters and characters for each image and their operation are different to relieve the user's boredom and to more accurately convey the intention or message to the user. can do.

1 is a diagram illustrating a state in which data is inserted into an image according to an embodiment of the present invention.
2 is a diagram for explaining screen conversion according to an embodiment of the present invention.
3 is a block diagram of an image processing device according to an embodiment of the present invention.
4 is a block diagram of an apparatus for generating spatial information according to an embodiment of the present invention.
5 is a block diagram of an apparatus for controlling spatial information according to an embodiment of the present invention.
6 is a block diagram of an image processing device according to another embodiment of the present invention.
7A to 7C are diagrams illustrating types of various images that can be provided for a specific space according to an embodiment of the present invention.
8a †T FIG. 8d is a diagram showing various images of a specific space according to an embodiment of the present invention.
9A to 9H are diagrams implementing a crime scene according to an embodiment of the present invention.
10A to 10H are diagrams implementing an automobile exhibition hall according to an embodiment of the present invention.
11a to 11d are diagrams implementing a shooting studio according to an embodiment of the present invention.
12a to 12f are diagrams illustrating the interior of a restaurant according to an embodiment of the present invention.
13A to 13G are diagrams of a workspace implemented according to an embodiment of the present invention.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. Like reference numerals have been used for like elements throughout the description of each figure.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention. The term “and/or” includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle. It should be. On the other hand, when an element is referred to as “directly connected” or “directly connected” to another element, it should be understood that no other element exists in the middle.

Terms used in this application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described in more detail. In order to facilitate overall understanding in the description of the present invention, the same reference numerals are used for the same components in the drawings, and redundant descriptions of the same components are omitted.

Spatial information according to an embodiment of the present invention may include images representing a specific space, and the image may refer to a 360-degree image or an omnidirectional image. In the description of the present invention, a screen may refer to a part of an image provided according to a user's field of view, and may also be referred to as a viewport. Here, the size of the partial area may be flexibly changed according to the user's viewing range, but may be determined based on the size of the displayed screen. An image provided to the user may be determined based on a location in a specific space, and the location may be referred to as a viewpoint or viewing point.

An embodiment of the present invention may move from one position to another in a specific space according to a user's input through a preset scenario or user interface, and provide each position and/or scene at the time of movement, and even in the same position, various scenes may be provided. scenes can be provided. Through this, the user may be provided with scenes according to scenarios or scenes according to his or her interest in a specific space. In other words, an embodiment of the present invention may provide dynamic visual information to a user based on a still image.

1 is a diagram illustrating a state in which data is inserted into an image according to an embodiment of the present invention.

Referring to FIG. 1 , an image according to an embodiment of the present invention may represent an appearance at a location in a specific space, and a screen may represent a partial area within the image according to a user's field of view. Here, object information may be inserted into the image, and when the location of the object information in the image exists within a partial region according to the user's field of view, the object information may be provided to the user.

For example, a specific space may mean a space such as inside a building, hall, living room, yard, exhibition hall, conference room, etc., and the image is a omnidirectional view from any position inside the building, hall, living room, yard, exhibition hall, or conference room. , and the screen may mean a partial area in the image according to the user's field of view at any of the above positions.

Object information may refer to information that can be additionally provided in relation to a certain object in addition to a simple image. The object may include objects such as a picture frame and an object, and may include display information about another space that can be checked or moved if it exists. Also, the object information may include information about a specific space itself or a specific location in a specific space. In other words, the object information may include all descriptions or information to be additionally provided to the user in addition to the image in a specific space. Object information may be provided including at least one of text, image, video, and link information related to the object, but the format of the provided information is not limited thereto.

The image may include information indicating inserted object information (or an indication that additional information exists). The indicated information may include a button and may include a special shadow or neon effect. For example, if the information to indicate is a button, the button may be composed of a circle and a solid line, and the solid line may be composed so that the object and the circle are connected, but the shape of the button may be implemented in various ways depending on the setting, It is not limited to this. Object information may appear on an image based on user input information, such as when a user clicks a button or button circle of a corresponding object in the image, but may always be displayed without user input information, and may be displayed depending on the scenario. may be

For example, when an object is set as a smartphone, the object information may mean information related to the corresponding smartphone and may include information about the type of smartphone, owner information of the smartphone, price of the smartphone, and the like. If the object is set as a table, the object information may refer to table-related information and may include information about the size of the table and the manufacturer of the table. If the object is set as a book, the object information may include information about the corresponding book, and may include information about the size of the book, the pages of the book, the synopsis of the book, and the sales volume of the book. This object information can be set and/or modified.

Also, the image may further include additional information according to settings. The additional information may include at least one of text, image, and video. For example, the additional information may include an artificial image or other specific image created by a user. Here, another specific image may include a painting work or a specific appearance of another space. In other words, the image may be provided with additional information inserted by the user, and through this, a virtual exhibition or the like may be provided.

The image may include other images and objects different from each other according to the same view in the same specific space, and accordingly may include other object information. Through this, the user can be provided with different information, different feelings, or different stories by being provided with the same specific space or different images.

2 is a diagram for explaining screen conversion according to an embodiment of the present invention.

Referring to FIG. 2 , a screen may refer to a partial area according to a user's field of view within a 360-degree image. The screen may overlap a user interface for a user's manipulation in a partial region of the image. The screen transition may include screen rotation in which an image including the current screen is changed to another screen through rotation within the image, and may include position change, time change, and space change in which the image including the current screen is changed to another image. can Such screen switching may be performed based on user input information through a user interface, but may be performed automatically based on current time information and user location information, or may be performed according to a preset scenario.

In addition, the user may be provided with an initial image according to a specific location in a specific space and/or an initial screen according to a specific field of view, and may change to another screen or another image through a screen transition from the initial screen. Here, the initial image or initial screen may be set to the last image or the last screen previously provided, and may always be set to the same image or the same screen, but may be changed according to settings, so it is not limited thereto.

Position change, time change, and space change during screen transition mean that the screen is changed as the current image is changed to another image. The object, object information, and additional information may be different from each other or may be the same. In other words, when different, at least one of the object, object information, and additional information may be omitted or added. Each of location change, time change and spatial change may be as follows.

The location change is to change the user's location in a specific space, and another image to be changed from the current image may be determined based on the changed location. For example, the location change may include movement to another space, such as from a living room to a yard, and movement within the same space, such as to another location within a living room. The location change may be performed based on user input information, such as when the user clicks a certain point (or a movable location point) on the image, but the method may be set differently, so it is not limited thereto.

Time change refers to changing time information of a specific space, and another image to be changed from the current image may be determined based on the changed time information. An embodiment of the present invention may include a plurality of images according to different times even in the same location for time change. For example, the time change may be performed based on user input information, such as when the user clicks a button preset through a user interface or clicks twice on a point where there is no specific button on the screen within a certain period of time. Since the method may be set differently, it is not limited thereto. In addition, when there are a plurality of images corresponding to a certain position according to time change, the current image may be changed to the next other image according to a preset order based on user input information, but this may also be set differently. may be, but is not limited thereto.

Space switching is to change the concept of a specific space, and another image to be changed from the current image may be determined based on preset concept information. Here, another image to be changed may be an image having a different interior and atmosphere from the current image. An embodiment of the present invention may include a plurality of images according to different concepts even in the same location for spatial conversion. For example, space switching may be performed based on user input information, such as when the user clicks a button preset through a user interface or clicks three times on a point where there is no specific button on the screen within a certain period of time. Since the method may be set differently, it is not limited thereto. In addition, when there are a plurality of images corresponding to a certain location according to space conversion, the current image may be changed to the next image according to a preset order based on user input information, but this may also be set differently. may be, but is not limited thereto.

Screen rotation is to change the area to be displayed according to the user's view through rotation within the current image. It is included in one of the screen transitions, but may be different from position change, time change, and space change where the current image is changed to another image. there is. In other words, screen rotation can be seen as changing the direction or line of sight of the user at the same location. For example, screen rotation may be performed based on user input information such as dragging from a certain point on the screen, clicking a preset button on the screen, or waiting while pressing a preset button, but the method is different. Since it can be set, it is not limited thereto.

An embodiment of the present invention can provide an effect according to a user's movement or gaze change in a specific space through the various screen transitions described above, and different objects according to the location change, time change, and space change during screen transition. Since another image including information may be provided, an effect of a user directly visiting a specific space may be provided using this, and storytelling may be added to the space using object information.

3 is a block diagram of an image processing device according to an embodiment of the present invention.

Referring to FIG. 3 , an image processing device 300 according to an embodiment of the present invention may include a spatial information generating device 310 , a spatial information controlling device 320 and a database 330 . In the image processing device according to an embodiment of the present invention, the spatial information generating device 310 and the spatial information controlling device 320 may be omitted. In the description of the present invention, each component is not limited to a name and may be defined as a function. In addition, one function may be performed by a plurality of components, and a plurality of functions may be performed by one component.

The spatial information generating device 310 may generate spatial information based on image information. Here, spatial information may include a set of images of a specific space, and may further include a 3D image of a specific space, which will be described later. The spatial information generating device 310 may store the generated spatial information in the database 330 . A detailed description of the spatial information generating device 310 will be described later along with FIG. 4 .

The spatial information control device 320 may provide spatial information to the user, and may change an image or screen provided to the user to another image or another screen based on the user's input information. The spatial information control device 320 may provide images to the user by using the spatial information stored in the database 330 . A detailed description of the spatial information control device 320 will be described later along with FIG. 5 .

The database 330 may store spatial information. Here, the spatial information may include spatial information generated by the spatial information generating device 310, or may include spatial information acquired through wired/wireless communication or a storage medium.

Spatial information may mean a set of images including at least one image of a specific space or a set of images. For example, the image set may include images according to locations in a specific space and may include images to be changed according to a screen transition. In addition, the images to be changed may select a basic image or a basic image for each position, and may be replaced and stored only with information about a difference from the basic image.

4 is a block diagram of an apparatus for generating spatial information according to an embodiment of the present invention.

Referring to FIG. 4 , the spatial information generating device 400 according to an embodiment of the present invention may include a data collection unit 410 and a space processing unit 420, and may further include a data insertion unit 430. can In the description of the present invention, each component is not limited to a name and may be defined as a function. In addition, one function may be performed by a plurality of components, and a plurality of functions may be performed by one component.

The data collection unit 410 may collect image information. The data collection unit 410 may collect image information through wired/wireless communication or may collect image information through a storage medium. In addition, image information may be collected using an image capture device such as a camera. Here, the image information may include panoramic image information, a circular image according to a fisheye lens, and image information according to multiple viewpoints, but is not limited thereto, and may cover 360 degrees or all directions. All information about at least one image may be included.

The spatial processor 420 may generate spatial information based on image information collected by the data collector 410 . The spatial processing unit 420 may perform at least one of operations such as decapsulation, decoding, and unpacking according to image information to generate spatial information. The image information may include 360 image information or omnidirectional image information. Also, the space processing unit 420 may generate a 3D image for a specific space based on image information, and the 3D image may be used as a three-dimensional view to be described later. Also, the space processing unit 420 may generate floor plan information for a specific space based on image information, and the floor plan may be generated for each floor.

The data insertion unit 430 may insert additional information, objects, and/or object information into the spatial information generated by the spatial processing unit 420 . A detailed description thereof has been described above with reference to FIG. 1 .

In other words, the space information generating device 400 may generate images to represent a specific space by the data collection unit 410 and the space processing unit 420, and additional information and objects by the data insertion unit 430. And/or object information may be inserted into the generated images.

5 is a block diagram of an apparatus for controlling spatial information according to an embodiment of the present invention.

Referring to FIG. 5 , an apparatus 500 for controlling spatial information according to an embodiment of the present invention may include a user interface unit 510 and a spatial controller 520 . In the description of the present invention, each component is not limited to a name and may be defined as a function. In addition, one function may be performed by a plurality of components, and a plurality of functions may be performed by one component.

The user interface unit 510 may obtain input information from the user and may provide the user with a screen of a partial area according to the user's field of view in an image of a specific space. The user interface unit 510 may include an interface overlapping a screen to obtain input information from a user, and screen rotation without image change during screen switching may be performed through the user interface unit 510 .

Also, the user interface unit 510 may operate according to two modes. The two modes may include a guest mode and an administrator mode. In the case of the guest mode, the operation may be performed as described above. More can be provided.

The space control unit 520 may derive another image for a specific space to be provided to the user from a database based on user input information obtained from the user interface unit 510 . For example, when the user interface unit 510 obtains input information about position change, time change, and space change requiring image change during screen change from the user, the space control unit 520 changes the database based on this. It is possible to derive an image to be used, and deliver the derived image to the user interface unit 510 so that it can be provided to the user. Here, the current image may be referred to as the first image, and the changed or derived image may be referred to as the second image. In addition, when the user interface unit 510 operates in the manager mode, additional information on an image, an object, or correction information on object information may be obtained from the user interface unit 510 and reflected on the image, and the reflected image may be reflected in a database. can be stored in

6 is a block diagram of an image processing device according to another embodiment of the present invention.

Referring to FIG. 6 , an image processing device 600 according to an embodiment of the present invention may include at least one processor 610 , a memory 620 and a storage device 630 .

The processor 610 may execute program commands stored in the memory 620 and/or the storage device 630 . The processor 610 may mean a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods according to the present invention are performed. The memory 620 and the storage device 630 may be composed of volatile storage media and/or non-volatile storage media. For example, the memory 620 may include read only memory (ROM) and/or random access memory (RAM).

The memory 620 may store at least one command executed through the processor 610 . The at least one command includes a command for acquiring input information from a user, a command for determining another image among a set of images for a specific space based on the input information and a current image provided to the user, and providing the determined other image to the user. Can contain commands.

In addition, the at least one command may further include at least one of a command for obtaining correction information from a user and a command for modifying the object information and information indicating an object into which the object information is inserted based on the correction information. .

Here, at least one image in the image set may include object information and information indicating an object into which the object information is inserted.

Here, the input information may include any one of location change request information, time change request information, and space change request information, and when the input information is time change request information or space change request information, the other image It may have an image for a specific space identical to the current image or different object information.

Here, the image set may include at least one other image whose location is changed from the current image, at least one other image whose location is changed from the current image, and another image whose location is changed from the current image.

At least one other image whose location has changed from the current image may include location information different from that of the current image, and at least one other image whose time has changed from the current image may include time information different from that of the current image, Another image spatially converted from the current image may include concept information different from that of the current image, and change may be performed based on the location information, time information, and concept information.

7A to 7C are diagrams illustrating types of various images that can be provided for a specific space according to an embodiment of the present invention.

An image of a specific space according to an embodiment of the present invention may be provided to the user in various forms. For example, the image may include three types of figures or drawings of a specific space, but is not limited thereto. The image may be provided with one of three shapes based on user input information such as a preset button, and may be changed to another image based on user input information.

Referring to FIG. 7A , the spatial information may include a screen showing a partial area in an image according to the user's field of view. The screen according to the user's field of view described as shown in FIGS. 1 and 2 may correspond to this. This may specifically provide indoor information of a specific space according to the user's location and line of sight.

Referring to FIG. 7B , space information may include a stereoscopic view according to a 3D image of a specific space. When a specific space includes a plurality of floors, the stereoscopic view may represent a plurality of floors together.

Referring to FIG. 7C , spatial information may include a plan view of a specific space. The floor plan may provide a plan view for each floor when a specific space includes a plurality of floors. In addition, a floor plan according to any one of a plurality of floors may be provided based on user input information such as preset buttons.

In the case of FIGS. 7B and 7C , some areas within a specific space may be highlighted and provided to the user according to settings, but such effects may be changed according to settings, and thus are not limited thereto.

8A to 8D are diagrams showing various screens for a specific space according to an embodiment of the present invention.

8A to 8D may be screens showing a living room of a family home. However, each screen may be an area within a different image, but may include a different view of the same space.

For example, FIG. 8A shows a left area of a living room, and may be a screen including two children, one of which is playing with a balloon. FIG. 8B is a screen showing the living room of the same family, but slightly rotated to the right compared to FIG. 8A , and may be an image including the presence of only one child among two children. Balloons may not exist here. FIG. 8c is a screen showing the living room of the same family, but shows a more advanced view of the living room than FIGS. 8a and 8b, and includes only one child out of two children and one child holding a balloon. can 8D may be a screen showing a living room of the same family or a screen including a family member sitting on a sofa together. Balloons may not exist here.

Referring to FIGS. 8A to 8D , in an embodiment of the present invention, various appearances can be produced even in the same space, and a location in a specific space can be moved. Therefore, one embodiment of the present invention can configure and provide visual scenarios based on the above-described images and screens with various appearances, various information, space movement and rotation, etc., and also provide storytelling based on this. You may.

Hereinafter, it will be described in more detail based on a detailed example implemented according to an embodiment of the present invention.

9A to 9H are diagrams implementing a crime scene according to an embodiment of the present invention.

A crime scene can be effectively implemented using an embodiment of the present invention. Alternatively, it may be provided through wired or wireless communication such as the Internet. A crime scene representing a crime scene may include a large amount of data according to many scenes and many case records, and it is difficult to organize such a large amount of data into general documents such as A4, etc., and it is more difficult to identify the crime scene based on this . An embodiment of the present invention can implement a crime scene based on a vast amount of data, and can intuitively, specifically, and visually provide a crime scene. In other words, the specific location of a corpse or bloodstain, various memos and comments during a case investigation, and the results of a coroner can be effectively provided together with the crime scene.

Hereinafter, it will be described in detail with reference to images provided as a crime scene, but this is an example and the present invention is not limited thereto. The image may include a 360-degree image or an omnidirectional image, and the user may be provided with a portion of the 360-degree image or the omnidirectional image, and another portion of the 360-degree image or the omnidirectional image may be provided through rotation. The area provided by the user may be referred to as a screen, and some areas currently being provided may be referred to as a current screen. The screen may be used interchangeably with the scene, which may be used equally below. .

Referring to FIG. 9A , the user may be provided with an image of the inside of a bathroom at a crime scene as an initial image. Here, the current screen may include a partial area inside the bathroom, three viewport icons, and map information. Here, the viewport icon may refer to an icon or button capable of directly calling a pre-specified image, and the map information may refer to a mini-map showing areas where a current crime scene is provided as a whole.

9B may be a screen showing another area within the same image by rotating the screen of FIG. 9A through a user interface. Referring to FIG. 9B , among the two circles, a circle further including a relatively small circle in the center may mean a movable location point, and the other circle may mean a user's cursor.

FIG. 9C may be a screen showing a partial area within the image at the moved location point after clicking and moving the movable location point from the screen of FIG. 9B. Referring to FIG. 9C , the current screen may include an image of a warehouse with a closed door, an image of a laundry room in which a washing machine is placed, and an image of a room with an open door. An indication that additional information exists may appear on the door of the warehouse and inside the room, and when the user brings the cursor to the door of the warehouse, additional information may appear. Here, additional information may mean object information, and viewpoint #57 may be provided. In addition, map information at the lower left as moving from FIG. 9B may provide information on the current location moved within the entire provided areas.

In FIG. 9d, since viewpoint #57, which is the additional information confirmed in FIG. 9c, exists in the viewport icon at the top left of the screen, it may be a screen showing viewpoint #57 by clicking it with the user's cursor. Referring to FIG. 9D , the current screen may include the inside of the warehouse door, and this may be a screen according to viewpoint #57. Referring to FIG. 9D , it can be seen that many carriers and secretly wrapped luggage are stacked inside the warehouse.

FIG. 9E may be a screen showing a partial region in the image at the moved location point after clicking and moving a location point that can be moved from the screen of FIG. 9C to the room where the door is open. Referring to FIG. 9E , the current screen may include a view looking inside the room from outside the room door. Inside the room, indications of the presence of additional information may appear on the floor and sides of the room. As moving from FIG. 9C , the map information on the lower left can provide information on the current location moved within the entire provided areas.

FIG. 9F may be a screen showing a partial area within the image at the moved location point after clicking and moving a location point capable of moving inside the room from the screen of FIG. 9E. Referring to FIG. 9F , the current screen may include a dead body, a clothes drying rack, and objects piled with cloth. Indications of the presence of additional information may appear on the floor of a room, a dead body, or an object wrapped in cloth. When the user's cursor is brought to the display, additional information such as the autopsy report may be displayed. As moving from FIG. 9E , the map information on the lower left can provide information on the current position moved within the entire provided areas.

9g may be a screen showing a three-dimensional view showing the entire provided area in three dimensions. Referring to FIG. 9G , four icons may exist at the bottom of the map information located at the bottom left of the screen, and an overall three-dimensional view may be provided by clicking the second icon from the left. A stereoscopic view may be provided with an indication that additional information is present. Here, when the first from the left is clicked, a screen providing a partial area within the image according to the user's field of view may be provided.

9H may be a screen showing a plan view representing the entire provided area in two dimensions. Referring to FIG. 9H , four icons may exist at the bottom of the map information located at the bottom left of the screen, and a plan view of each floor may be provided by clicking the third icon from the left. You can also click the 4th from the left or the 1st from the right to display the floor plan of another floor. The floor plan may be provided with an indication that additional information exists.

Referring to FIGS. 9A to 9H , a crime scene implemented according to an embodiment of the present invention may actually move at a crime scene and provide an effect of confirming scenes at each location, and the main points and Since comments can also be provided, it is possible to reproduce and provide a crime scene intuitively and visually, solving difficulties caused by existing images and documents. That is, it is possible to provide an effect in which a user directly visits a crime scene using a cursor.

10A to 10H are diagrams implementing an automobile exhibition hall according to an embodiment of the present invention.

An automobile showroom can be effectively implemented using an embodiment of the present invention. Alternatively, it may be provided through wired or wireless communication such as the Internet. An automobile exhibition hall realized according to an embodiment of the present invention can provide the appearance of an actual exhibition store, and since people move for each image as well as a simple vehicle appearance and store, the overall feeling of the store can be provided together. . Hereinafter, it will be described in detail with reference to images provided to the automobile exhibition hall, but this is an example and the present invention is not limited thereto.

Referring to FIG. 10A , a user may be provided with an image of an entrance of an automobile exhibition hall as an initial image. Here, the current screen is a view looking into the interior of the automobile exhibition hall from the entrance side of the automobile exhibition hall, and may include five vehicles, a reception desk, and a bookshelf. The current screen may further include a plurality of viewport icons and map information. Here, the viewport icon may refer to an icon or button that can directly call a pre-specified image, and may exist for each displayed vehicle or specific area. Also, the map information may refer to a mini-map representing areas currently provided to the automobile exhibition hall as a whole. Referring to FIG. 10A , among the two circles, a circle further including a relatively small circle in the center may mean a movable location point, and the other circle may mean a user's cursor.

FIG. 10B may be a screen showing a partial area in the image at the moved location point after clicking and moving a movable location point around the vehicle through the user interface from the screen of FIG. 10A. Referring to FIG. 10B , the current screen may include two vehicles and a bookshelf, and as the user moves, the vehicle and the bookshelf may appear closer than in FIG. 10A.

10C may be a screen showing a specific vehicle in detail by clicking an icon for a specific vehicle through a user's cursor among viewport icons present in the upper left corner of the screen. Referring to FIG. 10C , the current screen may include a view of the specific vehicle viewed from directly in front. Here, a screen displayed by clicking the viewport icon may be the same as or different from a screen provided by clicking a movable location point around a corresponding specific vehicle.

10D may be a screen showing the inside of a vehicle by clicking a movable location point located inside the vehicle. Due to this, not only the appearance of the exhibition hall and the exterior of the vehicle, but also the interior of the vehicle may be provided. Referring to FIG. 10D , the current screen shows the inside of the vehicle from the passenger seat, but a movable location point may be additionally located at the driver's seat, and by clicking on it, the inside of the vehicle from the driver's seat may be provided.

FIG. 10E may be a screen showing a partial area within an image at the moved location point after clicking a movable location point to move to the front of an elevator inside the automobile exhibition hall. Referring to FIG. 10E , the current screen may include an image of an elevator. An indication that additional information exists may appear on the side where the elevator operation button exists, and when the user's cursor is brought to the corresponding indication, additional information may appear. Here, the additional information may include a button for moving to the second floor or moving to the third floor.

FIG. 10F may be a screen showing a partial area in the image at the moved location point after moving to the third floor of the automobile exhibition hall by clicking a button for moving to the third floor according to additional information on the screen of FIG. 10E. Referring to FIG. 10F , the current screen may include a large hall and a single vehicle.

10g may be a screen showing another area within the same image by rotating through a user interface from the screen of FIG. 10f. Referring to FIG. 10G , the current screen may include an image of an elevator. An indication that additional information exists may appear on the side where the elevator operation button exists, and when the user's cursor is brought to the corresponding indication, additional information may appear. Here, the additional information may include a button for moving to the first floor or moving to the second floor.

As described above, according to an embodiment of the present invention, each floor can be organically connected like an elevator effect, and it can be provided so that an actual user can experience each floor by riding an elevator.

10H may be a screen showing a plan view showing areas provided on each floor in two dimensions. Referring to FIG. 10H , two icons may exist at the bottom of map information located at the bottom left of the screen, and a plan view of each floor may be provided by clicking the second icon from the left. Also, although not shown in FIG. 10H, a plan view of another floor may be displayed on the screen by clicking another icon. The floor plan may be provided with an indication that additional information exists. Here, when the first from the left is clicked, a screen providing a partial area within the image according to the user's field of view may be provided.

Referring to FIGS. 10A to 10H , the automobile exhibition hall implemented according to an embodiment of the present invention can provide an effect of moving in an actual exhibition hall, checking scenes at each location, and checking the inside of each vehicle. In each scene, the vehicle's financial resources may be provided together. In addition, people in the background can move for each scene or each image to reproduce and provide a lively exhibition hall.

11a to 11d are diagrams implementing a shooting studio according to an embodiment of the present invention.

A shooting studio can be effectively implemented using an embodiment of the present invention. Alternatively, it may be provided through wired or wireless communication such as the Internet. A shooting studio implemented according to an embodiment of the present invention may provide the appearance of shooting equipment, etc., and may provide data on how to use the shooting equipment as additional information related thereto, so how to use the shooting equipment or Shooting techniques can be taught effectively. Hereinafter, it will be described in detail with reference to images provided to the shooting studio, but this is an example and the present invention is not limited thereto.

Referring to FIG. 11A , a user may be provided with an image in the center of a shooting studio as an initial image. Here, the current screen is a view looking at the shooting equipment from the center of the shooting studio, and may include two sets of shooting equipment. Here, the current screen may further include map information. The map information may refer to a mini-map or the like that shows areas currently provided to the automobile exhibition hall as a whole. Referring to FIG. 11A , among the two circles, a circle further including a relatively small circle in the center may mean a movable location point, and the other circle may mean a user's cursor. A mark indicating that additional information exists may appear on the floor of the photographing equipment and the photographing studio, and when a user brings a cursor to the mark, additional information may appear. For example, as shown in FIG. 11A , when the user's cursor is brought to the central mark farthest from the current position, a video lecture on creating and deleting data may appear.

FIG. 11B may be a screen showing a partial area within the image at the moved location point after clicking and moving a movable location point around the photographing equipment through the user interface from the screen of FIG. 11A. Referring to FIG. 11B , the current screen may include one piece of photographing equipment and an image of a passage, and the image of the photographing equipment may appear closer than in FIG. 11A according to movement. A display indicating that additional information exists in the photographing equipment may appear, and when a user brings a cursor to the corresponding display, additional information may appear. Additional information here may include a description of the first-generation 3D scanner. As moving from FIG. 11A , the map information on the lower left can provide information on the current location moved within the entire provided areas.

11C may be a screen showing a three-dimensional view showing an area of a shooting studio in three dimensions. Referring to FIG. 11C , three icons may exist at the bottom of the map information located at the bottom left of the screen, and an overall three-dimensional view may be provided by clicking the second icon from the left. A stereoscopic view may be provided with an indication that additional information is present. Here, when the first from the left is clicked, a screen providing a partial area within the image according to the user's field of view may be provided.

11D may be a screen showing a plan view showing an area of a shooting studio in two dimensions. Referring to FIG. 11D , three icons may exist at the bottom of map information located at the bottom left of the screen, and a plan view may be provided by clicking the third icon from the left. The floor plan may be provided with an indication that additional information exists.

11A to 11D, since a shooting studio implemented according to an embodiment of the present invention may display additional information related to shooting equipment or a shooting location, and may provide a shooting technique based on this, The training can be conducted effectively and interestingly.

12a to 12f are diagrams illustrating the interior of a restaurant according to an embodiment of the present invention.

The inside of a restaurant can be effectively implemented using an embodiment of the present invention. Alternatively, it may be provided through wired or wireless communication such as the Internet. The interior of the restaurant implemented according to an embodiment of the present invention can provide the interior of the actual restaurant, and since each image includes not only a simple vehicle and store, but also people eating food or drinking alcohol, It can provide the overall feel of the restaurant together. Hereinafter, a detailed description will be made with reference to images provided inside the restaurant, but this is an example and the present invention is not limited thereto.

Referring to FIG. 12A , a user may be provided with an image of an entrance inside a restaurant as an initial image. Here, the current screen may include a partial area of the entrance of the restaurant and map information. Here, the map information may refer to a mini-map or the like that generally shows areas currently provided inside the restaurant. Referring to FIG. 12A , among the two circles, a circle further including a relatively small circle in the center may mean a movable location point, and the other circle may mean a user's cursor.

12B may be a screen showing another area within the same image by rotating the screen of FIG. 12A through a user interface. Referring to FIG. 12B , the current screen may include a view looking toward the inside of the restaurant from the entrance side of the interior of the restaurant, and may include a view of tables, chairs, and an inner bar area.

FIG. 12c may be a screen showing a partial area within the image at the moved location point after clicking and moving a movable location point from the screen of FIG. 12b. Referring to FIG. 12C , the current screen may include a side view of a bar inside the restaurant, and may include tables, chairs, and bars, and various alcoholic beverages displayed in the bar.

FIG. 12d may be a screen showing a partial area in the image at the moved location point after clicking and moving a movable location point from the screen of FIG. 12c. Referring to FIG. 12D, the current screen may include an image from the screen of FIG. 12C further into the bar, and accordingly, the image of tables, chairs, and the bar and various alcoholic beverages displayed in the bar may be included in more detail. can Further, FIG. 12d shows the same restaurant bar area as FIG. 12c, but different images according to different locations may be provided, and accordingly, figures of people drinking alcoholic beverages may be further included. An embodiment of the present invention provides not only a simple structure of the restaurant, but also the atmosphere or feeling of the restaurant by providing the interior of the restaurant and the appearance of people drinking alcohol for the same restaurant according to various locations and movements. can provide

12E may be a screen showing a three-dimensional view of an area provided inside the restaurant. Referring to FIG. 12E , three icons may exist at the bottom of the map information located at the bottom left of the screen, and an overall three-dimensional view may be provided by clicking the second icon from the left. A stereoscopic view may be provided with an indication that additional information is present. Here, when the first from the left is clicked, a screen providing a partial area within the image according to the user's field of view may be provided.

12F may be a screen showing a plan view showing an area provided inside the restaurant in two dimensions. Referring to FIG. 12F, three icons may exist at the bottom of map information located at the bottom left of the screen, and a plan view may be provided by clicking the third icon from the left. The floor plan may be provided with an indication that additional information exists.

Referring to FIGS. 12A to 12F , the interior of the restaurant implemented according to an embodiment of the present invention can provide an effect of checking scenes at each location while moving inside the actual restaurant, and people's behavior in each scene. This is provided differently so that the atmosphere and feeling inside the restaurant can be provided together with structural information of the restaurant. Through this, the user can directly explore the inside of the restaurant using a cursor from the entrance of the restaurant, and can provide an effect of walking around the inside of the actual restaurant.

13A to 13I are diagrams implementing a workspace according to an embodiment of the present invention.

A work space can be effectively implemented using an embodiment of the present invention. Alternatively, it may be provided through wired or wireless communication such as the Internet. According to an embodiment of the present invention, each characteristic of various work spaces can be effectively displayed and provided, and accordingly, the work space and the process in which work is performed can be effectively identified or introduced. Hereinafter, a detailed description will be made with reference to images provided as a work space, but this is an example and the present invention is not limited thereto.

Referring to FIG. 13A , a user may be provided with an image of a passage in a work space as an initial image. Here, the work space can be a hanok with a yard or a renovated house. The current screen may include a view of the road to the yard, and may include various viewport icons and map information. Here, the viewport icon may refer to an icon or button capable of directly calling a pre-specified image, and the map information may refer to a mini-map showing areas where a current crime scene is provided as a whole. Referring to FIG. 13A , among the two circles, a circle further including a relatively small circle in the center may mean a movable location point, and the other circle may mean a user's cursor.

FIG. 13B may be a screen showing a partial area in the image at the moved location point after clicking and moving a movable location point from the screen of FIG. 13A. Referring to FIG. 13B , the current screen may include the same view of a passage as in FIG. 13A , but may include a picture closer to the yard as it moves. In addition, although the image is shown in the same direction as that of FIG. 13A, the image of an animal that does not exist in FIG. 13A may be further included. That is, since FIGS. 13A and 13B use different images for the same area, different information can be provided.

FIG. 13C may be a screen showing a partial area in the image at the moved location point after clicking and moving a movable location point from the screen of FIG. 13B. Referring to FIG. 13C , the current screen may include an image of a yard emerging from one aisle in FIG. 13B and may include an image of animals located in one aisle in FIG. 13B following along and being located in the yard. This provides a dynamic feeling by using different images depending on the location, and can provide an effect as if an animal moves together with the user. Also, on the current screen, an indication indicating that additional information exists inside the building may appear, and when the user brings the cursor to the corresponding indication, additional information may appear. Here, the additional information may include an introductory video about a company or a user using the corresponding workspace.

FIG. 13D may be a screen showing a partial area within the image at the moved location point after clicking and moving a movable location point from the screen of FIG. 13C. Referring to FIG. 13D , the current screen may move from the yard of FIG. 13C to the inside of the building and include an image of an inner working space, and thus may further include images of people performing tasks. These people are not shown in FIG. 13c, but this effect can be given by using different images in FIGS. 13c and 13d. In addition, a display indicating that additional information exists on the work table, camera, floor, etc. may appear, and when the user's cursor is brought to the corresponding display, additional information may appear. Here, the additional information may include information describing the company's item.

13E may be a screen showing another area within the same image by rotating the screen of FIG. 13D through a user interface. Referring to FIG. 13E, the current screen may include a partial view of the inner space shown in FIG. 13D, a view of a further inner space, and a view of the yard from the inside, indicating that additional information exists for each object, etc. may appear.

13F may be a screen showing a three-dimensional view of a region provided as a work space in a three-dimensional manner. Referring to FIG. 13F , four icons may exist at the bottom of the map information located at the bottom left of the screen, and an overall three-dimensional view may be provided by clicking the second icon from the left. A stereoscopic view may be provided with an indication that additional information is present. Here, when the first from the left is clicked, a screen providing a partial area within the image according to the user's field of view may be provided.

13G may be a screen showing a plan view showing an area provided as a work space in two dimensions. Referring to FIG. 13G , there may be four icons at the bottom of the map information located at the bottom left of the screen, and a plan view of each floor may be provided by clicking the third from the left. You can also click the 4th from the left or the 1st from the right to display the floor plan of another floor. The floor plan may be provided with an indication that additional information exists.

Referring to FIGS. 13A to 13G , the workspace implemented according to an embodiment of the present invention can effectively represent each characteristic of various spaces, and when various teams exist, the space and team mainly used by each team can be provided together with an introduction to, and accordingly, the work space and the process in which work is performed can be effectively identified or introduced.

According to an embodiment of the present invention, virtual furniture may be placed and checked in an indoor space through the above-described operation, and a virtual gallery or exhibition may be provided by inserting a specific picture or a specific object as additional information. In addition, an embodiment of the present invention may reproduce and provide an incident scene based on a specific space and materials for a major incident. In addition, an embodiment may provide efficient and interesting education to the user by inserting information about educational materials into a specific space. In addition, in one embodiment, an advertisement may be inserted as additional information on an image through collaboration with an advertiser, and may be utilized in various ways.

Operations according to embodiments of the present invention can be implemented as computer-readable programs or codes on a computer-readable recording medium. A computer-readable recording medium includes all types of recording devices in which data that can be read by a computer system is stored. In addition, computer-readable recording media may be distributed to computer systems connected through a network to store and execute computer-readable programs or codes in a distributed manner.

In addition, the computer-readable recording medium may include hardware devices specially configured to store and execute program instructions, such as ROM, RAM, and flash memory. The program command may include high-level language codes that can be executed by a computer using an interpreter or the like as well as machine code generated by a compiler.

Although some aspects of the present invention have been described in the context of an apparatus, it may also represent a description according to a corresponding method, where a block or apparatus corresponds to a method step or feature of a method step. Similarly, aspects described in the context of a method may also be represented by a corresponding block or item or a corresponding feature of a device. Some or all of the method steps may be performed by (or using) a hardware device such as, for example, a microprocessor, programmable computer, or electronic circuitry. In some embodiments, one or more of the most important method steps may be performed by such an apparatus.

In embodiments, a programmable logic device (eg, a field programmable gate array) may be used to perform some or all of the functions of the methods described herein. In embodiments, a field programmable gate array may operate in conjunction with a microprocessor to perform one of the methods described herein. Generally, methods are preferably performed by some hardware device.

Although the above has been described with reference to preferred embodiments of the present invention, those skilled in the art will variously modify and change the present invention within the scope not departing from the spirit and scope of the present invention described in the claims below. You will understand that it can be done.

Claims (1)

An image processing method for providing an image for a specific space,
obtaining input information from a user;
determining another image among a set of images for the specific space based on the input information and a current image provided to the user; and
Providing the determined other image to the user;
At least one image in the image set includes object information and information indicating an object into which the object information is inserted.