KR20180093293A - Virtual reality smart video services technology using smart phone - Google Patents

Abstract

Disclosed is a virtual reality smart video service technique using a smartphone. The virtual reality smart video service technique using a smartphone comprises: requesting content list information and displaying a received result on a screen; moving to a content detail view screen; requesting downloading and displaying the received content information on a screen; displaying additional information on a screen; moving to a content upload screen; requesting uploading; moving to a camera preview screen; inputting necessary information; displaying a pop-up; moving to a viewer with photo information; and requesting deletion.

Description

TECHNICAL FIELD [0001] The present invention relates to a virtual reality service,

1. Overview

1.1 Purpose

This document describes the detailed system design of the task of "Virtual Reality Smart Video Service Technology using Smartphone." The contents of the detailed design were based on the previously defined requirements definition, functional specification and structure design.

1 is a configuration diagram of a location mapping smart image content generation and service system.

1.2 Range

This document describes the detailed design of the virtual reality smart image service technology using the smartphone, and more specifically the description of each component or package, class and sequence.

1.3 References

'Virtual Reality Smart Image Service Technology using Smartphone' R & D Plan, 2016.04

'Virtual Reality Smart Video Service Technology using Smartphone' Requirements Statement, 2016.08

'Functional Specification of Virtual Reality Smart Image Service Technology using Smartphone', 2015.08

'Structural Design of Virtual Reality Smart Video Service Technology Using Smartphone', 2015.09

1.4 Terms and Abbreviations

Analysis and Mapping: A technique of arranging a photographing space of an image with the position information (latitude / longitude / altitude) and direction of the image collecting device, a tilt value, etc. and arranging the image in a real world through a smart device or a web

Ontology : A knowledge structure of a specific domain is classified into an object, a class representing a set of objects, a data value representing a property of an object, a data type, a data model expressed using a data property representing the relationship between the object and the data value,

OWL ontology : An ontology implementation modeling a knowledge structure of a specific domain according to an ontology data model and expressing / storing it using OWL

Ontology knowledge base : A database that stores the ontology created according to the information structure of the applicable domain as a knowledge model, that is, the logical object representation of actual object information constructed with the schema

Ontology inference rules : Rules that derive implicit knowledge from explicit knowledge explicitly expressed in ontology and ontology knowledge base

Query graph : A partial graph corresponding to the meaning of the user query in the knowledge (knowledge graph) expressed in a graph form in the knowledge base

Domain knowledge structure Statistical and structural features of knowledge objects expressed in knowledge base. For example, an entity representing a relationship of 'eat' is frequently associated with an instance object of a class entity representing 'food', and thus has adjacent statistical and structural characteristics on the knowledge graph

Knowledge of content association : Knowledge objects related to specific contents among the knowledge expressed in the knowledge base and their structure knowledge

Feature extraction The process of extracting features from an image. Using feature extraction techniques such as SIFT, SURF, FAST, and ORB

Feature Matching : The process of defining the correlation between similar features by measuring the similarity between features extracted from two or more different images

Meta tag : Describing a keyword (Tag) assigned to metadata as metadata. It means to input simple character type information to medium which is difficult to record by letter like music and picture

Epipolar : A straight line connecting two cameras projecting the position of the image taken at the same point (point of interest). If the coordinates of the point of interest are unknown, estimate the coordinates using epipolar lines.

Building Information Modeling (BIM) : This is a function that can visually express the shape of the building, appearance, wiring, etc., or to check the cross-section, and visually provide various contents that are difficult to confirm from the existing blue screen. Currently, it is also used for building information management.

GIS (Geographic Information System) : Hardware, software, human resources, and geographic information on a computer designed to effectively collect, store, update, coordinate, analyze and represent all types of geospatially referential information.

CAD (Computer-Aided Design) : A word collectively referring to computer-based tools that support the design of engineering and architecture, including specific hardware and software. Currently, it is also used as a synonym for CAAD (Computer-Aided Architectural Design) which means Drawing (Technical Drawing).

Watermarking : Technology that hides the copyright information of the copyright holder in a way that the content can not be recognized

Copyright : Creator's right granted to the content

Co-authorship : Content with multiple creators of the content

Combined Asset : Content that can be broken down by creator in a collaborative work

Micro licensing : Technology that supports small C2C licenses rather than large-scale licenses such as B2B or B2C

Robustness: Resistant to attacks for removal of watermarks

CRUD : The term used to describe the basic data processing functions of most computer software, including Create, Read, Update, and Delete.

1.5 Identity System

The criteria for assigning ID identifiers used in this design are as follows.

ID Identifier: Subsystem-CLS-Serial Number

Subsystem CN Content authoring / collection client

MP Location / Attitude Analysis / Mapping Engine

SM Semantic Search Engine

RD Road view / 2D map-based visualization viewer

AR Augmented Reality-based Visualization Viewer

WM Watermarking Library

Serial Number 000 A number from 001 to 999,

Means number

An example of the above ID identifier is as follows.

(Example) CN-CLS-001: First SW class belonging to content authoring / collection client

1 Location Mapping Smart image content creation and service system configuration diagram
2 component diagram
Figure 3 Class Diagram All Class - Android
Figure 4 Class diagram All classes - iOS
Figure 5 Class details (relationship diagram) - Android
Figure 6 Class details (relationship diagram) - iOS
Figure 7 Class details (relationship diagram) - Android
Figure 8 Class Detail Diagram (Relationship Diagram) - iOS
Figure 9 Class details (relationship diagram) - Android
Figure 10 Class Detail Diagram (Relationship Diagram) - iOS
Figure 11 Class details (relationship diagram) - Android
Figure 12 Class Detail Diagram (Relationship Diagram) - iOS
Fig. 13 Class Detail Diagram
Figure 14 Component diagram
Figure 15 Class All - GearVR
Figure 16 Class Detail Diagram (Relationship Diagram)
17 Class Detail Diagram (Relationship Diagram)
Figure 18 Component diagram
Figure 19 Class diagram
Fig. 20 Class Detail Diagram (Relationship Diagram)
Figure 21 Class Detail Diagram (Relation Diagram)
Figure 22 Class Detail Diagram (Relation Diagram)
Figure 23 Class Detail Diagram (Relation Diagram)
Fig. 24 Class Detail Diagram (Relation Diagram)
Figure 25 Class Detail Diagram (Relation Diagram)
Figure 26 Class Detail Diagram (Relation Diagram)
Figure 27 Class Detail Diagram (Relation Diagram)
Figure 28 Component diagram
Figure 29 Class diagram
Figure 30 Class Detailed Diagram (Relationship Diagram)
Figure 31 Class Detail Diagram (Relation Diagram)
32 Class Detailed Diagram (Relationship Diagram)

2. Content authoring / collection client

This chapter designs the component specification of a content authoring / gathering client.

Figure 2 is a component diagram.

FIG. All in class - Android.

FIG. All in class - iOS.

2.3 Class Definitions

2.3.1 Content Management

Class List - Android

CN-CLS-001 ContentManager class A utility class that provides the functionality needed to save and load photo / movie files.

CN-CLS-002 CameraCaptureUtils class Utility class to set basic information when saving photo / movie files

CN-CLS-003 ExifInterfaceUtils class Utility class for entering EXIF information when saving photo / movie files

CN-CLS-004 CameraPreview class A screen class that provides camera image preview function and provides the function to save corresponding image as photo / video file

CN-CLS-005 ContentDetailView class A screen class that provides detailed view of photo / movie file, delete photo, detailed view of additional information, and link to external visualization linked library

CN-CLS-006 ContentInfoView class Screen class that provides the function to check and modify additional information of photo / video file

CN-CLS-007 ContentListView class A screen class that displays a list of photo / video files and provides functions for deleting pictures, taking pictures, and uploading pictures

CN-CLS-008 ContentUploadView class Screen class that provides photo / video file upload function, select photo to upload, and input additional information

Class List - iOS

CN-CLS-101 CameraViewController class Classes for previewing cameras and inputting video information

CN-CLS-102 ContentManager class A class that performs the function of saving the image viewed through the camera preview function as a file or deleting the photo / video file of the path entered by the user

CN-CLS-103 ContentListViewController class A class for displaying pictures / videos stored locally and a list of photos / videos retrieved from the server

CN-CLS-104 DetailContentInfoViewController class Provides a function to preview additional information of a photo / movie file, and provides a function that allows the user to input additional information into a picture or modify / delete the entered information

CN-CLS-105 Content class A class that stores information about photo / movie files

CN-CLS-106 ExifInfoManager class Class to manage additional information of photo / video file

CN-CLS-107 Appdelegate class A class that handles your app's process-related events.

Figure 5 Class details (relationship diagram) - Android

Figure 6 Class details (relationship diagram) - iOS

Sequence diagram

One) When the content list screen is started, the content list information is requested through the server request class and the received result is displayed on the screen.

2) When the content item is selected from the content list screen, it moves to the content detail view screen.

3) If there is no content file downloaded locally in the content details view screen, the download request is requested through the server request class and the received content information is displayed on the screen.

4) When the content additional information detail view button is touched on the content detail view screen, the content additional information detail view screen is displayed and additional information is displayed on the screen.

5) When the content upload button is touched, it moves to the content upload screen.

6) After inputting the content information and additional information to be uploaded on the content uploading screen, touch the upload button to request upload through the server request class.

7) When a watermark button is touched on the content upload screen, a copyright watermark is input to the current content information.

8) When the content shooting button is touched, it moves to the camera preview screen.

9) When the shooting button is touched on the camera preview screen, save the screen image to a file and input necessary information using CameraCaptureUtils and ExifInterfaceUtils.

10) If you touch the visualization button on the content detail view screen, a popup that allows you to select the visualization type is displayed.

11) If you select one of the 2D viewer, 3D viewer, 360 viewer, load view viewer, and AR viewer in the visualization selection popup, it moves to the corresponding viewer via the ExternalLibManager.

12) When the delete content button is touched, it requests deletion through the server request class.

2.3.2 Server connection

Class List - Android

CN-CLS-009 IParser Interface A parser interface class for parsing WebService request results provided by the content storage / management engine.

CN-CLS-010 IResponse interface The WebService request result parsing information interface class provided by the content storage / management engine

CN-CLS-011 AbsParser class Parser abstract class for parsing WebService request results provided by the content storage / management engine

CN-CLS-012 AbsResponse class WebService request result parsing information provided by the content storage / management engine Abstract class

CN-CLS-013 Content class Photo / Movie Information Information Object Class

CN-CLS-014 ContentDeleteParser class Results of photo / video deletion request Parser class

CN-CLS-015 ContentListParser class Picture / video list request result parser class

CN-CLS-016 ContentUploadParser class Photo / Video upload request result parser class

CN-CLS-017 ContentDownloader class Photo / Video download request handling class

CN-CLS-018 ContentDeleteResponse class Photo / Video removal request result class

CN-CLS-019 ContentListResponse class Photo / video list request result class

CN-CLS-020 ContentUploadResponse class Photo / Video upload request result class

CN-CLS-021 ServerNetworkManager class The WebService request utility class provided by the content storage / management engine

Class List - iOS

CN-CLS-108 IResponse interface The WebService interface provided by the content storage / management engine

CN-CLS-109 AbsResponse class An abstraction class that handles responses received from the server.

CN-CLS-110 ContentDeleteResponse class A class that handles responses to photo / video deletions received from the server

CN-CLS-111 ContentDownloader class Classes for handling photos / videos received from the server

CN-CLS-112 ContentUploadResponse class A class that handles responses to photo / video uploads received from the server.

CN-CLS-113 ContentListResponse class A class that handles responses to a list of photos / videos received from the server.

CN-CLS-118 ServerNetworkManager class The WebService request utility class provided by the content storage / management engine

Fig. 7 shows the details of the class (relationship diagram) - Android.

8 is a class detail diagram (relationship diagram) - iOS.

Sequence diagram

One) When the content list screen starts, it requests content list information through the server request class and parses the corresponding request result through ContentListParser.

2) When the content upload button is touched, it moves to the content upload screen.

3) After inputting the content information and additional information to be uploaded on the content upload screen, touch the upload button to request upload of the content information through the server request class, and parse the request result through the ContentUploadParser.

4) When the content delete button is touched, it requests content deletion through the server request class and parses the result of the request through ContentDeleteParser.

5) When the content item is selected from the content list screen, it moves to the content detail view screen.

6) If there is no content file downloaded locally in the content details view screen, the content download request is requested through the server request class and the content file download is performed through ContentDownloader.

2.3.3 Sensor information collection

Class List - Android

CN-CLS-022 ClientSensorManager class Utility class providing direction sensor and GPS sensor information collection function

CN-CLS-023 LocationListener interface GPS sensor information interface class

CN-CLS-024 SensorEventListener interface Direction sensor information interface class

Class List - iOS

CN-CLS-114 SensorInfoManager class Classes to manage direction sensors and GPS sensor information collection

CN-CLS-115 CoreLocation class A framework that provides the ability to collect direction sensor information

CN-CLS-116 CoreMotion class A framework that provides the ability to collect GPS sensor information

Fig. 9 shows the details of the class (relationship diagram) - Android.

10 is a class detail diagram (relation diagram) - iOS.

Sequence diagram

One) When the user touches the content shooting button on the content list screen, the user goes to the camera preview screen

2) When the camera preview screen is displayed, an instance of the content management class is created internally

3) When a content management instance is created, a GPS sensor listener object and a direction sensor listener object are registered in the sensor management class

4) Once the GPS sensor listener and direction sensor listener are registered, execute the method to get the GPS and direction sensor values

2.3.4 Linking External Library

Class List - Android

CN-CLS-025 ExternalLibManager class A utility class that provides copyright information watermark display, link to 2D map viewer, link to road view map viewer, AR viewer link, 360 view viewer connection, 3D map viewer link to photographed photo file

Class List - iOS

CN-CLS-117 ExternalLinkManager class A utility class that provides copyright information watermark display, link to 2D map viewer, link to road view map viewer, AR viewer link, 360 view viewer connection, 3D map viewer link to photographed photo file

Fig. 11 shows the class detail diagram (relation diagram) - Android.

12 shows the class details (relationship diagram) - iOS.

Sequence diagram

One) Go to content detail screen through contents list screen

2) Select visualization type (2D / 3D / Load view / AR / 360 viewer)

3) If 2D map visualization is selected, content information is transferred to 2D map viewer through ExternalLibManager

4) Select 3D map visualization to deliver content information to 3D map viewer via ExternalLibManager

5) If you select the load view visualization, the contents information is transferred to the view viewer through ExternalLibManager

6) If AR visualization is selected, contents information is transferred to AR viewer through ExternalLibManager

7) Selecting 360 viewer visualization will transfer content information to 360 viewer via ExternalLibManager

8) Go to content upload screen through content list screen

9) Touch the watermark button to link the content information with the watermark generation library through ExternalLibManager

2.3.5 Production of video production On-site web authoring

List of classes

CN-CLS-201 ContentManagementController Class Controller class to provide content query, modify, and delete functions

CN-CLS-202 ContentManagerService Interface Service interface for content inquiry, modification and deletion

CN-CLS-203 ContentManagerServiceImpl Class Implementation class for content query, modify, and delete functions

CN-CLS-204 ContentMgrDAO Class Classes for accessing and working with DBs for content information query, modification, and deletion

CN-CLS-205 ContentMgrVO Class VO class for content information

CN-CLS-206 ContentMgr Class Model class for content information

Fig. 13 is a detailed view of the class

Sequence diagram

One) Invokes Controller's showContentInfoList to retrieve the uploaded content list.

2) showContentInfoList calls content list query method of ContentManagerServiceImpl which is implementation class of ContentManagerService.

3) Access the DB to obtain a list of contents and use them to display on the screen.

4) In the content list, the user calls the controller's showContentInfo to inquire the details of the content.

5) showContentInfo calls selectContentInfo which is the content detail information inquiry method of ContentManagerServiceImpl which is the implementation class of ContentManagerService.

6) Access the DB to obtain detailed information on the content, and display it on the screen.

7) To upload the content, call addContentInfo of the controller to select the content file to be registered, and input additional information about the content.

8) addContentInfo calls insertContentInfo, the content addition method of ContentManagerServiceImpl, the implementation class of ContentManagerService.

9) It stores contents file and information entered by DB in DB.

10) The user calls the editContentInfo method to modify the file and additional information of the selected content.

11) editContentInfo calls updateContentInfo, the content modification method of ContentManagerServiceImpl, which is the implementation class of ContentManagerService.

12) The content file and information entered by the user are input to the DB and updated.

13) Call Controller removeContentInfo to delete user selected content.

14) removeContentInfo calls deleteContentInfo, which is the content delete method of ContentManagerServiceImpl, which is the implementation class of ContentManagerService.

15) Access the DB and delete the corresponding content.

3. Mobile Virtual Reality (VR) Viewer

This chapter designs the component specification of the mobile virtual reality (VR) viewer.

3.1 Component Diagram

14 is a component diagram.

3.2 Class Diagram

15 shows the class-wide GearVR.

3.3 Class Definition

3.3.1 360 Viewer

List of classes

CN-CLS-26 ContentManager class A utility class that provides the functionality needed to save and load photo / movie files.

CN-CLS-27 CameraCaptureUtils class Utility class to set basic information when saving photo / movie files

CN-CLS-28 ExifInterfaceUtils class Utility class for entering EXIF information when saving photo / movie files

16 shows the class detail diagram (relationship diagram).

Sequence diagram

One) When GearVR starts, it requests content list information through the server request class and displays the received result on the screen.

2) When the content item is selected from the content list screen, it moves to the content detail view screen.

3) If there is no content file downloaded locally in the content details view screen, the download request is requested through the server request class and the received content information is displayed on the screen.

4) If the content is a photo, it will be displayed directly on the content details view screen. If it is a video, playback will start when the start button is touched.

3.3.2 Server connection

List of classes

CN-CLS-29 IParser Interface A parser interface class for parsing WebService request results provided by the content storage / management engine.

CN-CLS-30 IResponse interface The WebService request result parsing information interface class provided by the content storage / management engine

CN-CLS-31 AbsParser class Parser abstract class for parsing WebService request results provided by the content storage / management engine

CN-CLS-32 AbsResponse class WebService request result parsing information provided by the content storage / management engine Abstract class

CN-CLS-33 Content class Photo / Movie Information Information Object Class

CN-CLS-34 ContentListParser class Picture / video list request result parser class

CN-CLS-35 ContentListResponse class Photo / video list request result class

CN-CLS-36 ContentDownloader class Photo / Video download request handling class

CN-CLS-37 ServerNetworkManager class The WebService request utility class provided by the content storage / management engine

17 is a class detail diagram (relationship diagram).

Sequence diagram

One) When GearVR is started, it requests content list information through the server request class and parses the result of the request through ContentListParser.

2) When the content item is selected from the content list screen, it moves to the content detail view screen.

3) If there is no content file downloaded locally in the content details view screen, the content download request is requested through the server request class and the content file download is performed through ContentDownloader.

6. Road view / 2D map-based visualization viewer

This chapter designs the component specification of the visual view viewer based on the road view / 2D map.

18 is a component diagram.

19 is a class diagram.

6.3 Class Definitions

6.3.1 Creating the Road View Panorama Viewer

List of classes

RD-CLS-001 LoadRoadview Class A class that takes a picture to the user and shows the load view of a similar place using the image's metadata

RD-CLS-008 ImageAnalysis Class A class that analyzes images such as feature point extraction, comparison, calibration, and metadata extraction

RD-CLS-009 RoadviewImage Class Class to store and retrieve information about load view images

RD-CLS-010 ContentImage Class Class to store and retrieve information about the content video

20 is a class detail diagram (relationship diagram).

Sequence diagram

One) The user selects one of the searched content images

2) Analyze metadata of content video

3) Content video storage

4) Storing the coordinates of the content video

5) Obtain a load view image in the vicinity of the analyzed GPS coordinates of the metadata

6) Create panoramic image with acquired images

7) Save load view image

8) Save Load View Coordinates

9) Provide Viewer

6.3.2 Creating a 2D map

List of classes

RD-CLS-001 LoadRoadview Class A class that takes a picture to the user and shows the load view of a similar place using the image's metadata

RD-CLS-008 ImageAnalysis Class A class that analyzes images such as feature point extraction, comparison, calibration, and metadata extraction

RD-CLS-010 ContentImage Class A class that stores and invokes information from a user-selected content image.

RD-CLS-002 2DMapService Class Classes for creating and servicing 2D maps using GPS information of image metadata input by the user

RD-CLS-006 2DMapInformation Class A class that provides the direction, location, etc. that you are currently viewing on a 2D map.

21 is a class detail diagram (relationship diagram).

Sequence diagram

One) The user selects one of the searched content images

2) Analyze metadata of content video

3) Content video storage

4) Storing the coordinates of the content video

5) Obtain 2D map near GPS coordinates of analyzed metadata

6) Save coordinates of acquired 2D map

7) Provide 2D map viewer

6.3.3 Load View Control

List of classes

RD-CLS-001 LoadRoadview Class A class that takes a picture to the user and shows the load view of a similar place using the image's metadata

RD-CLS-003 RoadviewController Class Class to set and control the load view controls such as zoom in / out, load viewer rotation

22 is a class detail diagram (relationship diagram).

Sequence diagram

- Load view zoom level setting -

1) Pinch open / close event detection in load viewer

2) Set the load view zoom level

- Rotate the load view -

1) Drag event detection in load viewer

2) Set rotation of X, Y, Z axis of load view

6.3.4 Load View Additional Information

Class ID Class name type Explanation

RD-CLS-001 LoadRoadview Class A class that takes a picture to the user and shows the load view of a similar place using the image's metadata

RD-CLS-004 RoadviewInformation Class A class that contains the location of the currently viewed load view, near famous places, weather, etc.

23 is a class detail diagram (relationship diagram).

Sequence diagram

1) Click the info icon button on the bottom right of the App

2) Acquire the information of the nearby additional places by taking the load view coordinates as parameters

6.3.5 2D Control

List of classes

RD-CLS-001 LoadRoadview Class A class that takes a picture to the user and shows the load view of a similar place using the image's metadata

RD-CLS-002 2DMapService Class Classes for creating and servicing 2D maps using GPS information of image metadata input by the user

RD-CLS-004 2DMapInformation Class A class that provides the direction, location, etc. that you are currently viewing on a 2D map.

RD-CLS-005 2DMapController Class A class that sets and controls controls such as zooming in / out, moving, etc.

24 is a class detail diagram (relationship diagram).

Sequence diagram

- 2D map zoom level setting -

1) Pinch open / close event detection in 2D map

2) Set the zoom level of the 2D map

- 2D map movement settings -

1) Detect drag events on 2D maps

2) Coordinate movement of 2D map

- Marker rotation setting -

1) Detect rotation events in load view

2) Passing events to 2D map objects

3) Rotate 2D map marker

6.3.6 2D map additional information

List of classes

RD-CLS-002 2DMapService Class Classes for creating and servicing 2D maps using GPS information of image metadata input by the user

RD-CLS-004 2DMapInformation Class A class that provides the direction, location, etc. that you are currently viewing on a 2D map.

25 is a class detail diagram (relationship diagram).

Sequence diagram

1) Set and fetch the nearest 2D map X and Y coordinates using the coordinates of the image input by the user.

2) Acquire an integer value based on the north (0) in which direction you are looking through the marker on the 2D map.

6.3.7 Search for a place

List of classes

RD-CLS-001 LoadRoadview Class A class that takes a picture to the user and shows the load view of a similar place using the image's metadata

RD-CLS-007 SearchPlace Class Classes that work with the viewer provided by the Semantic Search Engine

26 is a class detail diagram (relationship diagram).

Sequence diagram

1) Click the Search button at the bottom of the Load Viewer

2) Calling the class that is linked with the semantic search engine

3) Calling the viewer provided by the search engine

6.3.8 Image registration

List of classes

RD-CLS-001 LoadRoadview Class A class that takes a picture to the user and shows the load view of a similar place using the image's metadata

RD-CLS-002 ImageAnalysis Class Classes that work with the viewer provided by the Semantic Search Engine

RD-CLS-003 ContentImage Class Class to store and retrieve information about the content video

RD-CLS-009 RoadviewImage Class Class to store and retrieve information about the load view image

RD-CLS-11 RoadviewIntrinsicParameters Class Class that stores and imports camera internal parameters of the load view image

RD-CLS-12 RoadviewExtrinsicParameters Class Class that stores and imports camera external parameters of the load view image

RD-CLS-13 ContentImageIntrinsicParameters Class A class that stores and imports camera internal parameters of the content video

RD-CLS-14 ContentImageExtrinsicParameters Class Class that stores and imports camera external parameters of the content video

RD-CLS-15 ImageRegistration Class Class that matches content image and load view image

Fig. 27 is a class detail diagram (relationship diagram).

Sequence diagram

1) Get the internal parameters and external parameters of the load view image

2) Correct the load view image using internal parameters and external parameters

3) Obtain internal and external parameters of the content image.

4) Correct the content image using internal parameters and external parameters.

5) Extract the feature points of the load view image and the content image.

6) Match each extracted minutia data.

7) The content image is matched to the similar position on the load view by using the parameter information and the feature point matching data contained in the image.

9. Watermarking Library

This chapter designs the component specification of image watermarking.

28 is a component diagram.

29 is a class diagram.

9.3 Class Definitions

9.3.1 Inserting a watermark

List of classes

WM-CLS-001 WatermarkEmbedManagementInterface interface Interface for inserting watermark information into the original image

WM-CLS-002 WatermarkEmbedManagement class A class that inserts watermark information into the original image

30 is a class detail diagram (relationship diagram).

Sequence diagram

One) Receive an image to insert a watermark

2) Check if watermark is already inserted in this image

3) Determine whether a watermark is extracted from this image

4) If this image does not contain a watermark,

9.3.2 Preventing duplicate watermarks

List of classes

WM-CLS-003 WatermarkRepeatEmbedCheckInterface interface Interface to check if the image contains a watermark before inserting the watermark

WM-CLS-004 WatermarkRepeatEmbedCheck class A class that checks whether an image contains a watermark before inserting it.

31 is a class detail diagram (relationship diagram).

Sequence diagram

One) Receive an image to insert a watermark

2) Check if watermark is already inserted in this image

3) Determine whether a watermark is extracted from this image

9.3.3 Watermark Extraction

List of classes

WM-CLS-005 WatermarkExtractManagementInterface interface An interface for extracting watermarks from watermark embedded images

WM-CLS-006 WatermarkExtractManagement class A class that extracts a watermark from an embedded watermark image

32 is a class detail diagram (relationship diagram).

Sequence diagram

1) Receive an image to extract a watermark

2) extract the watermark from this image

Claims (5)

As a virtual reality smart image service technology using a smart phone,
Requesting content list information through a server request class and displaying a received result on a screen when a content list screen is started;
Moving to a content detail view screen when a content item is selected from a content list screen;
Requesting a download through a server request class and displaying the received content information on a screen when the content file is downloaded locally in the content details view screen;
When the content additional information detail view button is touched on the content detail view screen, the content additional information detail view screen is displayed and additional information is displayed on the screen;
Moving to a content upload screen when the content upload button is touched;
Requesting upload through a server request class by touching an upload button after inputting content information and additional information to be uploaded on a content upload screen;
Inputting a copyright watermark display on the current content information by touching the watermark button on the content upload screen;
Moving to the camera preview screen when the content shooting button is touched;
When the photographing button is touched on the camera preview screen, storing the screen displayed on the screen as a file and inputting necessary information using CameraCaptureUtils and ExifInterfaceUtils;
Displaying a pop-up for selecting a visualization type when a visualization button is touched on the content detail view screen;
Moving with the photo information to the viewer through the ExternalLibManager when selecting from among the 2D viewer, 3D viewer, 360 viewer, load view viewer, and AR viewer in the visualization selection popup; And
When the content delete button is touched, a step of requesting deletion through the server request class
Virtual reality service using smart phone. As a virtual reality smart image service technology using a smart phone,
Requesting content list information through the server request class and parsing the request result through ContentListParser when the content list screen is started;
Moving to a content upload screen when the content upload button is touched;
Inputting content information and additional information to be uploaded on a content upload screen, and then touching an upload button, requesting upload of content information through a server request class and parsing the request result through ContentUploadParser;
Requesting deletion of content through the server request class and parsing the request result through ContentDeleteParser when the content deletion button is touched;
Moving to a content detail view screen when a content item is selected from a content list screen; And
If there is no content file downloaded locally in the content details view screen, the content download request is requested through the server request class and the content file download is performed through ContentDownloader
Virtual reality service using smart phone. As a virtual reality smart image service technology using a smart phone,
Moving to a camera preview screen when the user touches the content shooting button on the content list screen;
Generating an instance of the content management class internally when the camera preview screen is displayed;
Registering a GPS sensor listener object and a direction sensor listener object in a sensor management class when a content management instance is created; And
When the GPS sensor listener and the direction sensor listener are registered, executing the method to receive the GPS and direction sensor values
Virtual reality service using smart phone. As a virtual reality smart image service technology using a smart phone,
Moving to a content detail screen through a content list screen;
Selecting a visualization type to be linked through a visualization link button on a content detail screen;
If 2D map visualization is selected, delivering the content information to the 2D map viewer through the ExternalLibManager;
If 3D map visualization is selected, delivering the content information to the 3D map viewer through the ExternalLibManager;
Selecting the load view visualization, and transmitting the content information to the load view viewer through the ExternalLibManager;
Selecting AR visualization, delivering the content information to the AR viewer through the ExternalLibManager;
Selecting 360 viewer visualization, delivering content information to 360 viewer via ExternalLibManager;
Moving to a content upload screen through a content list screen; And
Touching the watermark button and linking the content information with the watermark generation library through ExternalLibManager
Virtual reality service using smart phone. As a virtual reality smart image service technology using a smart phone,
Calling the controller's showContentInfoList to retrieve the uploaded content list;
showContentInfoList is a step of calling a content list inquiry method of ContentManagerServiceImpl which is an implementation class of ContentManagerService;
Accessing a DB to obtain a list of contents and displaying the list on a screen using the list;
Calling a showContentInfo of the controller to inquire detailed information of the contents in the contents list;
showContentInfo is a step of calling selectContentInfo which is a content detailed information inquiry method of ContentManagerServiceImpl which is an implementation class of ContentManagerService;
Accessing the DB to obtain detailed information of the content and using the information to display on the screen;
Selecting a content file to be registered by calling addContentInfo of the controller to upload the content, and inputting additional information about the content;
addContentInfo is a step of calling insertContentInfo which is a content addition method of ContentManagerServiceImpl which is an implementation class of ContentManagerService;
Storing a content file and information input by the user in the DB;
The user may call the editContentInfo method to modify the file and the additional information of the selected content;
editContentInfo is a step of calling updateContentInfo which is a content modification method of ContentManagerServiceImpl which is an implementation class of ContentManagerService;
Inputting a content file and information input by a user into the DB and updating the content file;
Calling removeContentInfo of the Controller to delete the content selected by the user;
removeContentInfo calls the content delete method deleteContentInfo of ContentManagerServiceImpl which is the implementation class of ContentManagerService; And
Accessing the DB and deleting the corresponding content
Virtual reality service using smart phone.

Images