KR20230027383A - Server, method and user device for providing virtual aquarium service of aquatic animals catched by fishing activity - Google Patents

Abstract

The present invention relates to a server, method, and user terminal for providing a virtual aquarium service of aquatic animals caught by fishing activities. The server for providing a virtual aquarium service of aquatic animals caught by fishing activities comprises: a model learning unit learning a fish identification model using learning data including pre-saved aquatic animal images and label information; a reception unit receiving the aquatic animal images from a user terminal; a fish identification unit identifying fish of the aquatic animals form the aquatic animal images received by using the fish identification model; a virtual aquatic animal generation unit generating a virtual aquatic animal by modeling the exterior of the aquatic animals based on the fish of the aquatic animals and the aquatic animal images; and a virtual aquarium service provision unit realizing the swimming of the virtual aquatic animal by applying an aquatic animal movement algorithm for the generated virtual aquatic animal, and providing the user terminal with a virtual aquarium service for allowing a user to view the virtual aquatic animal whose swimming is realized through a virtual aquarium.

Description

Server, method and user terminal providing virtual aquarium service for aquatic organisms captured through fishing activities

The present invention relates to a server, method, and user terminal for providing a virtual aquarium service for aquatic organisms captured through fishing activities.

A smart phone is a mobile device developed so that some of the tasks that can be performed on a computer can be performed on a mobile phone. People always carry their smartphones with them to browse the Internet, send and receive e-mails, and shoot and edit videos or photos. In addition, smartphone users may exchange contents such as videos, music, and photos with each other.

Recently, users have been able to receive services related to various hobbies by using smart phone applications. Regarding services related to these hobbies, Korean Patent Registration No. 10-1825742, which is a prior art, discloses a method of providing fishing content information using the Internet and a communication terminal.

On the other hand, the number of users who enjoy fishing as a hobby has recently increased, and it is expected that interest in fishing activities will further increase as the 52-hour work system and leisure time increase.

In this regard, users who enjoy fishing as a hobby have a desire to share the aquatic creatures they have captured or record related information, but as there is no fishing-related service provided through smartphones, fishing is a hobby activity. Users enjoying the game take pictures and record the captured aquatic creatures.

However, the method of capturing and recording captured aquatic organisms has various limitations in sharing aquatic organisms or recording related information.

It is intended to provide a server, method, and user terminal for learning a fish identification model using learning data including previously collected images of aquatic organisms and label information. An image of an aquatic creature is received from the user terminal, a fish of the aquatic creature is identified from the received image of the aquatic creature using a fish identification model, and the appearance of the aquatic creature is modeled based on the fish of the aquatic creature and the image of the aquatic creature. It is intended to provide a server, method, and user terminal for generating a virtual aquatic creature.

Server, method and It is intended to provide a user terminal.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problems described above, and other technical problems may exist.

As a means for achieving the above-described technical problem, an embodiment of the present invention provides a model learning unit for learning a fish identification model using learning data including previously collected images and label information of aquatic organisms, from a user terminal. A receiver for receiving an image of an aquatic creature, a fish identification unit for identifying a fish of the aquatic creature from the received image of the aquatic creature using the fish identification model, based on the fish of the aquatic creature and the image of the aquatic creature A virtual aquatic creature generating unit for generating a virtual aquatic creature modeling the external appearance of the aquatic creature and applying an aquatic creature motion algorithm to the created virtual aquatic creature to realize swimming of the virtual aquatic creature, and implementing the virtual aquatic creature swimming. A virtual aquarium service providing server including a virtual aquarium service providing unit providing a virtual aquarium service for viewing aquatic life through a virtual aquarium to the user terminal may be provided.

Another embodiment of the present invention includes learning a fish identification model using learning data including previously collected images of aquatic creatures and label information, receiving an image of aquatic creatures from a user terminal, and the fish identification model. identifying a fish of the aquatic creature from the received image of the aquatic creature by using a fish, and generating a virtual aquatic creature modeling an external appearance of the aquatic creature based on the fish of the aquatic creature and the image of the aquatic creature. and implementing a swimming of the virtual aquatic creature by applying an aquatic creature motion algorithm to the created virtual aquatic creature, and providing a virtual aquarium service for viewing the virtual aquatic creature in which the swimming is implemented through a virtual aquarium. It is possible to provide a virtual aquarium service providing method comprising the step of providing.

Another embodiment of the present invention provides a photographing unit for capturing an image of an aquatic creature using a camera, a transmitting unit for transmitting the captured image of an aquatic creature to a virtual aquarium service providing server, and the virtual aquarium service providing server. A virtual aquarium service providing unit receiving a virtual aquarium service so that a virtual aquatic creature generated based on an image of an aquatic creature and a fish of the aquatic creature identified from the image can be viewed through the virtual aquarium, and The fish is identified from the image of the aquatic creature using a fish identification model by the virtual aquarium service providing server, and the virtual aquatic creature has an appearance of the aquatic creature based on the fish of the aquatic creature and the image of the aquatic creature. In the virtual aquarium service, an aquatic creature motion algorithm is applied to the created virtual aquatic creature to realize swimming of the virtual aquatic creature, and the virtual aquatic creature in which the swimming is implemented can be viewed through the virtual aquarium. It is possible to provide a user terminal that is to enable.

The above-described means for solving the problems is only illustrative and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and detailed description.

According to any one of the above-described problem solving means of the present invention, when a user captures an aquatic organism captured through a fishing activity using a user terminal, the image of the aquatic organism captured through a fish identification model is used to identify an aquatic organism. It is possible to provide a server, method, and user terminal for identifying a fish and generating a virtual aquatic creature modeling an external appearance of the aquatic creature based on the identified fish and images of the aquatic creature.

A server, method, and user that implements swimming of the virtual aquatic creature by applying an aquatic creature motion algorithm to the virtual aquatic creature, and provides a virtual aquarium service to a user terminal so that the virtual aquatic creature in which swimming is implemented can be viewed through the virtual aquarium. terminal can be provided.

1 is a block diagram of a virtual aquarium service providing system according to an embodiment of the present invention.
2 is a configuration diagram of a virtual aquarium service providing server according to an embodiment of the present invention.
3A to 3D are exemplary diagrams for explaining a process of providing information on aquatic organisms according to an embodiment of the present invention.
4 is an exemplary diagram for explaining a process of obtaining a voting result on whether label information of an unidentified aquatic creature is authentic according to an embodiment of the present invention.
5A and 5B are exemplary diagrams for explaining a process of providing a virtual aquarium service according to an embodiment of the present invention.
6 is an exemplary diagram for explaining a process of performing authentication for fishing activities according to an embodiment of the present invention.
7A and 7B are exemplary diagrams for explaining a process of providing at least one piece of additional information related to a fishing activity according to an embodiment of the present invention.
8 is a flowchart of a method of providing a virtual aquarium service for aquatic organisms captured through fishing activities in a virtual aquarium service providing server according to an embodiment of the present invention.
9 is a configuration diagram of a user terminal according to an embodiment of the present invention.
10A to 10D are exemplary diagrams for explaining a process of displaying virtual aquatic creatures through a virtual aquarium in a user terminal according to an embodiment of the present invention.
11 is a flowchart of a method for receiving a virtual aquarium service for aquatic organisms captured through fishing activities in a user terminal according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail so that those skilled in the art can easily practice the present invention with reference to the accompanying drawings. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected" but also the case where it is "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, this means that it may further include other components, not excluding other components, unless otherwise stated, and one or more other characteristics. However, it should be understood that it does not preclude the possibility of existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

In this specification, a "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized using two or more hardware, and two or more units may be realized by one hardware.

In this specification, some of the operations or functions described as being performed by a terminal or device may be performed instead by a server connected to the terminal or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal or device connected to the corresponding server.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a virtual aquarium service providing system according to an embodiment of the present invention. Referring to FIG. 1 , a virtual aquarium service providing system 1 may include a virtual aquarium service providing server 110 and a plurality of user terminals 120 . The virtual aquarium service providing server 110 and the plurality of user terminals 120 are examples of components that can be controlled by the virtual aquarium service providing system 1 .

Each component of the virtual aquarium service providing system 1 of FIG. 1 is generally connected through a network. For example, as shown in FIG. 1 , the virtual aquarium service providing server 110 may be connected to a plurality of user terminals 120 simultaneously or at intervals.

A network refers to a connection structure capable of exchanging information between nodes such as terminals and servers, such as a local area network (LAN), a wide area network (WAN), and the Internet (WWW: World Wide Web), wired and wireless data communication network, telephone network, and wired and wireless television communication network. Examples of wireless data communication networks include 3G, 4G, 5G, World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, infrared communication, ultrasonic communication, visible light communication (VLC: Visible Light Communication), LiFi ), etc., but are not limited thereto.

The virtual aquarium service providing server 110 may learn a fish identification model using learning data including previously collected images of aquatic organisms and label information. For example, the virtual aquarium service providing server 110 receives label information on an image of an unidentified aquatic creature from a plurality of user terminals 120, updates training data, and identifies fish using the updated training data. model can be trained.

The virtual aquarium service providing server 110 may receive an image of an aquatic creature from the first user terminal 121 .

The virtual aquarium service providing server 110 identifies a fish of aquatic life from the received aquatic creature image using a fish identification model, and transmits information on the identified aquatic creature based on the identified aquatic creature to the first user terminal. (121). Here, information on aquatic organisms may include fish information related to aquatic organisms, catch information, fish encyclopedia information, and meta information of images of aquatic organisms.

The virtual aquarium service providing server 110 receives label information on fish of aquatic organisms from the first user terminal 121 when it is impossible to identify fish of aquatic organisms, or automatically label information by using a label information allocation algorithm. can be assigned.

The virtual aquarium service providing server 110 posts an aquatic creature post including an image of an aquatic creature and label information to at least one of a social network service (SNS) service, an app or a web service providing a virtual aquarium service, and the aquatic creature Label information on fish of aquatic organisms may be further received from the plurality of user terminals 120 that access the postings.

For example, the virtual aquarium service providing server 110 may receive information on authenticity of label information from a plurality of user terminals 120 .

For example, the virtual aquarium service providing server 110 may receive a voting result for the voting post by posting a voting post regarding the authenticity of the label information to at least one of an SNS service, a virtual aquarium service providing app, or a web service. there is. At this time, the virtual aquarium service providing server 110 may provide a predetermined point to the account of at least one user terminal 120 participating in the voting on the authenticity of the voting post.

The virtual aquarium service providing server 110 may add an image of an aquatic creature and label information to the learning data when the total voting amount and the voting rate for True in the voting result are equal to or greater than a preset threshold value.

The virtual aquarium service providing server 110 may generate a virtual aquatic creature modeling an external appearance of an aquatic creature based on fish and images of aquatic creatures.

The virtual aquarium service providing server 110 implements swimming of the virtual aquatic creature by applying an aquatic creature motion algorithm to the created virtual aquatic creature, and a virtual aquarium that allows the swimming virtual aquatic creature to be observed through the virtual aquarium. The service may be provided to the first user terminal 121 . Here, the virtual aquarium may be implemented on the metaverse space.

The virtual aquarium service providing server 110 may provide a community service between avatars of a plurality of users who use the aquarium service in the metaverse space.

The virtual aquarium service providing server 110 receives location information of the aquatic organisms captured from the first user terminal 121, compares the aquatic organism information and location information, and provides information about fishing activities of the first user terminal 121. authentication can be performed.

The virtual aquarium service providing server 110 provides additional information related to weather information related to fishing activities, tide information, competition information, recommended fishing place information, fishing guide information, fishing supply store information, fishing boat information, and lodging information to the first user. It can be provided to the terminal 121. For example, the virtual aquarium service providing server 110 may provide the first user terminal 121 with information about a place to stay that requires a minimum distance or minimum time from a fishing spot designated by the user. Here, the minimum distance is derived through harversine fomula, spherical low of cosines, etc., and the minimum time is Manhattan distance, Euclidean distance, phase order, Dijkstra, Bellman Ford, A-Star, Floyd-Warshall, Prim, It can be derived through MST, Kruskal, etc.

The virtual aquarium service providing server 110 may provide the SNS service to a plurality of user terminals 120 through an app providing the virtual aquarium service. The SNS service may include a community function with other users, a function of registering an area of interest, a function of exposing popular posts, a function of recommending contents according to user interest, a function of commenting on SNS posts, a function of advertising a feed, and a function of broadcasting real-time fishing conditions. For example, if the first user terminal 121 has uploaded an SNS post about fishing activities in the Sihwa embankment through the SNS service, the virtual aquarium service providing server 110 provides recommended content uploaded in the West Sea. It may be provided to one user terminal 121 . For another example, the virtual aquarium service providing server 110 analyzes the taste of the first user based on the search history and tagging information of the first user terminal 121, and sends advertisements that may be of interest to the first user through SNS. It can be exposed through service. For another example, when a fishing schedule is registered from the first user terminal 121 , a weather forecast and companion information related to the registered fishing schedule may be provided to the first user terminal 121 .

In addition, the virtual aquarium service providing server 110 may provide aquatic creature capture ranking information to the plurality of user terminals 120 through an app or web service providing the virtual aquarium service. For example, the virtual aquarium service providing server 110 may provide ranking information according to the length of each fish of aquatic organisms to the plurality of user terminals 120 . Hereinafter, the user terminal will be described based on the first user terminal 121 among the plurality of user terminals 120 .

The user terminal 121 may capture an image of an aquatic creature using a camera and transmit the captured image of the aquatic creature to the virtual aquarium service providing server 110 . Here, the camera may include a general camera, a depth camera, and the like. For example, the user terminal 121 may measure the length of an aquatic creature when equipped with a depth camera.

The user terminal 121 may receive information on aquatic organisms identified based on the image of aquatic organisms from the virtual aquarium service providing server 110 and display the information on aquatic organisms through a display.

When the user terminal 121 receives a message related to the identification of fish species of aquatic organisms from the virtual aquarium service providing server 110, the user terminal 121 receives label information on the fish species of aquatic organisms, and provides the input label information to the virtual aquarium service. It can be transmitted to the server 110.

The user terminal 121 provides a virtual aquarium service through which the user terminal 121 can view the virtual aquatic creature generated based on the image of the aquatic creature from the virtual aquarium service providing server 110 and the fish of the aquatic creature identified from the image through the virtual aquarium. can be provided.

The user terminal 121 may display virtual aquatic creatures in which swimming and movement are expressed in the virtual aquarium through a display.

The user terminal 121 may provide the SNS service to the user through an app or web service providing a virtual aquarium service. In addition, the user terminal 121 provides weather information related to fishing activities, fishing condition information, competition information, recommended fishing place information, fishing guide information, fishing supply store information, fishing boat information, And additional information related to lodging information may be provided.

2 is a configuration diagram of a virtual aquarium service providing server according to an embodiment of the present invention. Referring to FIG. 2 , the virtual aquarium service providing server 110 includes a model learning unit 200, a receiving unit 210, a fish identification unit 220, an information providing unit 230, a point payment unit 240, and virtual aquatic creatures. It may include a generator 250, a virtual aquarium service provider 260, a metaverse service provider 270, an authentication performer 280, and an additional information provider 290.

The model learning unit 200 may learn a fish species identification model using learning data including previously collected images of aquatic organisms and label information. Here, the fish identification model is Convolution Neural network (CNN), Single Shot MultiBox Detector (SSD), You Only Look Once (YOLO), Retinanet, K-nearest neighbor, K-means Can be built based on K-menas/K-modes, Gaussian Mixture Model, Support Vector Machine (SVM), Bag of Words (BoW), Viola-Jones, etc. Not limited to this.

The fish species identification model can further improve the recognition accuracy of images of aquatic creatures by using Principal Component Analysis, Singular Value Decomposition, Latent Dirichlet Allocation, and Claasfication. .

The model learning unit 200 may include a label information management unit 201 .

The label information management unit 201 may receive label information about an image of an unidentified aquatic creature from a plurality of user terminals 120 . The label information management unit 201 provides information on authenticity of label information about an image of an unidentified aquatic creature from a plurality of user terminals 120 through at least one of an SNS service and an app or web service providing a virtual aquarium service. can receive

The receiving unit 210 may receive an image of an aquatic creature from the first user terminal 121 .

The fish identification unit 220 may identify a fish of an aquatic creature from the received image of an aquatic creature by using a fish identification model.

The information providing unit 230 may provide information on the identified aquatic organisms to the first user terminal 121 based on the fish of the identified aquatic organisms. Here, information on aquatic organisms may include fish information related to aquatic organisms, catch information, fish encyclopedia information, image information of an image of aquatic organisms, meta information, and the like.

Here, the image information of the image of the aquatic creature includes, for example, fish identification information, pixel identification information, whether or not the same image exists, and the meta information, for example, shooting date, shooting location, tag information, and file size. , extension, color information, camera information (eg, aperture, shutter speed, ISO, lens size, white balance, flash, etc.).

In addition, when the first user terminal 121 posts the captured aquatic organisms on the SNS, the information providing unit 230 provides the post upload date, text information, size information of the aquatic organisms, tag information, etc. posted on the SNS. can provide more. A process of identifying the species of aquatic organisms and providing information on aquatic organisms will be described in detail with reference to FIGS. 3A to 3D .

3A to 3D are exemplary diagrams for explaining a process of providing information on aquatic organisms according to an embodiment of the present invention.

Referring to FIG. 3A , a first user may capture an aquatic creature through a fishing activity and then photograph the captured aquatic creature using his/her first user terminal 121 .

The receiving unit 210 may receive the image 300 of an aquatic creature from the first user terminal 121 .

Referring to FIG. 3B , the fish identification unit 220 may measure the length of an aquatic creature from the image 300 of the aquatic creature using various length measurement methods prior to identifying the fish of the aquatic creature.

For example, the fish identification unit 220 may measure the length of the aquatic creature 311 using the marker comparison length measuring method 310 . Here, the image 300 of an aquatic creature may include a marker 312 located around the aquatic creature 311 . For example, the fish identification unit 220 determines the aquatic organisms captured by the first user using a ratio of the length of the aquatic organisms 311 and the length of the marker 312 preset based on the aquatic organisms image 300. The length of (311) can be measured. For example, when the length of the predetermined marker 312 is 10 cm and the ratio of the length of the marker 312 obtained from the image 300 of an aquatic creature and the length of the aquatic creature 311 is 1:2, fish are identified. The part 220 may measure the length of the aquatic creature 311 as 20 cm through a proportional formula.

For another example, the fish identification unit 220 may measure the length of an aquatic creature using the augmented reality length measuring method 320 . For example, the fish identification unit 220 displays markers 321 on each of the head end and tail end of the aquatic creature 311 included in the aquatic creature image 300, and each of the displayed markers 321 ), the length of the aquatic creature 311 may be measured using augmented reality.

As another example, the fish identification unit 220 may measure the length 331 of the aquatic creature 311 using the depth camera length measuring method 330 . For example, the receiver 210 may receive height information from the first user terminal 121 . Here, the height information may mean a measured distance from the first user terminal 121 to the aquatic creature 311 .

The fish identification unit 220 measures the size occupied by the aquatic creature 311 from the aquatic creature image 300, and through this measures the size and size of the aquatic creature 311 in the previously stored height information and the aquatic creature image 300. The length 331 of the aquatic creature can be measured from the image 300 of the aquatic creature using the correlation of .

Referring to FIG. 3C , the fish identification unit 220 may identify a fish of an aquatic creature 311 from an image 300 of an aquatic creature. For example, the fish identification unit 220 may use an image 300 of an aquatic creature by using a computer vision technology capable of selective search or a Region Proposal Network (RPN) algorithm based on deep learning. ), an area where aquatic organisms are likely to be located can be detected as a predetermined bounding area.

Thereafter, the fish identification unit 220 may input an image corresponding to the detected bounding area to the fish identification model 340 to identify a fish of aquatic organisms as 'rockfish' 350 .

Referring to FIG. 3D , the information providing unit 230 may provide information on the identified aquatic organisms based on the fish of the identified aquatic organisms. For example, when the fish of the aquatic organisms is identified as 'rockfish', the information providing unit 230 may provide information such as the size, weight, age, catch information, fish information, recipe, preparation method, and rockfish fishing laws of the 'rockfish'. Detailed information 360 on the rockfish' may be provided to the first user terminal 121 . Here, the capture information includes capture date, capture environment, time required for capture, capture location, capture tool, culture or wild production information, etc., and fish encyclopedia information includes scientific name, English name, Japanese name, nickname, dialect, and endangered species level. , distribution, habitat, morphology, spawning, growth, migration, food, life expectancy, body color, and auction information.

The information provision unit 230 further provides transaction price information related to fish of aquatic organisms, taboo season information, spawning season information, sashimi ranking information, fish grooming information, recipe information for each fish, equipment inspection information, main food information, risk information, and the like. can provide

Returning to FIG. 2 , when the fish identification unit 220 cannot identify fish of aquatic creatures from the image of the aquatic creatures, the information providing unit 230 sends a fish identification request message for fish identification to the first user terminal 121 ) can be provided.

The label information management unit 201 receives label information on aquatic fish from the first user terminal 121 or automatically allocates label information by using a label information allocation algorithm when it is impossible to identify fish as aquatic organisms. can do.

For example, the label information management unit 201 may receive, as label information, 'Spirit rockfish' input by the user from the first user terminal 121 . For another example, when the information providing unit 230 transmits a fish identification request message such as "Is this fish a rockfish?" in relation to the image of an aquatic creature to the first user terminal 121, The label information management unit 201 may generate label information by receiving a response message from the first user terminal 121 . As another example, when the information providing unit 230 transmits a plurality of candidate fish in relation to the image of an aquatic creature to the first user terminal 121, the label information management unit 201 transmits the first user terminal 121 ), it is possible to receive label information including 'Spirit rockfish' input by the user from ).

The label information management unit 201 posts an aquatic creature post including an image of an aquatic creature and label information to at least one of an SNS service, an app or a web service that provides a virtual aquarium service, and receives information from a plurality of user terminals 120. Based on the creature posting, label information about the fish of the aquatic creature may be further received. At this time, the model learning unit 200 may update training data based on the received label information, and may train a fish identification model using the updated training data.

The label information management unit 201 may receive information about authenticity of the label information from the plurality of user terminals 120 through at least one of an SNS service, an app providing a virtual aquarium service, and a web service. A process of receiving information on authenticity of the label information from the plurality of user terminals 120 will be described in detail with reference to FIG. 4 .

4 is an exemplary diagram for explaining a process of obtaining a voting result on whether label information of an unidentified aquatic creature is authentic according to an embodiment of the present invention. Referring to FIG. 4 , the label information management unit 201 posts a vote on authenticity of label information on at least one of the SNS service 400 and an app or web service that provides a virtual aquarium service to a plurality of user terminals A voting result 402 for the voting post 401 in which 120) participated may be obtained. For example, when a plurality of user terminals 120 access an app or web service that provides a virtual aquarium service, the label information management unit 201 displays a voting post 401 on the app or web service that provides a virtual aquarium service. can be displayed in the form of a pop-up or image.

Returning to FIG. 2 again, the point payment unit 240 may provide predetermined points to the accounts of the plurality of user terminals 120 participating in voting on the voting posts.

The model learning unit 200 may add an image of an aquatic creature and label information to training data when the total voting amount and the voting rate for True in the voting result are equal to or greater than a predetermined threshold value. For example, the model learning unit 200 may use an image and label of an aquatic creature when the total voting amount of the voting result is, for example, 1,000 votes or more, and the voting rate for true is about 66% or more (2/3 or more). information can be added to the training data. At this time, if the turnout for False is about 33% or more (1/3 or more), it is determined that the image and label information of the aquatic creature are incorrectly matched and may not be added to the learning data.

When the image of an aquatic creature is not added to the learning data, the point payment unit 240 may provide the first user terminal 121 with a predetermined point or a decoration item for a virtual aquarium through a quiz event.

In addition, the point payment unit 240 may provide predetermined points to a plurality of user terminals 120 participating in an attendance check, event, etc. of an app or web service providing a virtual aquarium service.

The virtual aquatic creature generating unit 250 may generate a virtual aquatic creature in which an external shape of an aquatic creature is modeled based on images of fish and aquatic creatures.

The virtual aquarium service provider 260 implements swimming of the virtual aquatic creature by applying an aquatic creature motion algorithm to the created virtual aquatic creature, and allows the virtual aquatic creature to be viewed through the virtual aquarium. The service may be provided to the first user terminal 121 . A process of providing a virtual aquarium service will be described in detail with reference to FIGS. 5A and 5B.

5A and 5B are exemplary diagrams for explaining a process of providing a virtual aquarium service according to an embodiment of the present invention.

Referring to FIG. 5A , the virtual aquatic creature generator 250 may generate a virtual aquatic creature through a virtual aquatic creature generation model based on fish information, length information 500, and color information 510 of the aquatic creature. . Here, the color information 510 of an aquatic creature may be a color extracted from an image of an aquatic creature, or may be a color corresponding to the identified fish when a fish of the aquatic creature is identified.

The virtual aquatic creature generator 250 may generate 2D images, 2D illustrations, 3D modeling, 3D illustrations, and virtual aquatic creatures embodying 3D appearances of fish species of aquatic creatures as they are through a virtual aquatic creature generation model.

The virtual aquatic creature generation model may be a model to which a Conditional Generative Adversarial Network (CGAN) algorithm, known as a deepfake technology expressing realism, is applied. For example, the virtual aquatic creature generation model applies length information 500 of an aquatic creature to a basic three-dimensional model corresponding to a fish of an aquatic creature, and color information 510 of the virtual aquatic creature based on an image of the aquatic creature. and material information may be applied to generate virtual aquatic organisms.

Referring to FIG. 5B , the virtual aquarium service provider 260 may create a virtual aquarium 520 . For example, the virtual aquarium service provider 260 may create at least one virtual aquarium 520 for each capture location or fishing period for the account of the first user terminal 121 . For example, the virtual aquarium service provider 260 realizes virtual water stains and residues generated while storing the virtual aquatic organisms 521, and various environmental changes that occur while breeding aquatic organisms in an actual aquarium. may be generated through the virtual aquarium 520.

For another example, the virtual aquarium service providing unit 260 provides a virtual aquarium service in which aquatic plants, lighting, floor decorations, and other structure information are implemented in the virtual aquarium 520 to the first user terminal 121, 1 The user may visually check the internal structure of the virtual aquarium 520 . At this time, the virtual aquarium service provider 260 provides information on the shape of the virtual aquarium 520 (eg, circular, rectangular, cylindrical, sea, freshwater, boat, house, space, etc.), aquatic plant information, and lighting information. , floor decoration information, other structure information, etc. may be further provided to the first user terminal 121 so that settings related to the internal structure of the virtual aquarium 520 may be changed by the first user terminal 121 .

In this way, the shape and decoration of the virtual aquarium 520 preset by the first user terminal 121 may be changed, and the virtual aquarium 520 may be a separate decoration item purchased by the first user terminal 121. Decorations may be changed or added.

As another example, the virtual aquarium service provider 260 provides cleaning information, temperature information, filter information, oxygen generation information, and feed information related to the virtual aquarium 520 to the first user terminal 121, Settings related to the environment of the virtual aquarium 520 may be changed by the first user terminal 121 .

The virtual aquarium service providing unit 260 may provide the virtual aquarium service to the first user terminal 121 by locating the virtual aquatic creature 521 in the created virtual aquarium 520 . For example, the virtual aquarium service provider 260 may allow the virtual aquatic creature 521 to move by reflecting swimming and movement corresponding to fish of the actual aquatic creature within the virtual aquarium 520 . Here, the virtual aquarium 520 may be implemented on the metaverse space.

The virtual aquarium service provider 260 implements the virtual aquarium 520 as virtual reality content, augmented reality content, mixed reality content, etc. using virtual reality, augmented reality, mixed reality, etc. By providing, the first user can feel a sense of vitality through the contents of the virtual aquarium 520 .

When other users visit the virtual aquarium 520 of the first user through the virtual aquarium service, the virtual aquarium service provider 260 may allow the first user to write a guestbook and check the created guestbook.

In addition, the virtual aquarium service providing unit 260 may provide ranking information of the virtual aquarium 520 to the plurality of user terminals 120 based on scores for the decoration of the virtual aquarium 520 for each user. For example, since each of the plurality of user terminals 120 evaluates the decoration of the virtual aquarium 520 of another user through the virtual aquarium service, the virtual aquarium service provider 260 provides ranking information of the virtual aquarium 520. may be provided to a plurality of user terminals 120 . For another example, the virtual aquarium service providing unit 260 calculates a score according to the harmony among decorative items in the virtual aquarium 520 for each user, the number and type of decorative items, etc. ), and ranking information of the virtual aquarium 520 based on the score may be provided to the plurality of user terminals 120 .

The metaverse service providing unit 270 may provide a community service between the avatars of a plurality of users who use the virtual aquarium service in the metaverse space. Metaverse is a new word that combines meta, which means virtuality and transcendence, and universe, which means the world and the universe. it means. This metaverse can be implemented in the form of Augmented Reality, Lifelogging, Mirror Worlds, and Virtual Worlds.

For example, the metaverse service provider 270 may provide a community service through which other users who have visited the user's virtual aquarium 520 in the metaverse space can exchange conversations through a guestbook function. For another example, the metaverse service provider 270 may plan a schedule for fishing activities through a non-face-to-face meeting on the metaverse space.

Returning to FIG. 2 again, the receiving unit 210 may receive location information of the captured aquatic creature from the first user terminal 121 .

The authentication unit 280 may perform authentication for fishing activities of the first user terminal 121 by comparing information of aquatic organisms and location information. A process of authenticating the fishing activity of the first user terminal 121 will be described in detail with reference to FIG. 6 .

6 is an exemplary diagram for explaining a process of performing authentication for fishing activities according to an embodiment of the present invention. Referring to FIG. 6 , it is assumed that a first user terminal 121 posts an image 611 of an aquatic creature and location information 610 on the SNS 600 .

For example, the authentication unit 280 compares the image 611 and the location information 610 of the aquatic creature with the aquatic creature information stored in the database to authenticate the fishing activity of the first user terminal 121. can For example, the database may store fish of aquatic organisms that can be captured in an indoor fishing activity site or an outdoor fishing activity site such as freshwater/sea. For example, when a 'catfish' is caught in 'Haeundae, Busan', the authentication unit 280 uses the image of 'catfish' and the location information of 'Haeundae, Busan.' When activity authentication is performed and 'catfish' is not caught in 'Haeundae, Busan', authentication for fishing activities of the first user terminal 121 may not be performed.

For another example, assume that another user terminal in the same capturing location as the first user terminal 121 posts an image and location information of the aquatic creature captured by the user terminal on the SNS service.

The authentication performer 280 may perform authentication for fishing activities by comparing posts posted on the SNS service 600 . For example, the authentication performing unit 280 compares the image 611 of an aquatic creature captured by the first user with the image of an aquatic creature captured by another user, and if the images of the two aquatic creatures are different, the first user captures the image 611 of the aquatic creature. 1 Authentication of the fishing activity of the user terminal 121 may be performed. For another example, if the images of aquatic organisms posted by the first user and other users in the same capturing location are the same, the authentication performing unit 280 determines that the first user and the other users do not directly capture the aquatic organisms. Upon determination, authentication for fishing activities of the first user terminal 121 and other user terminals may not be performed.

Returning to FIG. 2 , the additional information providing unit 290 provides additional information related to weather information related to fishing activities, fishing conditions information, competition information, recommended fishing place information, fishing guide information, fishing supply store information, fishing boat information, and lodging information. Information may be provided to the first user terminal 121 . A process of providing additional information related to fishing activities will be described in detail with reference to FIGS. 7A and 7B.

7A and 7B are exemplary diagrams for explaining a process of providing at least one piece of additional information related to a fishing activity according to an embodiment of the present invention.

Referring to FIG. 7A , the additional information providing unit 290 may provide weather information 700 of the Jeonnam nutritional embankment to the first user terminal 121 when the first user captures aquatic organisms in the Jeonnam nutritional embankment. there is. For example, the additional information providing unit 290 determines sunrise, sunset, wind, waves, water level, current intensity, moon phase, weather, temperature, sensible temperature, maximum temperature, minimum temperature, Weather information 700 including humidity, precipitation probability, precipitation, fine dust, ultra-fine dust, ultraviolet rays, and special weather information may be provided.

In this case, the additional information providing unit 290 may further provide the sea fishing index and the freshwater fishing index to the first user terminal 121 . Here, the sea fishing index and the freshwater fishing index may refer to fishing indexes for each catching location derived based on big data of weather and fishing condition information. In addition, the additional information provider 290 may further provide water temperature, air pressure, turbidity, wave height, water level, earthquake, tidal wave, maritime distress information, and the like.

The additional information providing unit 290 may further provide a fishing activity recommendation date to the first user terminal 121 based on recent fishing conditions data, past fishing conditions data, predicted weather data, past weather data, and the like.

Referring to FIG. 7B , the additional information providing unit 290 may provide a recommended fishing activity place to the first user terminal 121 by combining the search condition information or the user's preference. Bird condition information may be derived through capture information of aquatic organisms, length, fish, capture environment, and the like. In the case of recommended places for fishing activities, it is possible to provide capture spots for each type of fish of aquatic organisms.

For example, the additional information providing unit 290 provides a first user with recommended fishing spots for catching aquatic creatures, such as Yeonam embankment, Gohado dock, Aphae bridge, Geumho embankment, Baekyeonji, etc. It may be provided to the user terminal 121 .

In this case, the additional information providing unit 290 may further provide a capture location for each fish of aquatic organisms, a tool for capturing aquatic organisms for each fish type, risk information of aquatic organisms for each fish type, and related laws and regulations.

For example, the additional information providing unit 290 may expose recommended places for fishing activities through a map on the SNS service, expose actual fishing conditions photos in time, and expose locations for each type of fish to be captured on the SNS service. .

The additional information providing unit 290 may further provide a degree of congestion related to a fishing activity place. The congestion level may be derived and provided based on, for example, SNS service access records of a plurality of user terminals 120, reservation records for each fishing spot, and the current number of users for each fishing spot. In this case, the additional information providing unit 290 may provide an alternative fishing activity place or a recommended date for an alternative fishing activity to the first user terminal 121 based on the degree of congestion of the fishing activity place.

8 is a flowchart of a method of providing a virtual aquarium service for aquatic organisms captured through fishing activities in a virtual aquarium service providing server according to an embodiment of the present invention. A method of providing a virtual aquarium service for aquatic organisms captured through a fishing activity performed in a virtual aquarium service providing server 110 shown in FIG. 8 provides a virtual aquarium service according to the embodiment shown in FIGS. 1 to 7B It includes steps processed time-sequentially by system 1. Therefore, even if the contents are omitted below, the virtual aquarium service providing server 110 according to the embodiment shown in FIGS. 1 to 7B applies to the method of providing a virtual aquarium service for aquatic organisms captured through fishing activities.

In step S810, the virtual aquarium service providing server 110 may learn a fish identification model using learning data including previously collected images of aquatic creatures and label information.

In step S820, the virtual aquarium service providing server 110 may receive an image of an aquatic creature from the first user terminal 121.

In step S830, the virtual aquarium service providing server 110 may identify fish of aquatic organisms from the received aquatic organism images using the fish identification model.

In step S840, the virtual aquarium service providing server 110 may generate a virtual aquatic creature modeling the appearance of the aquatic creature based on the fish and the aquatic creature image.

In step S850, the virtual aquarium service providing server 110 may implement swimming of the virtual aquatic creature by applying an aquatic creature motion algorithm to the created virtual aquatic creature.

In step S860, the virtual aquarium service providing server 110 may provide the first user terminal 121 with a virtual aquarium service allowing the virtual aquatic organisms in which swimming is realized to be viewed through the virtual aquarium.

In the above description, steps S810 to S860 may be further divided into additional steps or combined into fewer steps, depending on an embodiment of the present invention. Also, some steps may be omitted as needed, and the order of steps may be switched.

9 is a configuration diagram of a user terminal according to an embodiment of the present invention. Here, the user terminal will be described based on the first user terminal 121 among the plurality of user terminals 120 . Referring to FIG. 9 , the user terminal 121 includes a photographing unit 910, a transmission unit 920, an aquatic life information providing unit 930, a display unit 940, an input unit 950, and a virtual aquarium service providing unit 960. ) and a metaverse service provider 970.

The photographing unit 910 may capture an image of an aquatic creature using a camera. Here, the camera may include a general camera, a depth camera, and the like. For example, the photographing unit 910 displays a photographing area of a predetermined location and a predetermined size on the display of the user terminal 121 so that the user presents the photographing region to capture an image of an aquatic creature. can make it

The transmission unit 920 may transmit the captured image of aquatic life to the virtual aquarium service providing server 110 .

The transmission unit 920 may transmit location information of the user terminal 121 to the virtual aquarium service providing server 110 . For example, the transmission unit 920 may transmit location information of the user terminal 121 measured through a Global Positioning System (GPS) to the virtual aquarium service providing server 110 . For another example, the transmission unit 920 may transmit location information input by the user to the virtual aquarium service providing server 110 .

The aquatic creature information provider 930 may receive information on aquatic creatures identified based on the aquatic creature images from the virtual aquarium service providing server 110 . For example, the aquatic creature information providing unit 930 provides detailed information related to the 'small rockfish' when the fish of the aquatic creature is identified as 'rockfish' based on the image of the aquatic creature from the virtual aquarium service providing server 110. can be provided.

The display unit 940 may display information on aquatic organisms through a display.

When the input unit 950 receives a fish identification request message from the virtual aquarium service providing server 110 , the input unit 950 may receive label information about fish of aquatic organisms. For example, when the input unit 950 receives an identification confirmation request message of a fish of aquatic organisms, it may receive 'rockfish' as label information on the fish of aquatic organisms.

The transmission unit 920 may transmit the input label information to the virtual aquarium service providing server 110 .

The virtual aquarium service providing unit 960 may provide a virtual aquarium service allowing viewing of virtual aquatic creatures generated based on images of aquatic creatures from the virtual aquarium service providing server 110 through the virtual aquarium. Here, the virtual aquarium may be implemented on the metaverse space.

The display unit 940 may display virtual aquatic creatures in which swimming and movement are embodied in the virtual aquarium through a display.

The metaverse service provider 970 may receive a community service between a user's avatar and a plurality of other users' avatars using the aquarium service in the metaverse space. Alternatively, the metaverse service provider 970 may plan a schedule for fishing activities through a non-face-to-face meeting between a user's avatar and a plurality of other users' avatars in the metaverse space.

10A to 10D are exemplary diagrams for explaining a process of displaying virtual aquatic creatures through a virtual aquarium in a user terminal according to an embodiment of the present invention.

Referring to FIG. 10A , the user terminal 121 may check the virtual aquarium 1000 through an app or web service providing its own virtual aquarium service. For example, the user terminal 121 may display a plurality of virtual aquatic creatures located in the virtual aquarium 1000 . Here, the fish, body length, capture date, capture area, etc. of each of the plurality of virtual aquatic creatures may be displayed on the virtual aquarium 1000 .

Referring to FIG. 10B , when a specific virtual aquatic creature 1010 displayed on the virtual aquarium 1000 is selected, the user terminal 121 may display detailed information 1020 related to the specific virtual aquatic creature 1010. .

Referring to FIG. 10C , the user may check the aquatic organisms captured by the user by fish type and size through virtual aquatic organisms. At this time, the user can provide an effect of immediately comparing the aquatic creatures captured by the user by checking various information such as weight and appearance of the virtual aquatic creature.

Referring to FIG. 10D , the user terminal 121 allows the user to see virtual aquatic creatures swimming and moving like real aquatic creatures through a virtual aquarium implemented as virtual reality content or augmented reality content 1040, so that the user can actually Virtual underwater creatures can be confirmed through a virtual aquarium realistically expressed as if in an aquarium space.

Conventionally, when a user captures aquatic organisms through fishing activities, the captured aquatic organisms cannot be stored and managed, and thus the user has a memory of capturing the aquatic organisms or a photo stored in the user terminal 121 and his/her own I had no choice but to rely on my capture experience. However, the present invention allows the user to check the virtual aquatic organisms generated based on the captured aquatic organisms through the virtual aquarium, thereby providing a feeling of breeding the aquatic organisms captured by the user through his/her virtual aquarium. .

The user can feed the virtual aquatic creature through the virtual aquarium, adjust the temperature of the water in the virtual aquarium, and control the operation of the filter, thereby providing a feeling that the user is directly raising the virtual aquatic creature. .

11 is a flowchart of a method for receiving a virtual aquarium service for aquatic organisms captured through fishing activities in a user terminal according to an embodiment of the present invention. A method for receiving a virtual aquarium service for aquatic organisms captured through fishing activities in the user terminal 121 shown in FIG. 11 is in the virtual aquarium service providing system 1 according to the embodiment shown in FIGS. 1 to 10D It includes steps processed time-sequentially by Therefore, even if the content is omitted below, it is also applied to the method of receiving a virtual aquarium service for aquatic organisms captured through fishing activities in the user terminal 121 according to the embodiments shown in FIGS. 1 to 10D.

In step S1110, the user terminal 121 may capture an image of an aquatic creature using a camera.

In step S1120, the user terminal 121 may transmit the captured image of aquatic creatures to the virtual aquarium service providing server 110.

In step S1130, the user terminal 121 enters the virtual aquarium so that the virtual aquarium service providing server 110 can view the image of the aquatic creature and the virtual aquatic creature generated based on the fish of the aquatic creature identified from the image through the virtual aquarium. service can be provided.

In the above description, steps S1110 to S1130 may be further divided into additional steps or combined into fewer steps, depending on an embodiment of the present invention. Also, some steps may be omitted if necessary, and the order of steps may be switched.

The virtual aquarium service providing server described with reference to FIGS. 1 to 11 provides a method for providing a virtual aquarium service for aquatic organisms captured through fishing activities and a virtual aquarium service for aquatic organisms captured through fishing activities in a user terminal. The receiving method may also be implemented in the form of a computer program stored in a medium executed by a computer or a recording medium including instructions executable by a computer. In addition, the virtual aquarium service providing server described with reference to FIGS. 1 to 11 provides a virtual aquarium service for aquatic organisms captured through fishing activities and a virtual aquarium for aquatic organisms captured through fishing activities in a user terminal. A method of receiving a service may be implemented in the form of a computer program stored in a medium executed by a computer.

Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer readable media may include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The above description of the present invention is for illustrative purposes, and those skilled in the art can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts should be construed as being included in the scope of the present invention. do.

110: virtual aquarium service providing server
120: multiple user terminals
121: first user terminal
200: model learning unit
201: label information management unit
210: receiver
220: fish identification unit
230: information provision unit
240: point payment unit
250: virtual aquatic life generating unit
260: virtual aquarium service provider
270: metabus service provider
280: authentication execution unit
290: additional information providing unit
910: shooting unit
920: transmission unit
930: aquatic creature information providing unit
940: display unit
950: input unit
960: virtual aquarium service provider
970: metabus service provider

Claims (20)

In a server providing a virtual aquarium service for aquatic organisms captured through fishing activities,
a model learning unit learning a fish identification model using learning data including previously collected images of aquatic organisms and label information;
a receiving unit receiving an image of an aquatic creature from a user terminal;
a fish identification unit identifying a fish of the aquatic creature from the received aquatic creature image using the fish identification model;
a virtual aquatic creature generating unit generating a virtual aquatic creature modeling an external appearance of the aquatic creature based on the fish of the aquatic creature and the image of the aquatic creature; and
A virtual aquarium service is provided to the user terminal to realize swimming of the virtual aquatic creature by applying an aquatic creature motion algorithm to the created virtual aquatic creature, and to observe the virtual aquatic creature in which the swimming is implemented through a virtual aquarium. Virtual Aquarium Service Provider Department
To include, a virtual aquarium service providing server.
According to claim 1,
The virtual aquarium service providing server further comprising an information providing unit providing information on the aquatic organisms to the user terminal based on the fish of the identified aquatic organisms.
According to claim 1,
The virtual aquarium service providing server, which is implemented on the metaverse space.
According to claim 3,
A metaverse service providing unit that provides a community service between avatars of a plurality of users using the aquarium service on the metaverse space.
Further comprising a virtual aquarium service providing server.
According to claim 1,
The virtual aquarium service providing server, wherein the model learning unit includes a label information management unit receiving label information about an image of an unidentified aquatic creature from a plurality of user terminals.
According to claim 5,
The label information management unit receives label information on the fish of the aquatic organism from the user terminal or automatically allocates label information using a label information allocation algorithm when the identification of the fish of the aquatic organism is impossible. Server providing virtual aquarium service.
According to claim 5,
The label information management unit posts an aquatic creature post including the image of the aquatic creature and the label information on at least one of a social network service (SNS) service, an app or a web service providing the virtual aquarium service,
Wherein the server for providing a virtual aquarium service receives the label information on the fish of the aquatic organisms from the plurality of user terminals that have accessed the aquatic organisms post.
According to claim 5,
Wherein the model learning unit updates the learning data based on the received label information and uses the updated learning data to learn the fish identification model.
According to claim 5,
The label information management unit receives information on authenticity of the label information from the plurality of user terminals through at least one of an SNS service, an app or a web service providing the virtual aquarium service, and a virtual aquarium service providing server. .
According to claim 1,
The information of the aquatic organisms includes at least one of fish information, capture site information, fish encyclopedia information, image information of an image of the aquatic organisms, and meta information related to the aquatic organisms.
According to claim 1,
The receiving unit further receives location information of the captured aquatic creature from the user terminal,
The virtual aquarium service providing server further comprises an authentication performing unit performing authentication for the fishing activity of the user terminal by comparing the information of the aquatic life and the location information.
According to claim 1,
Additional information including at least one of weather information, fishing condition information, competition information, recommended fishing place information, fishing guide information, fishing supply store information, fishing boat information, and lodging information related to the fishing activity to the user terminal. information department
Further comprising a virtual aquarium service providing server.
A method for providing a virtual aquarium service for aquatic organisms captured through fishing activities in a virtual aquarium service providing server,
learning a fish identification model using learning data including previously collected images of aquatic organisms and label information;
Receiving an image of an aquatic creature from a user terminal;
identifying a fish of the aquatic creature from the received image of the aquatic creature by using the fish identification model;
generating a virtual aquatic creature modeling an external appearance of the aquatic creature based on the fish of the aquatic creature and the image of the aquatic creature; and
A virtual aquarium service is provided to the user terminal to realize swimming of the virtual aquatic creature by applying an aquatic creature motion algorithm to the created virtual aquatic creature, and to observe the virtual aquatic creature in which the swimming is implemented through a virtual aquarium. steps to provide
A virtual aquarium service providing method comprising:
According to claim 13,
The method of providing a virtual aquarium service further comprising providing information on the aquatic organisms to the user terminal based on the fish of the identified aquatic organisms.
15. The method of claim 14,
Wherein the virtual aquarium is implemented on a metaverse space.
According to claim 15,
Providing a community service between avatars of a plurality of users using the aquarium service on the metaverse space
Further comprising, a virtual aquarium service providing method.
In a user terminal receiving a virtual aquarium service for aquatic organisms captured through fishing activities,
a photographing unit for capturing an image of an aquatic creature using a camera;
a transmission unit for transmitting the photographed image of aquatic life to a virtual aquarium service providing server; and
Providing a virtual aquarium service that receives a virtual aquarium service from the virtual aquarium service providing server so that the virtual aquatic creature generated based on the image of the aquatic creature and the fish of the aquatic creature identified from the image can be viewed through the virtual aquarium. including wealth,
The fish of the aquatic creature is identified from the image of the aquatic creature using a fish identification model by the virtual aquarium service providing server,
In the virtual aquatic creature, an appearance of the aquatic creature is modeled based on a fish of the aquatic creature and an image of the aquatic creature,
The virtual aquarium service enables swimming of the virtual aquatic creature to be implemented by applying an aquatic creature motion algorithm to the created virtual aquatic creature, and allowing the swimming of the virtual aquatic creature to be observed through the virtual aquarium. person, user terminal.
18. The method of claim 17,
The user terminal further comprising a display unit for displaying the virtual aquatic creature in which the swimming and moving figures are implemented in the virtual aquarium through a display.
According to claim 18,
Further comprising an aquatic creature information provider receiving information on the aquatic creature identified based on the image of the aquatic creature from the virtual aquarium service providing server,
The user terminal, wherein the display unit further displays information on the virtual aquatic creature.
18. The method of claim 17,
Further comprising an input unit for receiving label information on the fish of the aquatic creature when a fish identification request message of the aquatic creature is received from the virtual aquarium service providing server,
The transmission unit transmits the input label information to the virtual aquarium service providing server, the user terminal.

Images