JP2023010868A - Control method and system for server - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method and a system for generating content by cooperation between users.

SOLUTION: A method to be realized by a computer includes the steps of: storing and managing information including content received from an electronic apparatus of a user by a server and a position relevant to generation of the content in a content database; setting a project for generating secondary content on the base of the position stored in the content database or a project generation request of the user; providing the project to an electronic apparatus of at least one user among users requesting for generation of the project, users selecting the project and users selected on the basis of the positions from the server; and using received primary content generated by the electronic apparatus on the basis of the project to generate the secondary content for the project.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2023,JPO&INPIT

Description

The following description relates to methods and systems for creating content through collaboration between users.

There is a conventional technique for generating secondary content using a plurality of contents individually generated by a plurality of users. For example, in the prior art, there is a technique that finds images of the same subject from images uploaded by a plurality of users, synchronizes the images, and generates and provides a three-dimensional image.

However, such a conventional technology has a problem that it requires a large amount of calculation because it needs to process all uploaded contents such as analysis and classification, and it is impossible to specify the result in advance. there were.

PCT/KR2014/010167 US2014/0019540A1 US20130/332543A1 US2013/0260893

Providing a specific user with a project generated at the request of the user or based on already received content, to induce this user to generate content based on the project, and By generating secondary content using the content generated in association with , the result can be specified in advance even in the project setting process, and the amount of calculation required to generate the result can be minimized. To provide a system and method that can

A computer-implemented method, comprising: storing and managing, at a server, content received from a user's electronic device and information including locations associated with generation of said content in a content database; setting a project for generating secondary content based on a location or a user's project generation request, selecting a user who requested the project generation, a user who selected the project, and the server based on the location; providing the project to an electronic device of at least one user among the users who received the project; and secondary content for the project using primary content generated and received by the electronic device based on the project. A computer-implemented method is provided, comprising the step of generating a .

A system including one or more processors, wherein the one or more processors stores and manages information in a content database, including content received from a user's electronic device and locations associated with generation of the content. a project setting unit that sets a project for generating secondary content based on the location stored in the content database or a user's project generation request; a user that requests the generation of the project; and selects the project. a project provider that provides the project to an electronic device of at least one of the user and the user selected based on the location; and a primary generated and received by the electronic device based on the project. A system is provided, comprising a secondary content generator that generates secondary content for the project using content.

Providing a specific user with a project generated at the request of the user or based on already received content, to induce this user to generate content based on the project, and By generating secondary content using the content generated in association with , the result can be specified in advance even in the project setting process, and the amount of calculation required to generate the result can be minimized. can.

1 is a diagram showing an example operating environment of a system for generating secondary content in an embodiment of the present invention; FIG. 1 is a block diagram for explaining internal configurations of an electronic device and a server in one embodiment of the present invention; FIG. FIG. 4 is a schematic diagram showing a process of generating secondary content in an embodiment of the present invention; FIG. 4 is a diagram for explaining a first example of assigning missions to users in one embodiment of the present invention; FIG. 4 is a diagram for explaining a second example of assigning missions to users in one embodiment of the present invention; FIG. 11 is a diagram for explaining a third example of assigning missions to users in one embodiment of the present invention; FIG. 12 is a diagram for explaining a fourth example of assigning missions to users in one embodiment of the present invention; FIG. 12 is a diagram for explaining a fifth example of assigning missions to users in one embodiment of the present invention; FIG. 20 is a diagram for explaining a sixth example of allocating missions to users in one embodiment of the present invention; FIG. 10 is a diagram showing an example of the process of editing a project in one embodiment of the present invention; FIG. 4 is a block diagram for explaining processors included in the server in one embodiment of the present invention; Figure 4 is a flowchart illustrating a method performed by a server in one embodiment of the present invention; FIG. 4 is a diagram showing an example of photographing the background at the same location in one embodiment of the present invention; FIG. 10 is a diagram showing an example of generating a panorama video using photographs taken at the same place in one embodiment of the present invention; FIG. 4 is a diagram showing an example of shooting for generating a 3D video in one embodiment of the present invention; FIG. 4 is a diagram showing an example of guiding a user to a shooting position in one embodiment of the present invention; FIG. 10 is a diagram showing an example of guiding a user to participate in a mission using a chat room in one embodiment of the present invention;

Embodiments will be described in detail below with reference to the accompanying drawings.

FIG. 1 is a diagram showing an example operating environment of a system for generating secondary content in one embodiment of the present invention. FIG. 1 is an example of an operating environment, showing multiple electronic devices 110 , 120 , 130 , 140 , multiple servers 150 , 160 and a network 170 .

Electronic devices 110, 120, 130, 140 may be fixed or mobile terminals implemented by computer systems. Examples of the electronic devices 110, 120, 130, and 140 include smart phones, mobile phones, navigation systems, computers, notebook pan controllers, digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), There are tablet PCs. Each such electronic device 110 , 120 , 130 , 140 may utilize wireless or wired communication schemes to communicate with other electronic devices and/or servers 150 , 160 via network 170 .

The communication method is not limited, and not only the communication method that utilizes the communication network that the network 170 can include (eg, mobile communication network, wired Internet, wireless Internet, broadcast network), but also the short distance between devices. Wireless communication may be included. For example, the network 170 includes a PAN (personal area network), a LAN (local area network), a CAN (campus area network), a MAN (metropolitan area network), a WAN (wide area network), a BBN (broadband network), and the Internet. It may include any one or more of the networks. Additionally, network 170 may include any one or more of network topologies including bus networks, star networks, ring networks, mesh networks, star-bus networks, tree or hierarchical networks, etc. It is not limited to this.

Each of servers 150, 160 may be implemented by a device or devices that communicate with electronic devices 110, 120, 130, 140 over network 170 to provide content for services. For example, the servers 150 and 160 may transmit codes to the electronic devices 110 and 120 to configure the screens of the electronic devices 110, 120, 130 and 140 according to requests from users using the electronic devices 110, 120, 130 and 140. , 130, 140, and the electronic devices 110, 120, 130, 140 may receive code provided by a program (eg, a browser or a specific application) included by the electronic devices 110, 120, 130, 140. Content may be provided to the user by using it to construct and display screens.

In yet another embodiment, the electronic devices 110, 120, 130, and 140 download and store data necessary for providing services in the servers 150 and 160 in advance, and store the stored data and the electronic devices 110 and 120. , 130 and 140 (for example, data input by the user and data measured by the electronic devices 110, 120, 130 and 140) are used to independently generate content for the service and provide it to the user. You may

FIG. 2 is a block diagram for explaining internal configurations of an electronic device and a server in one embodiment of the present invention.

Electronic device 110 and server 150 may include memory 211 , 221 , processors 212 , 222 , communication modules 213 , 223 and input/output interfaces 214 , 224 . The memories 211 and 221 are computer-readable recording media and include permanent mass storage devices such as RAM (random access memory), ROM (read only memory) and disk drives. good. The memories 211 and 221 may also store an operating system and at least one program code (eg, code for an application installed and running on the electrical device 110). Such software components may be loaded from a computer-readable medium separate from memories 211, 221 using a drive mechanism (not shown). Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD/CD-ROM drive, memory card, and the like. In other embodiments, software components may be loaded into memory 211, 221 using communication modules 213, 223 that are not computer-readable media. For example, at least one program may be loaded into memory 211 , 221 based on the program being installed by files provided by the developer over network 170 .

The processors 212, 222 may be configured to process computer program instructions by performing basic arithmetic, logic and input/output operations. Instructions may be provided to processors 212 , 222 by memory 211 , 221 or communication modules 213 , 223 . Processors 212 , 222 may be configured to execute program code stored in storage devices, such as memories 211 , 221 .

Communication modules 213 and 223 may provide functions for electronic device 110 and server 150 to communicate with each other via network 170, and for electronic device 110 and server 150 to communicate with other electronic devices or other servers. It may provide functionality for communication. As an example, under the control of the user, a request message generated by processor 212 of electronic device 110 may be communicated to server 150 via network 170 under the control of communication module 213 . Conversely, content provided by processor 222 of server 150 may be received by communication module 213 of electronic device 110 via communication module 223 and network 170 and transferred to processor 212 and memory 211 .

Input/output interfaces 214, 224 may be means for interfacing with a variety of input and output devices. For example, input devices may include devices such as keyboards or mice, and output devices may include devices such as displays for displaying applications and communication sessions of applications. As another example, the input/output interfaces 214, 224 may be means for interfacing with devices that integrate input and output functionality into one, such as a touch screen.

As a more specific example, when the processor 212 of the electronic device 110 processes the instructions of the computer program loaded in the memory 211, the service screen 215 configured using the data provided by the server 150 is input/output. It may be implemented to be displayed on a display through interface 214 .

Also, in other embodiments, electronic device 110 and server 150 may include many more components than those in FIG. However, most prior art components need not be explicitly shown in the figures. For example, the electronic device 110 may further include other components such as a display such as a touch screen, a transceiver, a GPS (Global Positioning System) module, a camera, and the like.

FIG. 3 is a schematic diagram showing the process of generating secondary content in an embodiment of the present invention. FIG. 3 shows a server 150 and a plurality of electronic devices 310, and briefly describes the process of generating secondary content from the server 150's point of view.

In step 1, server 150 may set up a project. As an example, server 150 may generate a project for generating secondary content. Such projects may include information about primary content that a user must create in order to generate secondary content. The server 150 may set (or generate) a project according to a specific user's request, or may set (or generate) the project automatically by analyzing the content already received by the server 150 .

For example, the server 150 may have the content database 320 and directly manage it, or while communicating with the content database 320 constructed outside the server 150 via a network, information about the content stored in the content database 320 may be obtained. may be obtained. In such a content database 320, each content received from a plurality of electronic devices 310 and the positions related to the creation thereof may be stored in correspondence with each other. For example, assume that an application related to a service provided by the server 150 is installed in each of the plurality of electronic devices 310 . When a plurality of electronic devices 310 generate content and transmit it to server 150 under the control of an application, the application confirms the GPS coordinate information of the electronic devices when the content was generated and transmits it to server 150 together with the content. may The server 150 may associate the received content and the GPS coordinate information with each other and store them in the content database 320 . Server 150 may then analyze the content stored in association with a particular location and generate a project associated with this location. For example, in the case of a photo spot in a famous tourist spot, many users will take a picture of a famous subject (such as a bronze statue) and upload it to the SNS server. Based on such information, a project or mission that instructs people (for example, 10 people) who pass by the area at regular time intervals to photograph the subject from different angles, using messenger chat rooms, etc. may be transmitted.

As another example, server 150 may receive a user's project setting request and generate a project according to the received project setting request. An application installed and running on each of the plurality of electronic devices 310 may control the plurality of electronic devices 310 to provide a user interface for inputting or selecting conditions for project setup. A user inputs or selects a condition using such a user interface so that the electronic device can transmit a project setting request to the server 150 under the control of the application.

In step 2, server 150 may serve the project. As an example, the server 150 sets the user's electronic device ("first electronic device", "third electronic device", and "nth electronic device" in the example of FIG. 3) associated with the set project. You can offer a project.

The users to whom the project is provided may be selected by various methods. For example, the server 150 may select a user who has selected a set project, a user selected by the server 150 (for example, a user located at the same location based on location information provided by an electronic device), and services related to the server 150. Users who have a personal relationship with each other in a social network service (SNS), for example, or communicate with each other through a single communication session (a chat room, for example) in a service associated with the server 150. Projects may be provided to users selected by various methods, such as users.

In step 3, server 150 may receive the primary content. As an example, an electronic device to which a project is provided (“first electronic device”, “third electronic device” and “nth electronic device” in the example of FIG. 3) generates primary content according to the project and sends it to the server. 150. At this time, the server 150 may receive the primary content transmitted by each electronic device.

As a more specific example, the project may include information about a specific place or a specific subject, and the primary content is a video shot at such a place or a video shot containing a specific subject. may contain. In this case, the server 150 may request (provision of a mission) the selected user by providing a project to shoot an image of a specific place or a specific subject. The user may shoot the video requested by the project as the primary content and send it from the electronic device to the server 150 .

In step 4, server 150 may generate secondary content. For example, the server 150 may synchronize the video received as the primary content and generate a 3D video (or animation video) or a panorama of the specific location or specific subject as the secondary content. For example, if a specific building is photographed from various angles by multiple cameras at the same time and/or at different times, each photograph taken can be synchronized to rotate 360 degrees around the building. Then, it becomes possible to generate a three-dimensional image that gives the effect of watching a moving image. Also, if multiple people take pictures of distant mountains from different angles, they can be combined to create a panoramic picture. Here, a project can be carried out by one person requesting the project at a specific location and carrying out missions at all angles, or multiple persons can carry out their assigned tasks without the need to carry out at the same time. You may perform your assigned task (photo/video capture, etc.) at any time from any angle you indicate. Also, when friends go out to a specific place, they may apply for a project together, receive assignments such as the shooting location and their own shooting angle, and shoot at that location. In addition, a user interface (UI) may be realized on the screen that displays the shooting position of each person in the form of a target when shooting is performed after the mission is assigned. The primary content may include a picture or text information directly drawn by the user, in addition to captured video (including moving images). For example, secondary content may be generated by linking pictures directly drawn by the user, or text information may be combined to generate a document explaining specific techniques or things as secondary content. Furthermore, when the primary content is still images (photographs), a plurality of photographs may be synthesized, and at the same time, a sound source (background music, voice, etc.) that is another type of primary content may be added. For example, in the case of background music, the server 150 may unilaterally select the background music, or the secondary content may be generated by adding background music using a sound source selected by the user. In this case, the project has a function to guide the user to draw a specific part of the overall picture, or to send text information containing explanations about specific techniques or things to the server 150. May contain information.

In addition, when a plurality of users shoot images at the same time, other users' shooting scenes may be displayed on a small screen. In this case, a chat window may be used to instruct another user to adjust the shooting position, or a map showing the current location and destination of the other user may be displayed.

As such, the server 150 sets a project for the secondary content to be generated, assigns the project to the selected user in the form of a mission, and provides the project based on the primary content generated according to the project. By generating the secondary content by using the server 150, the result to be generated can be predicted in advance, and there is no need to analyze all the contents received by the server 150 to generate one secondary content, Unnecessary computations can be reduced because secondary content can be generated using the received primary content according to the corresponding project.

FIG. 4 is a diagram for explaining a first example of assigning missions to users in one embodiment of the present invention. The server 150 may set up and maintain multiple projects 410 . Here, the first electronic device 420 may receive information about a plurality of projects 410 from the server 150 under the control of an application installed and running on the first electronic device 420 and select a desired project therefrom. For example, it is assumed that the user of first electronic device 420 selects "first project" from among a plurality of projects 410 as a desired project. In this case, the server 150 may provide the selected 'first project' to the first electronic device 420 to induce the user to generate and transmit the primary content. Here, the 'first project' may include information for guiding the user to create primary content lacking for the secondary content to be created according to the 'first project'. good. For example, when generating a three-dimensional image of a specific object, if there is no image from a specific angle, the information for guiding the user to generate an image from this angle is the "first project ” may be included in In other words, the project may include information for requesting missing content in the project selected by the user.

FIG. 5 is a diagram for explaining a second example of assigning missions to users in one embodiment of the present invention. Assume that after the first electronic device 420 selects 'first project' in FIG. 4, the second electronic device 510 also selects 'first project' in the same manner. At this time, the server 150 establishes a communication session between the first electronic device 420 and the second electronic device 510, and connects the user of the first electronic device 420 and the user of the second electronic device 510 to a group working on the same project. may be tied together as For example, the server 150 may create a chat room in which the user of the first electronic device 420 participates with the user of the second electronic device 510 and provide chat services between the two users. For this purpose, the application installed and running in the first electronic device 420 and the application installed and running in the second electronic device 510 may include at least a function for providing chat service.

A group chat service for three users may be provided when the "first project" is selected from yet another electronic device.

Also, the users may select different projects or no projects at all. For example, if another electronic device selects the 'second project', the server 150 may recommend the 'first project' selected by many users. As another example, a "first project" selected by a number of users may be recommended to the electronic devices of users who have not yet selected a project, thereby supporting user collaboration for the "first project." .

FIG. 6 is a diagram for explaining a third example of assigning missions to users in one embodiment of the present invention. FIG. 6 shows an example of providing a chat service using the chat room 610 to the first electronic device 420, the second electronic device 510, and the third electronic device 620 connected to the chat room 610 by connecting one communication session. ing.

In this case, server 150 sets a project for the users of first electronic device 420, second electronic device 510 and third electronic device 620 to may be provided to device 620. The user can generate content according to the project and upload it from the chat room 610 to the server 150 , and the server 150 can generate secondary content using the content uploaded to the chat room 610 .

As another embodiment, the server 150 may generate secondary content by collecting content arbitrarily uploaded by the user to the chat room 610 . For example, the server 150 may set, in the chat room 610 , a project in which secondary content is to be generated using the content uploaded to the chat room 610 . At this time, a project including guidance information regarding the automatic generation of such secondary content may be provided from the chat room 610 to the first electronic device 420 , the second electronic device 510 and the third electronic device 620 . At this time, even if the user does not have a separate intention to generate secondary content, the server 150 automatically generates secondary content using the content uploaded to the chat room 610, and the chat room 610 is generated. It may be used and provided to users (first electronic device 420, second electronic device 510, and third electronic device 620). For example, let's say that friends who traveled together share stories about their trips in a chat room and send each other photos taken at their travel destinations. At this time, the server 150 may automatically generate secondary content such as a slide show or animation by mixing the photos uploaded for transmission, and provide the secondary content to the user using the chat room.

In other embodiments, the project may include information for receiving confirmation from the user to allow such automatic generation of secondary content. At this time, if the user connected to the chat room 610 permits the automatic generation of the secondary content, the secondary content may be automatically generated using the content uploaded to the chat room 610 .

FIG. 7 is a diagram for explaining a fourth example of assigning missions to users in one embodiment of the present invention. If there is a friend-like personal relationship between the user of the first electronic device 420 and the user of the second electronic device 510 , the server 150 transfers the content uploaded by the first electronic device 420 to the second electronic device 510 . may be provided to For example, after the user of the first electronic device 420 uploads an image taken at a place A to the server 150, the user of the second electronic device 510 visits the place A, and the current position of the second electronic device 420 is determined to be the place A. In this case, the server 150 may provide the second electronic device 510 with the video captured at the location A by the user of the first electronic device 420 . In other words, it is possible to inform the user of the second electronic device 510 that the user of the first electronic device 420 has visited the corresponding place (place A) and where and what kind of picture was taken.

As another embodiment, the server 150 may provide the content uploaded by the first electronic device 420 to a chat room connected by the user of the first electronic device 420 and the user of the second electronic device 510 . Thus, it is possible to induce two users to converse about the same place (place A).

If necessary, the content uploaded by the first electronic device 420 is provided to the second electronic device 510, and even if the procedure for receiving permission from the user of the first electronic device 420 to share it is performed preferentially. good.

In this way, the server 150 is a service that allows users who have a personal relationship like friends to share with other users content uploaded through activities such as participating in a project. can be provided.

In addition, even if there is no separate personal relationship, the server 150 provides the user with primary content or secondary content generated by other users at the location where the user wants to shoot, and at the location where the user shoots. can also be recommended.

FIG. 8 is a diagram for explaining a fifth example of assigning missions to users in one embodiment of the present invention. A user of the first electronic device 420 may directly set up a project using functions provided by an application running on the first electronic device 420 . The server 150 may register a project set by the user of the first electronic device 420, provide the project to a user who meets the conditions of the set project, and request participation in the mission.

For example, the user of the first electronic device 420 witnesses a specific incident or accident (event, festival, natural disaster, traffic accident, etc.), generates a project for shooting a video related to the incident or accident, and sends the project to the server 150. Suppose you registered. Projects may then include locations related to specific incidents or accidents. In this case, the server 150 provides the project to other users (the user of the second electronic device 510 and the user of the third electronic device 620) who are present at the location of the locations included in the project, and the other users can A request may be made to take a picture of the accident and upload it to the server 150 . As another example, project settings may require input of textual information about a particular incident or accident, rather than just video.

When the content is uploaded from the second electronic device 510 and the third electronic device 620, the server 150 uses the content of the first electronic device 420, the second electronic device 510 and the third electronic device 620 to generate the secondary content. may be generated.

FIG. 9 is a diagram for explaining a sixth example of assigning missions to users in one embodiment of the present invention. FIG. 9 shows that a user (the user of the first electronic device 420, the second electronic device 510, and the third electronic device 620) who uploaded content to the server 150 from a specific location indicated by a dotted ellipse 910, the server 150 It shows an example of requesting participation in a project. At this time, the server 150 sets up a communication session between the users who have agreed to participate in the project (for example, connects the users to one chat room), and the content uploaded by the connected users through such a communication session. may be used to generate secondary content, and the generated secondary content may be provided to a user connected to an established communication session.

For example, if a number of users generate videos and upload them to the server 150 at the time and place of a particular incident or accident, the server 150 links such users into one chat room so that the users can The uploaded video may be used to generate secondary content about this incident or accident and distributed through the chat room. If primary content such as video or text information is insufficient, additional requests for the missing primary content may be made to other users of the location or users of the chat room. In other words, the server 150 sets a project (a project for missing primary content) based on the uploaded content and location, and the user or the server 150 communicates the project through one communication session (chat room). By providing this project to users selected from , they may be requested to generate and provide (upload to server 150) the missing primary content.

FIG. 10 is a diagram showing an example of the process of editing a project in one embodiment of the invention. The server 150 may present the configured projects 1010 to the first electronic device 420 as described with reference to FIG. A user of the first electronic device 420 may select a desired project (for example, the first project). At this time, the user of the first electronic device 420 may edit the selected project using the function of the application installed and running on the first electronic device. The edited project can be provided to the server 150 and registered as a new project. In this case, the user can more conveniently set up a customized project by editing an already set project rather than planning, generating, and registering the project from the beginning.

For example, for a project in which 10 users shoot one subject from different angles to generate secondary content, the condition of 10 users is increased to 15, or the subject is changed to another subject. It is possible to perform editing such as

When a user edits a project, server 150 may generate and send to first electronic device 420 expected content for the edited project. Such expected content may be generated from the content that the server 150 extracts from a content database (for example, the content database 320 in FIG. 3) that meets the conditions of the project. For example, if a specific secondary content shot and generated at a specific position is stored in the server 150, it is provided to the project participants in a preview form so that each participant can shoot the video from any position/angle. It can be used as a reference material for deciding whether it is good or it can be used as a reference for editing the project itself to suit one's taste.

Anticipated content may be generated when a user generates primary content according to a project. For example, when the user of the first electronic device 420 generates primary content according to a project and transmits it to the server 150, the server 150 may generate other content in the content database even if the content for generating secondary content is insufficient. The content (that meets the project requirements) and the first content can be used to generate and provide expected content.

An example of generating secondary content using video uploaded as primary content will be described below. In such an example, a description of the user's electronic device is omitted, but it is natural that communication between the user and server 150 takes place via the user's electronic device.

As an example, user A shoots a first image including the subject specified by the project and user B, and user B shoots a second image including the subject specified by the project and user A, and uploads them to the server 150. Suppose At this time, the server 150 may combine the first image and the second image to generate a third image in which both the user A and the user B are included as subjects, as secondary content. In this case, users A and B can obtain an image (third image) including all of the two users even if someone else does not shoot the two users.

As another example, the server 150 uses the first video including user A and user B and the second video including user C, and generates the third video in which user A or user B replaces user C as secondary content. may be generated as

As another example, a project is provided in which a specific user is set as a subject among users gathered in the same place, and the specific user set as the subject is guided to perform a specific action (for example, jump). Suppose At this time, the project may further include information for guiding other users to photograph a specific user designated as a subject from different angles and positions. Here, when images of a specific user photographed from different angles and positions are uploaded to the server 150, the server 150 uses the uploaded images to generate secondary content for the user set as the subject. You may

In addition, the server 150 provides a tick synchronization function when the user shoots the objects at the same time, uses automatic zoom-in when the distance between the object and the user is different, and compensates for this. The user may be provided with functions such as the ability to correct camera settings immediately. Here, such functions may be processed by controlling the electronic device by an application installed and driven in the user's electronic device according to the instructions provided by the server 150 .

For example, in a mission in which the user must simultaneously photograph objects, it is difficult for the user to simultaneously photograph the objects if the user directly performs photographing operations on the electronic device (by pressing the photographing button). Accordingly, the server 150 may send instructions to the user's electronic devices that are time-synchronized so that the user's electronic devices can start photographing at the same time (within a difference of, for example, 0.01 seconds). At this time, the electronic device can obtain an image of the subject simultaneously photographed by photographing at the same point in time according to the command received from the server 150 . Also, the video may be shot at a position determined for each user participating in the mission. At this time, the server 150 may control the electronic device to extract a still image at a specific point in time from the moving image and provide the extracted still image to the server 150 .

In addition, the server 150 may measure azimuth angle, position, etc. using image recognition, synchronize time between primary contents using voice recognition function, moving image recognition function, etc. Blur may be corrected by recognition or a 3D sound source may be generated and included in the secondary content.

Not only still images but also moving images may be used as primary contents, and secondary contents for images include camera shake correction, HDR (High Dynamic Range), 60fps video, GIF animation, 360-degree camera image, zoom, and camera rotation. It may be an image in which an effect or the like is reflected. For example, blurry footage caused by camera shake can be compensated for by other similar footage, or frames can be combined for at least part of a video captured by multiple cameras to provide a slow-motion video effect. is. Furthermore, it may include content that is completed by predicting and supplementing intermediate frames of vacant positions/angles that have not been shot, and may include cases where videos with different attributes at the time of shooting are integrated. . For example, when shooting at night, the background with light is shot with low exposure, so it is expressed as dark as possible, and the subject is shot with high exposure. Contents may be produced (HDR (High Dynamic Range effect)), and secondary contents may be produced that make the person stand out from the background due to the difference in aperture. Alternatively, moving images captured by a plurality of cameras may be combined to produce secondary content in which the first portion is played back in slow motion and the second half of the video is played back at the original speed. Furthermore, if different types of cameras are used for shooting, corrections may be made to match the mutual characteristics. In addition, an obstacle included in the image may be erased using another image, or a blurred part may be corrected using another image.

An example function of an application that is installed and driven in a user's electronic device will be described below.

As an example, if a project includes missions for filming from specific angles and positions, the application may include functionality for providing information that allows the user to grasp such angles and positions. In other words, the user may be provided with information indicating how and in which direction the user should move (directions, landmarks, etc. displayed on the camera screen).

As another example, the application may provide information about the angle and position of the next shot when the user creates an image by shooting from a particular angle and position.

As yet another example, the application may provide information regarding what content should be added to previously uploaded content to generate secondary content. For example, in a project that requires 10 images of an object taken from 10 different angles, if there is no image of an object taken from one angle, the application will prompt the user to take an image of the object from this angle. may be induced to do so.

Furthermore, as described above, the application may further include functions for receiving chat services with other users using chat rooms, and for receiving social network services. Chat services and social network services may be provided by server 150 .

FIG. 11 is a block diagram illustrating a processor included in a server in one embodiment of the invention, and FIG. 12 is a flowchart illustrating a method performed by the server in one embodiment of the invention. The processor 222 included in the server 150 may include a content manager 1110, a project setter 1120, a project provider 1130, and a secondary content generator 1140, as shown in FIG. Such components of processor 222 may be implemented to perform steps 1210-1240 of the method of FIG. 12 through an operating system and at least one program code that memory 221 contains.

In step 1210, the content management unit 1110 may store and manage information including the content received from the user's electronic device in the server 150 and the location associated with the creation of the content in the content database. For example, the primary content received according to a previously set project is correlated with the location associated with the generation of this primary content (for example, the GPS coordinates of the electronic device at the time the primary content was generated). May be stored in database. As noted above, the content database may be implemented to be contained within server 150 or may be implemented external to server 150 and in communication with server 150 .

In step 1220, the project setting unit 1120 may set a project for generating secondary content according to a location stored in the content database or a user's project generation request. For example, a project may be automatically generated by the server 150, or may be generated based on a user's request.

In operation 1230, the project providing unit 1130 provides the project to the electronic device of at least one of the user who requested the creation of the project, the user who selected the project, and the user selected based on the location in the server 150. may

For example, users who have selected a project may include users who have selected the same project among projects provided by the server 150 . Server 150 may also select users of electronic devices located at specific locations based on location. Here, the server 150 is a user with whom a personal relationship (eg, a friend relationship in a social network service) is established with a service related to the server 150 (eg, a social network service), or a user associated with the server 150 . Among users who communicate with each other (users connecting to the same chat room and A user may be selected based on location). The project providing unit 1130 may provide the project to various groups of users according to the nature of the project.

In step 1240, the secondary content generator 1140 may generate secondary content for the project using the received primary content generated by the electronic device based on the project. In other words, when the user generates and transmits the primary content on the electronic device based on the project, the secondary content generator may generate the secondary content using the transmitted primary content.

For example, primary content may include video associated with a location that the project includes or a subject that the project specifies. In this case, the secondary content generation unit 1140 may generate at least one of the panorama image, the 3D image, and the animation image as the second content by synchronizing the images. Also, at least one of the primary contents may further include a sound source and information about the sound source. In this case, the secondary content generation unit 1140 may generate the secondary content by adding the received sound source or the sound source obtained from the received sound source information to at least one video generated by synchronizing the video. . The server 150 may select a specific sound source and add it to the video even if the primary content does not provide the sound source or information about the sound source.

In another embodiment, the secondary content generation unit 1140 generates the secondary content using the primary content and the content retrieved from the content database based on the location associated with the generation of the primary content in step 1240. You may For example, content generated at different times for one project may be stored in the content database, and similar content based on other projects, not the project in question, may be uploaded in advance and stored in the content database. may have been Therefore, the secondary content generation unit 1140 may generate secondary content using the content stored in the content database.

Services associated with the server 150 (for example, the chat service and social network service described above) may be provided to users from applications (for example, messenger applications, SNS applications, etc.) driven by electronic devices. Here, a project is pushed by an electronic device through such an application, or provided through a corresponding communication session to an electronic device connected to a communication session (for example, a chat room of a chat service) under the control of the application. may be

In yet another embodiment, a project may include a mission to generate content that is insufficient to generate secondary content using content stored in a content database. Here, in step 1230, the project providing unit 1130 may transmit the project to the electronic device of the first user who has selected the project, and request generation of the missing content. For example, the project according to the present embodiment may be information requesting the user for content that is required to generate secondary content in the current content database. As a more specific example, when user A selects the type of work (secondary media) he or she wants to create, the server 150 generates this work from content stored in the content database (existing content uploaded by the user). A missing part (content) can be found and assigned to user A as a mission.

In yet another embodiment, the project providing unit 1130 may provide the project to the electronic devices of the users who have selected the same project in step 1230, and establish a communication session between the electronic devices of the users who have selected the same project. good. For example, if user A and user B select the same project to create the same type of work, server 150 provides this project to user A's electronic device and user B's electronic device, and user A and user B A chat room may be set up to connect the two users. In this way, the server 150 creates a chat room for users who want to work on the same project and connects the users, so that even users who do not know each other can easily work on the same project. We can support so that it is possible to collaborate with

In yet another embodiment, the method of FIG. 12 comprises determining if the primary content of the first user provided with the first project is the content needed by the second user provided with the second project ( not shown) and if the first user's primary content is the content required by the second user, the first user's primary content is provided to the second user's electronic device and used as the content for the second project. A sharing step (not shown) may also be included. A content sharing unit (not shown), which processor 222 may further include, may perform steps not shown in the figures according to the present embodiment. In this way, even if the content is generated by users working on different projects, mutually necessary content can be shared among the users.

In yet another embodiment, a project may include a mission for users communicating with each other via a single communication session to generate secondary content using content uploaded to the single communication session. In this case, the secondary content generator 1140 may generate the secondary content using the content uploaded in one communication session as the first content in step 1240 . For example, when User A, User B, and User C, who have traveled together or are currently traveling together, upload their travel photos in a chat room to share them, the server 150 allows the chat room participants to upload photos. Secondary content may be generated using the content obtained. Here, even if the uploaded travel photos are not related photos, by mixing the photos shared in the chat room, secondary content such as travel stories can be generated and provided.

In still another embodiment, it is assumed that the first content includes a first image that includes both the subject and the first user specified by the project and a second image that includes both the subject and the second user. . Here, in step 1240, the secondary content generation unit 1140 combines the first image and the second image to generate the third image including the subject, the first user, and the second user as the second content. You may For example, a first user and a second user who took pictures of the same subject on different trips, respectively, can provide a synthesized picture as if they went on a trip together, as the secondary content.

In still another embodiment, it is assumed that the first content includes a first image including a subject designated by the project and a second image including the photographer of the first image. Here, in step 1240, the secondary content generator 1140 may generate a third image including the subject and the photographer by synthesizing the first image and the second image. For example, when a first user generates a video of a subject and a second user generates a video of the first user, the secondary content generation unit 1140 synthesizes the two videos so that the subject is also captured. A video may be generated that also includes the first user.

In still another embodiment, the project may include information about a shooting location or subject, and the first content may include a video shot at the location or a video of the subject. Here, the method of FIG. 12 generates information about a recommended shooting position or a recommended shooting angle for a corresponding place or a corresponding object based on the content stored in the content database, and transmits the information to the user provided with the project. (not shown). For example, even if the user is provided with information for recommending from which position or angle the user should shoot based on primary content or secondary content that has already been generated at the same position as the user's position. good. A recommendation provider (not shown), which processor 222 may further include, may perform steps not shown in the figures according to the present embodiment.

As yet another embodiment, the method of FIG. 12 comprises extracting content from a content database (not shown) based on a location associated with generation of primary content received from a first user; A step (not shown) of generating expected content for the secondary content using the next content and providing the content to the first user may be further included. For example, when a user creates content, the server 150 may use existing content to predict the result and provide the user with a function such as a preview. A predictive content generator (not shown), which processor 222 may further include, may perform steps not shown in the figures according to the present embodiment.

In yet another embodiment, the project may include secondary content generated with the participation of the first user. Here, in step 1230, the project providing unit 1130 may provide the project to the second user who has a personal relationship with the first user in the service associated with the server 150. FIG. In this case, the secondary content generated with the participation of the first user may be provided to the second user.

As still another embodiment, the first content may include a first image including the first user and the second user and a second image including the third user. Here, in step 1240, the secondary content generator 1140 combines the first image and the second image to generate the third image in which the first user or the second user is changed to the third user. good too.

In yet another embodiment, the project setting unit 1120 receives a project creation request including the first user's content and a location related to the creation of the first user's content from the first user's electronic device and sets the project. may Here, the project providing unit 1130 may provide the project to the selected user based on the location related to the creation of the content of the first user. For example, when a user takes a video about a specific incident or accident and requests the generation of a project, a user who is in a position related to the incident or accident can be requested to generate a video related to the incident or accident.

In yet another embodiment, a project may be set up with information for requesting participation in a mission to users who have uploaded content at the same location within a certain period of time. Here, in step 1240, the secondary content generator 1140 uses, as the primary content, the content received from the electronic device of the user permitted to participate in the mission in response to the information for requesting participation in the mission. may be used to generate secondary content. For example, if a user uploads content at a similar time in a specific location due to a specific incident or accident, the uploaded content can be used to generate secondary content related to the incident or accident.

In still another embodiment, the primary content may include images of locations included in the project or subjects specified by the project, which are captured from different positions or different angles. Here, in the method of FIG. 12, if there is no video at the position required to generate the secondary content or the video from the angle required to generate the secondary content is insufficient, Sending a new project containing information about a required position or a required angle to a located electronic device to request a video, or sending a new video to a user's electronic device participating in a communication session of a service related to the server 150. A step of sending a project and requesting a video (not shown) may be further included. In this way, when materials (primary contents) for generating secondary contents are insufficient, the user can be requested to generate and provide the insufficient materials. Non-illustrated steps according to the present embodiment may be performed by an image requester (not shown), which processor 222 may further include.

In yet another embodiment, the project providing unit 1130, in step 1230, among the user's electronic devices with which a personal relationship is established in a service related to the server 150, the electronic devices are located at the same place based on the current location of the electronic devices. A project may be sent to the located electronic device. At this time, the transmitted project includes information for designating at least one of the users of the electronic devices located at the same location as the subject, action information required of the user designated as the subject, and information on the actions of the remaining users. Information about the angle or position for photographing the user designated as the subject may also be included. For example, it is possible to provide a user with a project for obtaining a video image of a specific user among users in the same location. As another example, at the moment when the user designated as the subject performs a predetermined action (for example, jumping), the remaining users can simultaneously provide a mission to photograph the user designated as the subject. . For this purpose, information regarding the positions of other users, shooting angles, etc. may be provided to the users through the project.

In yet another embodiment, an application running on each electronic device may be provided with the ability to edit the project. Here, in step 1220, the project setting unit 1120 may use the function to receive the project edited by the first user's electronic device and set a new project. Also, the method of FIG. 12 includes steps (not shown) of extracting content corresponding to a new project from a content database, generating expected content, and providing the generated expected content to the electronic device of the first user. It may contain further. In this manner, a user may edit an existing project to create a new project, and the server 150 may provide the user with the results of the edited project in preview form. A predicted content generator (not shown), which processor 222 may further include, may perform steps not shown in the figures according to the present embodiment.

As yet another example, a project may include a mission to photograph one subject at a time. In this case, the method of FIG. 12 may further include a step (not shown) of providing a photographing command with a synchronized photographing time to electronic devices of users participating in the mission. Here, the electronic device may generate an image of the subject at the same point in time by executing the shooting at the synchronized shooting point in time according to the shooting command received from the server 150 . A photographing command provider (not shown), which the processor 222 may further include, may perform steps not shown in the figures according to the present embodiment.

FIG. 13 is a diagram showing an example of photographing the background at the same place in one embodiment of the present invention, and FIG. FIG. 4 is a diagram showing an example of generating a panorama video;

FIG. 13 shows an example in which three smartphones 1310, 1320, and 1330 shoot the background at the same place. The three smartphones 1310, 1320, and 1330 may shoot the background according to the mission provided by the same project at the same time, or at different times (different hours, days, weeks, months, years). ), the background may be photographed. Furthermore, the background may be personally photographed regardless of the project.

In FIG. 14, photographs 1410, 1420, and 1430 taken by three smartphones 1310, 1320, and 1330 are uploaded to the server 150, and the server 150 uses the uploaded photographs 1410, 1420, and 1430 to create one panorama photograph 1440. shows an example of generating Such a panorama photograph 1440 may be generated as secondary content for a project when the photographs 1410, 1420, 1430 are associated with the project. Also, even if it is not a secondary content of a specific project, it may be generated and provided to other users for reference (anticipated content provided to other users at the location).

FIG. 15 is a diagram showing an example of shooting for generating a 3D video in one embodiment of the present invention. FIG. 15 shows how a plurality of smartphones 1521 to 1528 photograph one subject 1510 from a certain angle. As an example, a project provided to a plurality of smartphones 1521 to 1528 may include a mission to photograph subject 1510 and may include information regarding the position (angle) at which subject 1510 is photographed. As a specific example, eight locations for eight users may be included in a project. Here, the shooting position for each user may be designated in advance by the server 150, or individual shooting positions may be determined through consultation between users. Photos taken with a plurality of smartphones 1521 to 1528 may be transmitted to the server 150 as primary content, and the server 150 uses the transmitted photos to transmit secondary content such as a 3D image of the subject 1510. may be generated.

As described above, when a plurality of smartphones 1521 to 1528 must shoot the subject 1510 at the same time, the user can directly perform shuttering (an operation for shooting the smartphones 1521 to 1528 (screen touch, etc.)). Then, it is difficult to photograph the object 1510 at the same time. Therefore, even if the server 150 transmits a command in which shooting times are synchronized to the plurality of smartphones 1521 to 1528, and controls the plurality of smartphones 1521 to 1528 to shoot the subject 1510 at the same time at the synchronized time points. good.

FIG. 16 is a diagram showing an example of guiding the user to the shooting position in one embodiment of the present invention. For example, the server 150 may guide the user to move to the shooting position by using position information (eg, GPS coordinates) received from the user's terminal. For example, the server 150 may transmit information to the user's terminal to guide the user to move to the shooting location. Here, the application installed in the user's terminal may control the terminal so that the information received from the server 150 is displayed on the display of the terminal as indicated by the first dotted line box 1610 . When the user is positioned at the shooting position intended by the user, the server 150 transmits information to the user's terminal to guide the user to shoot at that position, as indicated by a second dotted line box 1620 . good too. Similarly, an application installed on the user's terminal may control the terminal to display information received from the server 150 on the terminal's display, as indicated by the second dashed box 1620 . good.

Here, the confirmation of the user's position may utilize information input from the camera of the terminal in addition to the GPS coordinates. For example, it is assumed that an image of a subject taken by the user with the camera of the terminal is transmitted to the server 150 under the control of the application. At this time, the server 150 may analyze the transmitted image of the subject and determine whether the image of the subject from another angle is necessary. If an image of the subject from another angle is requested to generate secondary content, the server 150 may guide the movement of the user to photograph the subject from the corresponding angle.

As a technique for guiding the user to the shooting position, map information or the like may be used as in navigation.

FIG. 17 is a diagram showing an example of guiding a user to participate in a mission using a chat room in one embodiment of the present invention. FIG. 17 shows an example screen 1700 for guiding users connected to the group chat room to participate in the shooting mission by using the group chat room. In other words, FIG. 17 illustrates an example where projects are sent to users communicating in the same communication session. Here, if there is a user who has expressed his or her intention to shoot, the server 150 may provide the user with specific information for proceeding with such a project. In addition, if the number of users who have expressed their intention to shoot is insufficient to generate secondary content for the project, the same user may be requested to provide a plurality of primary contents. Other users may be further selected and encouraged to participate in the project.

As described above, according to an embodiment of the present invention, a project generated according to a user's request or a project generated based on previously received content is provided to a specific user, and the user generates content according to the project. By guiding the user to create the secondary content using the content generated in relation to the project, the result can be specified in advance even in the process of setting the project, and the content necessary for generating the result can be specified in advance. can be minimized.

The apparatus described above may be realized by hardware components, software components, and/or a combination of hardware and software components. For example, the devices and components described in the embodiments may include, for example, processors, controllers, arithmetic logic units (ALUs), digital signal processors (microcomputers), field programmable gate arrays (FPAs), programmable gate arrays (PLUs), may be implemented using one or more general purpose or special purpose computers, such as logic units, microprocessors, or various devices capable of executing instructions and responding to instructions. A processing unit may run an operating system (OS) and one or more software applications that run on the OS. The processing unit may also access, store, manipulate, process and generate data in response to executing software. For convenience of understanding, a single processing device may be described as being used, but those skilled in the art will appreciate that a processing device may include multiple processing elements and/or multiple types of processing elements. You can understand that it's okay. For example, a processing unit may include multiple processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

Software may include computer programs, code, instructions, or a combination of one or more of these, to configure a processing device to operate at will or independently or collectively to operate a processing device. You can give orders to Software and/or data may refer to any kind of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted on or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in the transmitted signal wave. The software may be distributed over computer systems connected by a network so that they are stored and executed in a distributed fashion. The software and data may be stored on one or more computer readable media.

The method according to the embodiments may be embodied in the form of program instructions executable by various computer means and recorded on a computer readable medium. The computer-readable media may include program instructions, data files, data structures, etc. singly or in combination. The program instructions recorded on the medium may be those specially designed and constructed for an embodiment, or they may be of the kind known and available to those of skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language code that is executed by a computer, such as using an interpreter, as well as machine language code, such as that generated by a compiler. The hardware devices described above may be configured to act as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, the embodiments have been described based on the limited embodiments and drawings, but those skilled in the art can make various modifications and variations based on the above description. For example, the techniques described may be performed in a different order than in the manner described and/or components such as systems, structures, devices, circuits, etc. described may be performed in a manner different from the manner described. Appropriate results may be achieved when combined or combined, opposed or substituted by other elements or equivalents.

Accordingly, different embodiments that are equivalent to the claims should still fall within the scope of the appended claims.

110, 120, 130: electronic equipment 150, 160: server 170: network

Claims (18)

A storing step of correlating primary content received from a user's terminal with information about a location related to generation of the primary content and storing the information in a content database, wherein the location is a location related to a specific event. , a storage step;
A generating step of generating secondary content using a plurality of primary contents received from a plurality of terminals, wherein a location associated with each of the plurality of primary contents is a location associated with the specific event. a production step that is
a setting step of setting up a project, wherein the project asks one or more users to provide missing primary content to generate the secondary content;
How to control servers including . 2. The method of claim 1, comprising distributing the secondary content to a group including the terminal of the user that sent the primary content. 3. The method of claim 2, wherein the distributing step connects the group to the same chat room and transmits the project data to the chat room. The generating step of generating the secondary content includes:
2. The method of claim 1, wherein at least one of a panoramic video, a 3D video and an animated video is generated as the secondary content by synchronizing video. The project includes a mission to generate content lacking in generating the secondary content using the content stored in the content database;
The delivery step includes
4. The method according to claim 3, characterized by sending data of the project to the group and requesting generation of the missing content. an extracting step of extracting content from the content database based on locations associated with primary content received from a first user;
a second distribution step of generating expected content for the secondary content using the extracted content and the primary content and transmitting the content to the first user;
4. The method of claim 3, further comprising: the project includes secondary content generated with the participation of the first user;
The delivery step includes
4. The method of claim 3, characterized by transmitting the project data to a second user with whom the first user has a personal relationship established in a service associated with the server. The project is set including information for requesting users belonging to the group to participate in a mission,
The generating step of generating the secondary content includes:
The secondary content is generated by using, as the primary content, content received from a terminal of a user permitted to participate in the mission in response to information for requesting participation in the mission. 6. The method of claim 5, wherein The primary content includes images of locations included in the project or subjects specified by the project taken from different positions or different angles;
If the image at the position required for generating the secondary content or the image from the angle required for generating the secondary content does not exist or is insufficient, the terminal located at the location 6. The method of claim 5, further comprising a requesting step of sending data of a new project including information on position or said required angle and requesting images. A program which, when executed by a server, causes said server to:
a storage step of correlating primary content received from a user's terminal with information about a location related to generation of the primary content and storing it in a content database, wherein the location is a location related to a specific event; a preservation process;
A generating step of generating secondary content using a plurality of primary contents received from a plurality of terminals, wherein a location associated with each of the plurality of primary contents is a location associated with the specific event. a production step that is
a setting step of setting up a project, wherein the project asks one or more users to provide missing primary content to generate the secondary content;
program, including to the server, further comprising:
11. The program according to claim 10, causing execution of a distribution step of distributing the secondary content to a group including the terminal of the user who transmitted the primary content. 12. The program according to claim 11, wherein said distributing step connects said group to the same chat room and transmits said project data to said chat room. The generating step of generating the secondary content includes:
11. The program according to claim 10, wherein at least one of a panorama image, a three-dimensional image and an animation image is generated as the secondary content by synchronizing the images. The project includes a mission to generate content lacking in generating the secondary content using the content stored in the content database;
The delivery step includes
13. The program according to claim 12, further comprising sending data of the project to the group and requesting generation of the missing content. to the server, further comprising:
an extracting step of extracting content from the content database based on locations associated with primary content received from a first user;
a second distribution step of generating expected content for the secondary content using the extracted content and the primary content and transmitting the content to the first user;
13. The program according to claim 12, causing the execution of the project includes secondary content generated with the participation of the first user;
The delivery step includes
13. The program according to claim 12, wherein the project data is sent to a second user with whom the first user has a personal relationship in a service associated with the server. The project is set including information for requesting users belonging to the group to participate in a mission,
The generating step of generating the secondary content includes:
The secondary content is generated by using, as the primary content, content received from a terminal of a user permitted to participate in the mission in response to information for requesting participation in the mission. 15. The program of claim 14, wherein: The primary content includes images of locations included in the project or subjects specified by the project taken from different positions or different angles;
to the server, further comprising:
If the image at the position required for generating the secondary content or the image from the angle required for generating the secondary content does not exist or is insufficient, the terminal located at the location 15. The program according to claim 14, causing a request step to send data of a new project including information on position or said required angle to request a video.

Images