KR102172588B1 - Moving picture album production method and system for exhibition hall spectator - Google Patents

Abstract

According to one aspect of the present invention, a method for producing a video album for an exhibition hall visitor comprises the steps of: filming a video in an exhibition space; storing the filmed video in a video database; and linking photos to the filmed video. The photos linked to the filmed video is recognized through a portable terminal, so that the linked video is played.

Description

Video album production method and system for exhibition hall visitors {MOVING PICTURE ALBUM PRODUCTION METHOD AND SYSTEM FOR EXHIBITION HALL SPECTATOR}

The present invention relates to a method and system for producing a video album for visitors to an exhibition hall, and specifically, to an exhibition hall visitor capable of linking a video filmed in an exhibition hall and related to a visitor's photo and reproducing the linked video according to the recognition of the photo. It relates to a method and system for producing a video album for.

Recently, as it becomes easier to collect and produce videos, there are increasing attempts to facilitate access to specific videos through mediators such as QR codes. When the QR code is recognized through the smartphone, the smartphone searches and plays the video associated with the QR code. Recognizing the QR code and playing the video corresponding to it is performed by recognizing the QR code on the smartphone, recognizing the video address displayed in the QR code, and playing the video provided by requesting the video providing server.

Video playback via QR code can be applied in exhibition halls such as science museums, museums, and art galleries. That is, when a QR code is displayed at a location adjacent to a specific exhibition object and the QR code is recognized by a visitor's smartphone, a video related to the specific exhibition object may be output.

Video playback using this medium can easily play a specific video, but there is a limit to its use. Since the QR code is composed of an image code that the user does not recognize, there is a limit in which it is impossible to immediately know which video is a related video.

Instead, playing a video through a photo can provide new services in various fields. For example, if a video album is provided by taking a video of a visitor while visiting an exhibition hall and matching the video with a photo of the visitor or a photo of an exhibit, various fun and memories can be provided to the visitor.

As described above, there is a need for a method and system for producing a video album for visitors to an exhibition hall that can provide various services through photos, out of the limit of video playback through the existing QR code.

The present invention has been conceived to solve the above-described problems, and provides a method and system for producing a video album for visitors to an exhibition hall to link a video taken in an exhibition hall to a photo and to play the video taken in accordance with the recognition of the photo. It has its purpose.

In addition, an object of the present invention is to provide a method and system for producing a video album for visitors to an exhibition hall to recommend a video related to a visitor when producing a video album by linking an identifier of a visitor's portable terminal with a video. .

In addition, the present invention is to provide a method and system for producing a video album for exhibitors capable of playing a corresponding video when a photo is recognized by a portable terminal and continuously playing the video according to a playback mode set according to a touch input. There is this.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those of ordinary skill in the technical field to which the present invention belongs from the following description. I will be able to.

A method for producing a video album according to an aspect of the present invention includes the steps of: a camera photographing a video in an exhibition space; Storing, by the management server, the captured video in a video database; And linking, by a video album production device, a photo to the captured video, wherein a photo associated with the captured video is recognized through the portable terminal, and the associated video is played.

In addition, a method for producing a video album according to an aspect of the present invention includes the steps of: a camera photographing a video in an exhibition space; Collecting at least one portable terminal information including an identifier of the portable terminal by a wireless signal repeater; Mapping, by the management server, the captured video and information on one or more portable terminals and storing them in a video database; Recommending, by the video album production device, one or more videos from among the videos taken by using the identifier of the portable terminal; And linking, by the video album production device, the photo to the selected video.

In the above-described method for producing a video album, the camera is a camera of a portable terminal, a fixed camera installed in an exhibition space, or a camera installed in a robot moving the exhibition space.

In the above-described video album production method, the step of collecting the portable terminal information includes collecting MAC addresses of one or more portable terminals from a probe signal transmitted from the portable terminal during video recording, and recommending the one or more videos. In the step of doing so, the video database is searched using the identifier of the portable terminal recognized by the video album production device, and a video mapped to the identifier of the portable terminal is recommended.

In the above-described video album production method, in the step of linking a photo to the video, a photo selected by a user and a video are mapped and stored in a photo-video database.

In the above-described method for producing a video album, in the step of recommending the one or more videos, a face of a user creating a video album is recognized, and at least one video including a face recognized in a video database is recommended.

In the above-described video album production method, the method comprising: recognizing, by a portable terminal, a picture of a printed video album; And searching, by the portable terminal, a video corresponding to the recognized picture and reproducing the searched video.

In the above-described video album production method, in the step of playing the video, if the photo is not recognized during video playback in the first mode, the video playback is stopped, and the video is being played in a second mode set according to a user's touch input. The video continues to play even if the picture is not recognized.

In addition, a video album production apparatus according to an aspect of the present invention includes a display unit for displaying an image; An input unit for receiving a user input; And a control unit that recommends one or more of the videos captured in the video database by using the identifier of the user's portable terminal through the display unit, and stores the video and the video selected through the input unit in the photo-video database.

In the above-described video album production device, the controller searches a video database using a MAC address of a user's portable terminal, and recommends one or more videos mapped to and stored in the MAC address through the display unit.

In the above-described video album production device, the controller recognizes a face of a video album production user and recommends one or more videos including faces recognized in a video database.

In addition, a video album production system according to an aspect of the present invention includes the video album production device; A camera for taking a video in the exhibition space; And a management server that stores the captured video in a video database.

In the video album production system described above, a wireless signal repeater for collecting one or more portable terminal information including an identifier of the portable terminal; further comprising, the wireless signal repeater is one from a probe signal transmitted from the portable terminal during video recording. The MAC address of the portable terminal is collected, and the video album production device searches a video database using the recognized MAC address of the portable terminal, and recommends a video mapped to an identifier of the portable terminal.

In the video album production system as described above, the portable terminal further comprises a portable terminal for recognizing a picture of a printed video album, wherein the portable terminal for searching for a video corresponding to the recognized picture and playing the searched video, in a first mode If a photo is not recognized during video playback, the video playback is stopped, and the video being played in the second mode set according to the user's touch input is continuously played even when the photo is not recognized.

In addition, a download server for storing a video album production program according to an aspect of the present invention includes: a communication module for receiving a download request and transmitting a program corresponding to the download request; A storage module for storing the video album production program; And a control module for transmitting a video album production program stored in the storage module to a communication module in response to a download request of the video album production program through the communication module, wherein the video album production program Recommending one or more of the videos taken in the exhibition space using an identifier of the portable terminal; And linking, by the video album production device, a photo to the selected video.

The method and system for producing a video album for visitors to an exhibition hall according to the present invention as described above has an effect of linking a video taken in an exhibition hall to a photo and reproducing the captured video according to the recognition of the photo.

In addition, the method and system for producing a video album for visitors to an exhibition hall according to the present invention have the effect of linking the video with the identifier of the portable terminal possessed by the visitor to recommend a video related to the audience when producing the video album. have.

In addition, the method and system for producing a video album for visitors to an exhibition hall according to the present invention as described above has the effect of playing a corresponding video when a photo is recognized by a portable terminal, and continuously playing the video according to a playback mode set according to a touch input. There is.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those of ordinary skill in the art from the following description. will be.

1 is a diagram showing an example of a connection configuration between exemplary devices of a system for producing a video album for visitors to an exhibition hall according to the present invention.
2 is a diagram illustrating an exemplary block diagram of a video album production device.
FIG. 3 is a diagram illustrating a series of processes for producing a video album and playing a video linked to a photo of the produced video album.
4 is a diagram illustrating different video playback methods according to the video playback mode.

The above-described objects, features, and advantages will become more apparent through the detailed description that will be described later in detail with reference to the accompanying drawings, and accordingly, those of ordinary skill in the art to which the present invention pertains will understand the technical idea of the present invention. It will be easy to implement. In addition, in describing the present invention, when it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram showing an example of a connection configuration between exemplary devices of a system for producing a video album for visitors to an exhibition hall according to the present invention.

As shown in the example of FIG. 1, a video album production system for visitors to an exhibition hall includes a video album production device 100, a camera 200, a wireless signal repeater 300, a portable terminal 400, and a management server 500, and downloads A server 600 may be further included.

The video album production system according to the present invention is applied to exhibition halls (exhibition spaces) such as science museums, museums, art galleries, etc. to create a video album by linking the videos taken in the exhibition space with the photos of the visitors or the photos selected by the visitors, and It is a system capable of playing back a video corresponding to the recognition of a printed picture on the portable terminal 400 or the like.

Briefly looking at each device, the camera 200 is installed in the exhibition space to capture a video of an image exposed through a lens. A plurality of cameras 200 may be installed in the exhibition space. For example, the camera 200 may be fixedly installed at a location in the exhibition hall where one or a plurality of exhibits can be photographed. Alternatively, the camera 200 may be a movable camera installed on a robot that autonomously moves in the exhibition space. In addition, the camera 200 for photographing a video may be a camera installed in the portable terminal 400 carried by a user (visitor).

At least, the camera 200 captures an image exposed through a lens in the exhibition space as a video while being fixed or moving.

The wireless signal repeater 300 may convert a communication packet received from a wired/wireless network and transmit it as a wireless signal in the exhibition space or recognize a communication packet of a wireless signal in the exhibition space and transmit the communication packet to a wired/wireless network. . The wireless signal repeater 300 is a device for connecting a short-range wireless network to an external network, and may be, for example, a wireless access point (AP) connected for Wi-Fi.

The wireless signal repeater 300 according to the present invention collects information on the portable terminal 400 that can be recognized through a short-range wireless network (eg, Wi-Fi). For example, by recognizing a probe signal transmitted from the portable terminal 400, information on one or more recognizable portable terminals 400 is collected.

The portable terminal information may include at least the identifier of the portable terminal 400 included in the probe signal and further include signal strength. The identifier of the portable terminal 400 may be, for example, a MAC address.

In this way, the wireless signal repeater 300 collects the MAC address of the portable terminal 400 from the probe signal transmitted from the adjacent portable terminal 400 during video recording through the camera 200, and The portable terminal information including the collected MAC address may be transmitted to the management server 500 through a wired/wireless network. Each of the wireless signal repeaters 300 may be matched one-to-one with the camera 200 or a single wireless signal repeater 300 may be matched to correspond to multiple cameras 200.

The video album production device 100 produces a video album by linking a photo and a video. The video album production device 100 is installed in an exhibition space to link a video taken in a specific exhibition space to a photo selected by the user or provided to the user, and format the linked series of photos into an output template (video album template). You can print to organize and print your video album.

The video album production device 100 may be a personal computer, a laptop computer, a terminal, a smartphone, a tablet PC, or a dedicated device. An example video album production device 100 may be a personal computer, a laptop computer, a terminal, a dedicated device, etc. that are fixedly installed at a specific location in the exhibition space, and the video album production device 100 in another example is a smartphone or tablet PC carried by a user. Etc. In the latter case, the function of the video album production device 100 may be implemented through an app program of the portable terminal 400.

The video album production device 100 may be equipped with a printer or be connected to a printer to print or print a series of photos selected according to a promised format, and output them as paper. The video album production device 100 will be described in detail below in FIG. 2.

The portable terminal 400 is a terminal carried by a user (visitor). The portable terminal 400 may be a smartphone, a tablet PC, or a notebook. The portable terminal 400 may have an app program therein to recognize a photo in a video album and play a video corresponding to the recognized photo.

The portable terminal 400 has a display, a processor, and an input interface such as a touch pad to drive an app program for a video album. The app program is configured to recognize a photo of a video album in an album frame (eg, a rectangular area) in an area where the app program is displayed, search for a video corresponding to the recognized photo, and play the searched video.

The portable terminal 400 will be described in more detail with reference to FIGS. 3 and 4.

The management server 500 manages a video album production system.

The management server 500 includes a video database 501 and a photo-video database 503 and stores a video captured by the camera 200 in an exhibition space in the video database 501. The photo-video database 503 maps and stores a photo and a video linked to the photo. The video database 501 and the photo-video database 503 may be configured using a mass storage medium such as a hard disk.

Here, the management server 500 may be distributedly configured with a plurality of servers. For example, the management server 500 may be distributedly configured as a video server for storing and processing a video, and a photo server for storing a linked photo-video. Alternatively, according to a design example, the management server 500 may be configured in the video album production device 100.

The management server 500 will be described in more detail through FIGS. 2 and 3.

The download server 600 is a server capable of downloading a program to the portable terminal 400 and/or the video album production device 100.

The download server 600 includes a communication module, a storage module, and a control module. The communication module is provided with a communication chipset, etc., is connected to a wired/wireless network, receives a download request from the portable terminal 400 or the video album production device 100, and transmits a program (app) corresponding to the download request. The storage module has a large-capacity storage medium such as a hard disk to store a plurality of programs. At least the storage module stores a video album production program executable by the video album production device 100.

The control module includes a processor, etc., receiving a download request for a video album production program through a communication module, and transmitting the video album production program of the storage module to the communication module according to the download request, and the video album production device 100, etc. To transfer.

The video album production program performs a video album production process, which will be described below. For example, the video album production program may perform a series of processes (steps S107 to S111 in FIG. 3) of the video album production device 100 in connection with production of a video album. At least the video album production program links the selected video with the process (step) of recommending one or more videos of the videos taken in the exhibition space by the video album production device 100 using the identifier of the portable terminal 400 It is structured so that the process (step) can be performed.

Various servers and devices are connected through wired/wireless networks and transmit/receive various data. Wired/wireless networks consist of a combination of Ethernet, Wi-Fi, optical communication, and mobile communication to form a local area network or a broadband network. I can.

2 is a diagram illustrating an exemplary block diagram of a video album production device 100.

According to FIG. 2, the video album production device 100 includes a display unit 110, an input unit 120, an output unit 130, a communication unit 140, a storage unit 150, a print unit 160, and a connection unit 170. ), an external device interface unit 180 and a control unit 190. Depending on the design example, some blocks of FIG. 2 may be omitted or other blocks not shown may be further included in the video album production device 100 of FIG. 2.

The video album production device 100 is installed in the exhibition space to combine the video captured in the exhibition space with a user's photo or a photo available in the exhibition space to produce a video album.

Looking at the video album production device 100 through FIG. 2, the display unit 110 displays an image received from the control unit 190 by including a display-module such as LCD and OLED. The display unit 110 may display various images for selecting a photo, various images for linking photos and videos, and various images for specifying a user on the display module.

The input unit 120 receives various inputs. The input unit 120 may be provided with an input means for receiving a user input such as a mouse, a keyboard, a microphone, and the like, and may receive various inputs for selecting a picture or connecting a video from the user. Also, the input unit 120 may include a camera to receive image data captured from the camera.

The output unit 130 outputs various types of data. The output unit 130 may include a speaker, an LED, and the like to output various sound signals to inform a user.

The communication unit 140 transmits and receives various types of data by having at least a communication chipset for connection to a wired/wireless network. For example, the communication unit 140 may receive program data from the download server 600 or various videos from the management server 500 or the like.

The storage unit 150 is provided with a large-capacity storage medium such as a volatile memory, a nonvolatile memory, and/or a hard disk to store various types of data. The storage unit 150 stores at least a video album production program performed by the video album production device 100 to produce a video album, and permanently or temporarily stores various other pictures or videos. The video album production program may be received from the download server 600. In addition, the storage unit 150 may store programs (app programs, browsers, etc.) for accessing the download server 600 or the like and downloading programs.

The print unit 160 is provided with a printer interface or includes a printer to output a video album. The printer 160 may output a series of photos linked to a video, such as paper or photo paper provided in the printer, as well as related text and images.

The connection unit 170 transmits and receives various data between blocks inside the video album production device 100. The connection unit 170 may include or include a serial bus, a parallel bus, a GPIO, or the like, and may transfer data from the control unit 190 to another block or transfer data from an arbitrary block to the control unit 190.

The external device interface unit 180 interfaces with an external device such as the user's portable terminal 400 to transmit and receive various data to and from the external device. The external device interface unit 180 is provided with a removable memory interface, a hardware chipset such as USB, Wi-Fi, and Bluetooth, logic, and circuitry to transmit and receive various data to and from the connected external device. For example, the external device interface unit 180 may receive a picture stored in the portable terminal 400 from the portable terminal 400 or recognize an identifier of the portable terminal 400.

The control unit 190 controls the video album production device 100. The control unit 190 includes one or more execution units capable of executing a command code of a program, and loads various programs in the storage unit 150 to generate blocks of the video album production device 100 according to the loaded program. It can be controlled to perform functions according to the program. The control unit 190 may include one or more CPUs, MPUs, and processors to perform functions according to various programs.

For example, the control unit 190 accesses the download server 600 by performing the download program of the storage unit 150, searches for programs in the download server 600, and sends a download request for the searched video album production program to the communication unit 140 ) Can be transmitted to the download server 600. The controller 190 may receive a video album production program according to the download request from the download server 600 through the communication unit 140 and store the same in the storage unit 150.

When the moving picture/video album production device is a portable terminal, the controller 190 recognizes the portable terminal 400 through recognition by an album production program or through the external device interface unit 180. Identifier can be identified. The identifier of the portable terminal 400 may be, for example, a MAC address. This MAC address can be used for Wi-Fi communication or the like.

The controller 190 recommends one or more of the videos captured in the video database 501 (of the management server 500) through the display 110 using the recognized identifier of the portable terminal 400. For example, the control unit 190 searches the video database 501 using the MAC address of the user's portable terminal 400, and manages one or more videos mapped to the MAC address through the communication unit 140 and stored. It may be recommended by receiving it from 500 and displaying it through the display unit 110.

In addition, the control unit 190 may display pictures previously stored in the storage unit 150 or pictures accessible through the external device interface unit 180 from the portable terminal 400 on the display unit 110. The control unit 190 receives an input for linking the recommended one or more videos and the displayed pictures through the input unit 120, and associates the selected video and the picture to the picture-video database 503 with user information (user ID, MAC address, etc.). Likewise, it is stored together with information for specifying a user or specifying the portable terminal 400). For example, the control unit 190 transmits one or more linked photos and videos and user information to the management server 500 through the communication unit 140, and the management server 500 transmits the photos and videos to the photo-video database 503. Videos can be saved with user information.

As an alternative to recommending a video using the identifier of the portable terminal 400, the controller 190 recognizes the face of the video album production user through a camera (the camera of the input unit 120). The controller 190 may search and recommend one or more videos including the recognized faces in the video database 501. For example, the control unit 190 transmits the feature data of the recognized face to the management server 500 through the communication unit 140, and the management server 500 displays a video including a face having a similarity or higher specified by the feature data. The searched and recommended video may be transmitted to the video album production device 100, and the controller 190 may receive it through the communication unit 140 and display it on the display unit 110.

FIG. 3 is a diagram illustrating a series of processes for producing a video album and playing a video linked to a photo of the produced video album.

First, each of the one or more cameras 200 in the exhibition space photographs a video through a lens provided (S101). The camera 200 may be a camera provided in the portable terminal 400, a fixed camera installed in an exhibition space, or a camera installed in a robot moving the exhibition space.

The camera 200 configures and transmits the video information including the captured video, camera identification information, and shooting time to the management server 500, and the management server 500 temporarily stores the received video information. The camera identification information includes an identifier for identifying the camera 200 according to the type of the camera 200. For example, the camera identification information may be an identifier of the portable terminal 400 (Mac address, mobile phone number, etc.), an identifier of the fixed camera 200 (eg, ID or MAC address, etc.), or an identifier of a mobile robot (eg For example, ID or MAC address) can be included. Furthermore, the camera identification information may further include location information capable of specifying the current location of the camera 200 according to the type of the camera 200. The photographing time may be expressed as a photographing date, photographing start time, photographing end time, and photographing period.

In parallel with video recording through the camera 200, each of the one or more wireless signal repeaters 300 installed in the exhibition space collects portable terminal information including the identifiers of the one or more portable terminals 400 (S103). For example, the wireless signal repeater 300, which is a wireless AP, may recognize probe signals transmitted from arbitrary portable terminals 400 and collect MAC addresses of portable terminals 400 from the recognized probe signals. .

The wireless signal repeater 300 transfers the collected information to the management server 500 to the portable terminal information including the collected identifiers of one or more portable terminals 400, the collection time, and the identification information of the wireless signal repeater 300. And the management server 500 temporarily stores the received collection information. The collection time may be expressed as a collection date, collection start time, collection end time, collection period, and the like. The identification information of the wireless signal repeater 300 includes at least information for specifying the location where the wireless signal repeater 300 is installed or the associated camera 200, and for example, the identifier (ID) of the wireless signal repeater 300 ), location information of the wireless signal repeater 300 and/or an associated camera identifier. In this way, the wireless signal repeater 300 may be located near a camera in which a video is photographed and may dynamically collect the identifier of the portable terminal 400 around the camera 200.

The management server 500 stores the photographed video in the video database 501. Preferably, the management server 500 maps the video of the temporarily stored video information and the portable terminal information of the collection information and stores it in the video database 501 (S105).

Specifically, the management server 500 maps the video of the video information to the portable terminal information of the collected information according to the relationship between the camera identification information of the temporarily stored video information and the identification information of the wireless signal repeater 300 of the collected information, and Save to 501.

For example, the management server 500 targets video information and collection information photographed at the same time or within the same time range, at a location (or connected or preset) adjacent to the camera 200 that photographed the video. The portable terminal information from one or more wireless signal repeaters 300 may be mapped to a video and stored in the video database 501 along with a recording time or collection time. The determination of the adjacent position (or connection or setting) of the camera 200 and the wireless signal repeater 300 may be variously configured. For example, the ID of the fixed camera 200 and the ID of the wireless signal repeater 300 are matched in advance, or the location information of the mobile robot or portable terminal 400 is compared with the location where the wireless signal repeater 300 is installed. You can determine the adjacent location.

The video database 501 mapped and stored in this way enables a corresponding video to be searched using the identifier of the portable terminal 400. Accordingly, a general user can easily search for a video that is located adjacent to the user or that can be viewed as being photographed, and can produce a video album using the video related to the user.

The video album production device 100 installed in an exhibition space, etc. recommends a video to a user who wants to produce a video album (S107).

Specifically, as can be seen from the description of the control unit 190 of FIG. 2, the video album production device 100 (the control unit 190 of) identifies the identifier of the portable terminal 400 through user authentication or input. .

The video album production device 100 (the control unit 190 of) transmits a video search request including the identifier of the portable terminal 400 to the management server 500 through the communication unit 140. The management server 500 searches the video database 501 using the received identifier and searches for one or more videos mapped to information on the portable terminal having the same identifier in the video database 501.

The management server 500 transmits the searched one or more videos to the video album production device 100, and the video album production device 100 (the control unit 190 of) receives a video list (for example, video recording time and/ Alternatively, a list displaying location information, etc.) may be displayed on the display unit 110 and recommended.

In parallel or alternative to video recommendation using the identifier of the portable terminal 400, the video album production device 100 (the control unit 190 of) recognizes the face of the video album production user through the input unit 120. The video album production device 100 (the control unit 190 of) transmits a video search request including a facial feature recognized through the communication unit 140 to the management server 500. The management server 500 searches the video database 501 using the received facial features, and searches for one or more videos having the same or similar faces in the video database 501.

The management server 500 transmits the searched one or more videos to the video album production device 100, and the video album production device 100 (the control unit 190 of) receives a video list (for example, video recording time and/ Alternatively, a list displaying location information, etc.) may be displayed on the display unit 110 and recommended.

In this way, the video album production system can significantly reduce the number of relevant candidate videos that can be selected by recommending a video associated with an identifier of the portable terminal 400 or a face.

In addition, the video album production device 100 (the control unit 190 of) displays a photo to be linked to the video on the display unit 110. For example, the controller 190 temporarily stores pictures stored in the external device through the external device interface unit 180 in the storage unit 150 and then displays them on the display unit 110 or is stored in the storage unit 150 Photos that are present may be displayed on the display unit 110.

A picture selected from among displayed pictures and recommended videos and a mapped video may be linked to each other and subsequently produced as a video album.

The video album production device 100 (the control unit 190 of) links the photo to the captured video (S109).

Specifically, the video album production device 100 (the control unit 190 of) receives a selection input of one of the displayed pictures through the input unit 120 and a selection input of one of the displayed recommended videos. To associate the selected video with the selected photo.

The video album production device 100 (the control unit 190) configures one or more selected video and photo pairs as user input through the input unit 120, and maps each video and photo pair to each other to map a photo-video database 503 ).

The video album production device 100 (the control unit 190 of) transmits, together with the user's ID, one or more selected video and mapped photo pairs to the management server 500, and the management server 500 is the video selected by the user ID. And each of the mapped photo pairs is stored in the photo-video database 503.

The video stored in the photo-video database 503 and mapped to the photo may be played back according to the recognition of the mapped photo.

Thereafter, as the selection and mapping of the video and the photo are completed, the video album production device 100 (the control unit 190 of) produces a video album (S111). The video album production device 100 (the control unit 190 of) formats photos from among the selected video and photo pairs in a video album template and outputs them through the printer 160. Accordingly, the user may have a video album (a video album can also be produced through binding, etc.) having photos printed on paper or the like. Users can print not only photos but also text by mapping them to each photo.

After that, the portable terminal 400 drives the provided app program and recognizes the photos displayed in the video album through the camera 200 (S113). For example, the app program of the portable terminal 400 displays a photo album frame on the display of the portable terminal 400. The photo album frame has a rectangular shape, for example, and a picture of a video album can be located within this photo album frame. The photo album frame may have a rectangular mark or the mark may be omitted.

A photo is recognized through the camera 200 in the photo album frame on the display of the portable terminal 400, and the portable terminal 400 searches for a video corresponding to the recognized photo and plays the searched video (S115).

For example, the portable terminal 400 searches for a picture having the same or a specified similarity or higher than a picture recognized in one or more picture and video pairs previously downloaded from the picture-video database 503 of the management server 500, and A video mapped to a picture (the picture with the same or the highest similarity) can be played.

Alternatively, the portable terminal 400 transmits a video search request including the recognized photo data to the management server 500, and the management server 500 transmits a photo equal to or higher than the specified similarity as the photo data in the photo-video database 503. And transmits a video mapped to the searched picture (the picture having the same or highest similarity) to the portable terminal 400, and the portable terminal 400 plays the received video.

4 is a diagram illustrating different video playback methods according to the video playback mode. FIG. 4A shows a video playback method in a normal mode, and FIG. 4B shows a video playback method in a video split mode.

In the normal mode (hereinafter referred to as the'first mode'), the portable terminal 400 plays the video while the picture of the video album is recognized on the display (preferably within the photo album frame of the display) through the equipped camera. When a photo in the video album is not recognized on the display (in the frame of the photo album), playback of the video corresponding to the photo is stopped.

Alternatively, the portable terminal 400 is set to a video separation mode (hereinafter referred to as a'second mode') according to the reception of a touch input to the video area during video playback, and in the video separation mode, the portable terminal 400 Regardless of whether the photo is recognized on the display (in the frame of the photo album) (ie, even if the photo is not recognized), the video corresponding to the recognized photo is played. With this video separation mode, the user can view the video album (photo of) and the video and photo together after recognizing the photo. Switching from the video separation mode to the normal mode may be performed through an arbitrary input (eg, a back button) of the portable terminal 400.

Through this process, a user can conveniently organize a video album linked to a picture in an arbitrary exhibition space, map it to a picture, and automatically play a video related to the user according to the picture recognition.

The present invention described above, for those of ordinary skill in the technical field to which the present invention pertains, various substitutions, modifications, and changes are possible within the scope of the technical spirit of the present invention. It is not limited by the drawings.

100: video album production device
110: display unit 120: input unit
130: output unit 140: communication unit
150: storage unit 160: print unit
170: connection unit 180: external device interface unit
190: control unit
200: camera
300: wireless signal repeater
400: portable terminal
500: management server
501: video database 503: photo-video database
600: download server

Claims (15)

Taking a video in the exhibition space by the camera;
Storing, by the management server, the captured video in a video database; And
Including; linking the photo to the captured video by the video album production device,
The step of linking a photo to the video,
Mapping the photos and videos selected by the user and storing them in a photo-video database,
Printing a moving picture album including the picture mapped to the moving picture;
Allowing the picture of the printed video album to be recognized through a camera of the portable terminal; And
Searching for a video corresponding to the picture recognized by the portable terminal using the photo-video database and allowing the portable terminal to reproduce the searched video; further comprising,
How to create a video album. Taking a video in the exhibition space by the camera;
Collecting at least one portable terminal information including an identifier of the portable terminal by a wireless signal repeater;
Mapping, by the management server, the captured video and information on one or more portable terminals and storing them in a video database;
Recommending one or more videos of the recorded videos by a video album production device; And
Including; linking the photo to the selected video by the video album production device,
The step of linking a photo to the video,
Mapping the photos and videos selected by the user and storing them in a photo-video database,
Printing a moving picture album including the picture mapped to the moving picture;
Allowing the picture of the printed video album to be recognized through a camera of the portable terminal; And
Searching for a video corresponding to the picture recognized by the portable terminal using the photo-video database and allowing the portable terminal to reproduce the searched video; further comprising,
How to create a video album. The method according to claim 1 or 2,
The camera for shooting video in the exhibition space is a camera of a portable terminal, a fixed camera installed in the exhibition space, or a camera installed in a robot moving the exhibition space,
How to create a video album. The method of claim 2,
The step of collecting the portable terminal information includes collecting MAC addresses of one or more portable terminals from a probe signal transmitted from the portable terminal during video recording, and
The step of recommending one or more videos may include searching a video database using an identifier of a portable terminal recognized by a video album production device and recommending a video mapped to an identifier of the portable terminal,
How to create a video album. delete The method of claim 2,
The step of recommending the one or more videos may include recognizing a face of a user making a video album and recommending one or more videos including faces recognized in a video database,
How to create a video album. delete The method according to claim 1 or 2,
The step of playing the video,
Stops playing the video if the picture is not recognized during video playback in the first mode, and continues playing the video playing in the second mode set according to the user's touch input even when the picture is not recognized,
How to create a video album. A display unit that displays an image;
An input unit for receiving a user input; And
Including; a control unit for recommending one or more of the videos taken in the video database through the display unit, linking the selected video and photos through the input unit, and storing them in the photo-video database,
A video album including a photo of the linked video and photo is printed,
When the picture of the printed video album is recognized through the camera of the portable terminal, a video corresponding to the picture recognized by the portable terminal is searched using the photo-video database, and the searched video is played back by the portable terminal,
Video album creation device. The method of claim 9,
The control unit searches a video database using the MAC address of the user's portable terminal and recommends one or more videos mapped to and stored in the MAC address through the display unit,
Video album creation device. The method of claim 9,
The control unit recognizes a face of a user who creates a video album and recommends one or more videos including faces recognized in a video database,
Video album creation device. A display unit that displays an image; An input unit for receiving a user input; And a controller that recommends one or more of the videos taken in the video database through the display unit and stores the video and photos selected through the input unit in the photo-video database;
A camera for taking a video in the exhibition space; And
Includes; a management server for storing the captured video in the video database,
The video album production device allows the video album including the linked video and the photo among the photos to be printed,
When the picture of the printed video album is recognized through the camera of the portable terminal, a video corresponding to the picture recognized by the portable terminal is searched using the photo-video database, and the searched video is played back by the portable terminal,
Video album production system. The method of claim 12,
A radio signal repeater for collecting information on one or more portable terminals including an identifier of the portable terminal; further comprising,
The wireless signal repeater collects MAC addresses of one or more portable terminals from a probe signal transmitted from the portable terminal during video recording,
The video album production device searches a video database using the recognized MAC address of the portable terminal and recommends a video mapped to the identifier of the portable terminal,
Video album production system. The method of claim 13,
The portable terminal stops playing the video when the picture is not recognized during video playback in the first mode, and continues to play the video playing in the second mode set according to the user's touch input even when the picture is not recognized. ,
Video album production system. delete

Images