JP2016174290A - Server device, moving image data reproduction method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To distribute moving image data to a mobile terminal so that a moving image is reproduced in overlap with a printed matter by imaging the printed matter, output from an image printer, by the mobile terminal.SOLUTION: A server device 1 preserves image data, moving image data and authentication key information in a memory unit, and transmits the moving image data to a mobile terminal 4. The server device 1 includes: an authentication unit which requests authentication key information to a mobile terminal 4, which has read preservation location information from a code image on a printed matter 3 where the image data and the code image with coded information on the preservation location preserving the moving image data are printed, and has made an access to the server device, and by using both the authentication key information transmitted from the mobile terminal 4 in response to the request and the authentication key information preserved in the memory unit, performs user authentication; and a moving image data transmission unit which transmits the moving image data to the mobile terminal 4 when the authentication unit authenticates the terminal 4 as an authorized user.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a server device, a moving image data reproducing method, and a program for reproducing a moving image by AR technology in a mobile terminal.

  Image printing apparatuses that read digital data of images taken with a digital camera, a smartphone, or the like and print them out are installed in various places. For example, the user brings a storage medium in which image data taken with a digital camera is stored, and causes the image printing apparatus to read the image data in the storage medium. The image printing apparatus displays an image of the image data read from the storage medium and presents it to the user. When the user selects an image to be printed and designates the print size and the number of prints, the image printing apparatus prints out the image at the designated size. In such an image printing apparatus, user needs are diversified, and new services are always required.

  Conventionally, augmented reality (AR) technology is known in which an image of a virtual object or the like is superimposed and displayed on an image of a real space photographed by a mobile terminal such as a tablet terminal or a smartphone (for example, Patent Document 1). 2).

JP 2011-8752 A Special table 2012-503228 gazette

  The present invention has been made in view of the above-described conventional situation, and by photographing a printed matter output from the image printing apparatus with a portable terminal, the portable terminal is configured so that a moving image is superimposed and reproduced on the printed matter. It is an object to provide a server device, a moving image data reproduction method, and a program for distributing moving image data to a computer.

  A program according to an aspect of the present invention provides a reading unit that reads storage location information of moving image data in a server device from a code image printed on a printed matter, and the server device that is based on the storage location information read by the reading unit. When the authentication key information is requested from the server device with access to the authentication device, the authentication processing unit that transmits the authentication key information to the server device in response to the request, and when the server device is authenticated as an authorized user, An image acquisition unit that acquires image data from the server device, a comparison unit that compares feature points of an image acquired from the server device and an image on the printed matter acquired using a camera, and the feature points A mobile terminal that receives the video data from the server device and plays back the received video data when they match Those causing a computer to function.

  A program according to an aspect of the present invention includes a computer that further transmits moving image data and image data stored in a storage unit and authentication key information to the server device, and stores data from the server device. It is preferable to function as a receiving unit that receives location information, and a transfer unit that transfers the image data and the storage location information to an image printing apparatus that creates the printed matter.

  A server device according to an aspect of the present invention is a server device that stores image data, moving image data, and authentication key information in a storage unit, and transmits the moving image data to a mobile terminal. The authentication key information is requested to the portable terminal that has accessed the reading by reading the storage location information from the code image of the printed matter in which the code image in which the storage location information to be stored is printed is printed. When the authentication key information transmitted by the terminal and the authentication unit that performs user authentication using the authentication key information stored in the storage unit, and when the authentication unit authenticates with a regular user, for the mobile terminal, A moving image data transmitting unit for transmitting the moving image data.

  A server device according to an aspect of the present invention includes: a receiving unit that receives the image data, moving image data, and authentication key information from a mobile terminal; and a storage location information transmission unit that transmits the storage location information to the mobile terminal. It is further provided with the feature.

  A server apparatus according to an aspect of the present invention transmits the image data, the storage location information, and the authentication key information to an image printing apparatus that creates the printed matter.

  A moving image data reproduction method according to an aspect of the present invention is a moving image data reproduction method using a portable terminal, an image printing apparatus, and a server apparatus, wherein the portable terminal stores moving image data and image data stored in a storage unit. And authentication key information to the server device, and the server device stores the moving image data, image data, and authentication key information received from the mobile terminal, and stores data storage location information to the mobile terminal. And the portable terminal transfers the image data and the storage location information to the image printing device, and the image printing device combines the code image obtained by encoding the storage location information and the image data. An image is printed on photographic paper to output a printed matter, and the mobile terminal uses a camera to read from the code image printed on the printed matter. The storage location information is read to access the server device, and the server device requests authentication key information from the mobile terminal in response to the access from the mobile terminal, and is transmitted from the mobile terminal in response to the request. The user authentication is performed using the authentication key information and the stored authentication key information, and when the server device authenticates with a regular user, the mobile terminal acquires image data from the server device, and the server When the feature points of the image acquired from the apparatus and the image on the printed matter acquired using the camera are compared, and the feature points match, the moving image data is received from the server device, and the received moving image Characterized by playing data

  A moving image data reproducing method according to an aspect of the present invention is a moving image data reproducing method using a mobile terminal, an image printing apparatus that stores image data, and a server apparatus that stores the image data and moving image data. When the image printing device accepts the purchase order of the image data, the image data storage location information of the moving image data in the server device is encoded to generate a code image, and a composite image obtained by combining the image data and the code image is generated. Printing on photographic paper to output a printed matter and displaying authentication key information, and using the camera, the portable terminal reads the storage location information from the code image printed on the printed matter and sends it to the server device And the server device requests authentication key information from the mobile terminal with access from the mobile terminal. In response to this request, user authentication is performed using authentication key information transmitted from the mobile terminal, and when the server device authenticates with a regular user, the mobile terminal acquires image data from the server device, The feature points of the image acquired from the server device and the image on the printed matter acquired using the camera are compared, and when the feature points match, the moving image data is received from the server device and received. It is characterized by playing back the moving image data.

  According to the present invention, moving image data can be distributed to a portable terminal so that the moving image is superimposed on the printed material and reproduced by photographing the printed material output from the image printing apparatus with the portable terminal.

1 is a schematic configuration diagram of a moving image data reproduction system according to a first embodiment. It is a figure which shows the example of the printed matter output from an image printing apparatus. It is a block diagram of a portable terminal. It is a functional block diagram implement | achieved by running a moving image registration reproduction | regeneration application. It is a block diagram of a server apparatus. It is a block diagram of an image printing apparatus. It is a figure which shows the example of the display screen at the time of the image purchase in an image printing apparatus. It is a sequence diagram explaining the moving image data reproduction method which concerns on 1st Embodiment. It is a schematic block diagram of the moving image data reproduction system which concerns on 2nd Embodiment. It is a figure which shows the example of the printed matter output from an image printing apparatus. It is a block diagram of a server apparatus. It is a figure which shows the example of management information. It is a block diagram of an image printing apparatus. It is a functional block diagram implement | achieved by running an image sales program. It is a figure which shows the example of the display screen at the time of the image purchase in an image printing apparatus. It is a figure which shows the example of an authentication key display screen. It is a block diagram of a portable terminal. It is a functional block diagram implement | achieved by running a video reproduction application. It is a sequence diagram explaining the moving image data reproduction method which concerns on 2nd Embodiment. It is a figure which shows the example of management information.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a schematic configuration diagram of a moving image data reproduction system according to the first embodiment of the present invention. As shown in FIG. 1, the moving image data reproduction system includes a server device 1, an image print device 2, and a mobile terminal 4. The mobile terminal 4 is a smartphone or a tablet device having a camera or a communication function. The mobile terminal 4 is installed with an application program (moving image registration / playing application) for registering and playing back moving image data.

  The portable terminal 4 registers image data and moving image data in the server device 1. The moving image data is, for example, a moving image shot with the camera of the mobile terminal 4. The image data is, for example, still image cut out from moving image data or image data taken by a camera.

  The portable terminal 4 registers image data and moving image data, and registers authentication key information. This authentication key information is necessary for user authentication when reproducing moving image data, which will be described later. The authentication key information is a password or an application ID of a video registration / playback application installed in the mobile terminal 4. A unique application ID is assigned to each moving image registration / reproduction application for each user (mobile terminal) at the time of installation.

  When the authentication key information is a password, the user sets the password. When the authentication key information is an application ID, the application ID is automatically notified from the portable terminal 4 to the server device 1 when image data and moving image data are registered.

  When the server device 1 receives the image data and the moving image data from the mobile terminal 4, the server device 1 transmits storage location information (for example, URL or content ID) for accessing the moving image data to the mobile terminal 4.

  When the user transfers image data and storage location information from the portable terminal 4 to the image printing apparatus 2 and pays a fee, the image printing apparatus 2 encodes the storage location information to generate a two-dimensional code, and generates a two-dimensional code image. And the image of the image data received from the portable terminal 4, print the combined image on photographic paper, and output the printed matter 3. Thereby, as shown in FIG. 2, the printed matter 3 on which the image 31 and the two-dimensional code 32 are printed is created.

  When the user photographs the two-dimensional code 32 on the printed matter 3 with the camera of the portable terminal 4, the portable terminal 4 reads the two-dimensional code 32 to acquire storage location information, and accesses the server device 1. When the server apparatus 1 is accessed, user authentication is performed.

  If the authentication key information is a password, it is required to enter the password. By entering the password, the user is authenticated as a legitimate user, and the subsequent processing can proceed.

  When the authentication key information is an application ID, the application ID is automatically transmitted from the portable terminal 4 to the server device 1. If the application ID of the mobile terminal 4 that has accessed the server device 1 matches the application ID of the mobile terminal 4 that has registered the image data and the moving image data, it is authenticated as a legitimate user, and the subsequent processing can proceed.

  If the authentication key information is different, the user is not authenticated and the process stops.

  After the user authentication, the mobile terminal 4 acquires image data from the server device 1 and instructs the user to take the image 31 of the printed matter 3 with the camera of the mobile terminal 4. When the user captures the image 31 with the camera of the mobile terminal 4, the mobile terminal 4 compares and compares the feature points of the captured image 31 and the image acquired from the server device 1. When the two images match each other by the collation, the mobile terminal 4 acquires the moving image data corresponding to the image 31 from the server device 1 and reproduces the moving image on the display. A known AR technique is used for moving image reproduction, and the moving image is superimposed and reproduced on the printed matter 3 photographed by the camera of the mobile terminal 4.

  The server device 1 manages terminal identification information (individual identification information and application ID of the portable terminal 4) of the portable terminal 4 authenticated as a regular user, confirms the terminal identification information at the second and subsequent accesses, and performs user authentication processing. It may be done automatically. As a result, the user can view the moving image without entering a password or the like in the second and subsequent accesses.

  As described above, in the moving image data reproduction system, image data and moving image data are registered from the mobile terminal 4 to the server device 1, and the server device 1 notifies the mobile terminal 4 of storage location information of the moving image data. The image printing apparatus 2 sells the printed matter 3 on which the image data and the storage location information are transferred from the portable terminal 4 and the image 31 and the two-dimensional code 32 are printed.

  A user who has purchased the printed matter 3 can read the two-dimensional code 32 with the mobile terminal 4, access the server device 1 to receive / reproduce the moving image data, and view the moving image corresponding to the image 31. Thereby, the printed matter 3 can be enjoyed as a photograph with a moving image.

  In addition, since the authentication process for determining whether or not the user is a regular user is performed at the time of reproducing the moving image, it is possible to prevent the moving image from being viewed by a third party and to improve the security level.

  Hereinafter, the mobile terminal 4, the server apparatus 1, and the image printing apparatus 2 constituting the moving image data reproduction system will be described.

  FIG. 3 is a block configuration diagram of the mobile terminal 4. The mobile terminal 4 includes a CPU 40, a memory 41, a camera 42, a communication unit 43, and a display (touch panel) 44.

  The memory 41 stores moving image data and a moving image registration / reproduction application. The memory 41 includes a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory), a RAM (Random Access Memory), an SRAM (Static Random Access Memory), a ROM (Read- It includes at least one type of storage medium such as only memory (EEPROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), and magnetic memory.

  When the CPU 40 executes the moving image registration / playback application, as shown in FIG. 4, a registration unit 50, a transfer unit 60, and a playback unit 70 are realized, and data registration to the server device 1 and data to the image printing device 2 are realized. Transfer, acquisition / reproduction of moving images from the server device 1 and the like can be performed.

  The registration unit 50 includes a cutout unit 51, an image selection unit 52, a data transmission unit 53, an authentication key information transmission unit 54, and a storage location information reception unit 55.

  The cutout unit 51 cuts out a still image from the moving image data stored in the memory 41. The cutout unit 51 detects a portion (referred to as a cut or a cut break) where the scene of the moving image data changes greatly, and divides the moving image data for each detected cut. An image between adjacent frames is divided into a grid (rectangle), an average of pixel values for each rectangle is obtained, and when the absolute value of the difference between the average values is large, it is determined that the place is a cut. A representative image is determined from among a plurality of still images included in a moving image block between cuts. The representative image is the first image, the last image, the temporally intermediate image, or the like of the moving image block. By determining a representative image for each moving image block, the cutout unit 51 cuts out a plurality of still images from the moving image data.

  A plurality of still images cut out from the moving image data are displayed on the display 44. The image selection unit 52 receives a still image selection from the user.

  The data transmission unit 53 transmits the moving image data and the image data of the selected still image to the server device 1 using the communication unit 43.

  The authentication key information transmission unit 54 transmits authentication key information to the server device 1. When the authentication key information is a password, a password input screen is displayed on the display 44, and an input of the password from the user is accepted. The authentication key information transmission unit 54 transmits the password input by the user to the server device 1. When the authentication key information is an application ID, the authentication key information transmission unit 54 transmits the application ID of the installed moving image registration / playback application to the server device 1. The transmission of the authentication key information by the authentication key information transmission unit 54 is performed following the transmission of image data and moving image data by the data transmission unit 53, for example.

  The storage location information receiving unit 55 receives storage location information for accessing moving image data from the server device 1 via the communication unit 43.

  The transfer unit 60 uses the communication unit 43 to print the image data of the still image transmitted from the data transmission unit 53 to the server device 1 and the storage location information received from the server device 1 by the storage location information reception unit 55. Transfer to device 2.

  The reproduction unit 70 includes a code reading unit 71, an authentication processing unit 72, an image acquisition unit 73, a feature point comparison unit 74, and a moving image reproduction unit 75.

  The code reading unit 71 reads storage location information from the two-dimensional code 32 printed on the printed material 3 using the camera 42. When the mobile terminal 4 accesses the server device 1 based on the read storage location information, the server device 1 performs a user authentication process and requests an authentication key.

  The authentication processing unit 72 transmits authentication key information in response to an authentication key request from the server device 1. The authentication key information is an application ID or a password input from the user.

  When the server device 1 authenticates as a regular user, the image acquisition unit 73 acquires image data corresponding to the image 31 from the server device 1. The image acquisition unit 73 acquires the image 31 on the printed material 3 using the camera 42.

  The feature point comparison unit 74 compares feature points between the image acquired from the server device 1 and the image 31 of the printed matter 3 photographed by the camera 42.

  When the feature points of the image acquired from the server device 1 match the feature points of the image 31 of the printed matter 3 taken by the camera 42, the moving image reproduction unit 75 receives the moving image data from the server device 1. The moving image reproducing unit 75 reproduces the received moving image data by superimposing the received moving image data on the image 31 of the printed matter 3 photographed by the camera 42 using a known AR technique. For example, the feature point of the detected image 31 is tracked to estimate the position and orientation of the camera 42, and the camera image and the moving image are aligned.

  When the feature points do not match, it is displayed on the display 44 that the moving image cannot be reproduced.

  FIG. 5 is a configuration diagram of the server device 1. The server device 1 includes an image data receiving unit 11, a moving image data receiving unit 12, a storage location information transmitting unit 13, an image data transmitting unit 14, a moving image data transmitting unit 15, a moving image distribution management unit 16, an authentication unit 17, and a database 18. For example, a computer.

  The image data receiving unit 11 and the moving image data receiving unit 12 receive image data and moving image data from the mobile terminal 4. When receiving data from the mobile terminal 4, the authentication unit 17 receives authentication key information from the mobile terminal 4. When receiving the moving image data from the mobile terminal 4, the storage location information transmission unit 13 transmits storage location information for accessing the moving image data to the mobile terminal 4.

  The image data, moving image data, and authentication key information received from the mobile terminal 4 and the storage location information transmitted to the mobile terminal 4 are associated with each other and stored in the database 18.

  When the portable terminal 4 accesses the server device 1 based on the storage location information, the authentication unit 17 performs user authentication processing using authentication key information associated with the storage location information. For example, the authentication unit 17 requests the mobile terminal 4 that has accessed to enter a password or notify an application ID. The authentication unit 17 performs authentication processing by comparing the authentication key information transmitted from the portable terminal 4 in response to this request with the authentication key information stored in the database 18.

  When the authentication process confirms that the user of the mobile terminal 4 is a regular user, the image data transmission unit 14 displays the image data corresponding to the storage location information used when the mobile terminal 4 has accessed the mobile terminal 4. 4 to send. In response to a request from the mobile terminal 4, the video data transmission unit 15 transmits video data corresponding to the storage location information used when the mobile terminal 4 has accessed to the mobile terminal 4.

  The database (storage unit) 18 stores image data, moving image data, and management information. The image data and the moving image data are those received from the mobile terminal 4. The management information includes information such as the correspondence between the image data and the moving image data, authentication key information, and the date on which the data is registered. The server device 1 may further include a terminal identification information acquisition unit that acquires the terminal identification information of the mobile terminal 4, and may include the acquired terminal identification information in the management information. Thereby, it is possible to manage the registration date and authentication key of the image data and moving image data in the database 18, information of the mobile terminal 4 used for registration, and the like.

  The database 18 stores at least one type of flash memory type, hard disk type, multimedia card micro type, card type memory (eg, SD or XD memory), RAM, SRAM, ROM, EEPROM, PROM, magnetic memory. Includes media.

  When storing the image data and the moving image data received from the mobile terminal 4 in the database 18, the moving image distribution management unit 16 generates storage location information and creates management information including the storage location information. The moving image distribution management unit 16 refers to the management information and identifies the corresponding image data and moving image data from the storage location information when the mobile terminal 4 has accessed.

  FIG. 6 is a block configuration diagram of the image printing apparatus 2. As illustrated in FIG. 6, the image printing apparatus 2 includes a CPU (central processing unit) 20, a touch panel (display unit, operation unit) 21, a charging unit 22, a printer 23, a communication unit 24, and a memory 25. The image printing apparatus 2 reads image data from a storage medium in which image data photographed by a digital camera or the like is stored, displays the read image on the touch panel 21, and selects an image and designates a print size and the number of prints from the user. A function of receiving and printing out an image by the printer 23 is provided.

  The charging unit 22 identifies and counts the inserted money and withdraws change. The printer 23 is, for example, a sublimation thermal transfer type high resolution color printer.

  The memory 25 stores a control program. The memory 25 is a memory of at least one of flash memory type, hard disk type, multimedia card micro type, card type memory (for example, SD or XD memory), RAM, SRAM, ROM, EEPROM, PROM, magnetic memory. Includes media.

  The CPU 20 functions as a control unit that controls each unit of the image printing apparatus 2 by executing the control program.

  When receiving a print order start instruction for a photograph with moving images from the user via the touch panel 21, the communication unit 24 receives image data and storage location information from the portable terminal 4 using a wireless communication or wired communication function. As shown in FIG. 7, the control unit displays the sample image 80 of the printed material 3 on the touch panel 21 using the received image data.

  When the user selects a purchase image and pays a fee, the control unit generates a composite image by combining the two-dimensional code image obtained by encoding the storage location information and the image data, and transfers the composite image to the printer 23. The printer 23 prints this composite image on photographic paper and outputs a printed product 3.

  FIG. 8 is a diagram showing a flow of processing of image / video registration and video playback according to the present embodiment.

  When the user operates the mobile terminal 4 to execute the moving image registration / playback application and starts the registration process, the moving image data in the memory 41 can be selected. When the user selects any moving image data, the cutout unit 51 cuts out a plurality of still images from the selected moving image data and displays them on the display 44. The user selects one of a plurality of still images (step S101).

  The data transmission unit 53 of the portable terminal 4 transmits the moving image data and the still image data selected by the user in step S101 to the server device 1, and the authentication key information transmission unit 54 transmits the authentication key information to the server device 1. (Step S102). The authentication key information is an application ID or a password input from the user.

  The server device 1 stores the moving image data, the image data, and the authentication key information received from the mobile terminal 4 in the database 18 and notifies the mobile terminal 4 of storage location information for accessing the moving image data (step S103). .

  The user operates the image printing apparatus 2 and starts a print order for a photograph with a moving image. Using the communication function of the image printing apparatus 2, the same image data transmitted to the server apparatus 1 and the storage location information notified from the server apparatus 1 are transferred from the portable terminal 4 to the image printing apparatus 2 (steps). S104).

  When receiving the payment of the fee from the user, the image printing apparatus 2 encodes the storage location information to generate a two-dimensional code image, and synthesizes the two-dimensional code image and the image data transferred from the portable terminal 4. Then, a composite image is generated (step S105).

  The printer 23 prints this composite image on photographic paper and outputs it (step S106). Thereby, the user can obtain the printed matter 3 on which the image 31 and the two-dimensional code 32 are printed (step S107).

  When the user executes the moving image registration / reproduction application of the mobile terminal 4 and starts the reproduction process, the camera 42 is activated and a two-dimensional code reading instruction is displayed on the display 44. The portable terminal 4 reads the storage location information by photographing the two-dimensional code 32 of the printed matter 3 with the camera 42 (step S108).

  When the portable terminal 4 accesses the server apparatus 1 using the read storage location information (step S109), the server apparatus 1 requests an authentication key from the portable terminal 4 for user authentication (step S110). In response to this request, the portable terminal 4 transmits an authentication key to the server device 1 (step S111). For example, in the case of password authentication, a password input screen is displayed on the display 44 of the mobile terminal 4, and the mobile terminal 4 transmits the password input by the user to the server device 1. When the authentication key is an application ID, the mobile terminal 4 transmits the application ID to the server device 1.

  The server device 1 performs an authentication process using the received authentication key (step S112), and notifies the authentication result to the portable terminal 4 (step S113). When authenticated as a regular user by the user authentication process, the image acquisition unit 73 of the portable terminal 4 requests image data (step S114). The server device 1 refers to the management information and transmits image data corresponding to the storage location information when accessed from the mobile terminal 4 to the mobile terminal 4 (step S115).

  When the portable terminal 4 receives image data from the server device 1, an instruction to read the image 31 is displayed on the display 44. When the image 31 of the printed matter 3 is photographed by the camera 42, the feature point comparison unit 74 compares the feature point between the image received from the server device 1 and the image 31 photographed by the camera 42 (step S116). If the feature points match, the mobile terminal 4 requests the moving image data from the server device 1 (step S117).

  The server apparatus 1 transmits the moving image data corresponding to the image data transmitted to the mobile terminal 4 in step S115 to the mobile terminal 4 (step S118). When the mobile terminal 4 receives the moving image data, the moving image reproducing unit 75 reproduces the moving image data by superimposing the moving image data on the image 31 captured by the camera 42 using a known AR technique (step S119). As a result, the moving image is reproduced on the display 44 as if the image 31 in the printed matter 3 started to move.

  As described above, according to the present embodiment, when the printed matter 3 output from the image printing apparatus 2 is photographed by the portable terminal 4, the server device 1 causes the moving image to be superimposed and reproduced on the printed matter 3. The moving image data can be distributed to the mobile terminal 4.

  The moving image data can be registered in the server device 1 by the user himself / herself. Therefore, not only the image printed on the printed matter 3 but also a related moving image can be enjoyed.

  Further, when the storage location information is read from the two-dimensional code 32 and the server device 1 is accessed, user authentication processing is performed. For this reason, a moving image can be prevented from being viewed by a third party, and the security level can be improved.

  In the first embodiment, both the application ID and the password may be registered as the authentication key information. When the user who registered the image data and the moving image data reads the storage location information from the two-dimensional code 32 on the printed matter 3 using his / her mobile terminal 4 and accesses the server device 1, the application ID is used. User authentication is performed automatically.

  When the user A registers image data, moving image data, authentication key information (password and application ID) using the portable terminal 4A, and transfers the printed matter 3 created by the image printing apparatus 2 to the user B, the user A Tell B the password registered as authentication key information. The user B reads the storage location information from the two-dimensional code 32 on the printed material 3 using his / her portable terminal 4 </ b> B and accesses the server device 1.

  The server device 1 automatically acquires the application ID from the mobile terminal 4B. Since the application ID of the portable terminal 4B is different from the application ID of the portable terminal 4A in which the image data and the moving image data are registered, the server device 1 requests the portable terminal 4B to input a password. User B inputs the password taught by user A on the password input screen of portable terminal 4B. As a result, the user B is authenticated as an authorized user, and the mobile terminal 4B can reproduce the moving image. The server device 1 may register the application ID of the mobile terminal 4B as the app ID of the authorized user, and automatically perform authentication based on the application ID when accessing from the mobile terminal 4B thereafter.

  Instead of entering the password at the portable terminal 4B, the server device 1 may make an inquiry to the portable terminal 4A as to whether or not to permit video reproduction on the portable terminal 4B when accessed from the portable terminal 4B. . The server device 1 notifies the mobile terminal 4A of the user name registered in the application of the mobile terminal 4B. When the user A confirms from the notified user name that the user B is the user B who has transferred the printed matter 3 and permits the reproduction of the moving image, the portable terminal 4B can reproduce the moving image. According to such a method, even when the user A forgets the password when the printed material 3 is transferred to the user B, the moving image can be reproduced on the mobile terminal 4B of the user B.

  When the CPU 40 of the mobile terminal 4 executes the video registration / playback application, a time limit management unit is implemented to prevent the printed matter 3 from being purchased and not being registered in the server device 1 without being purchased. May be. For example, when moving image data and image data are registered in the server device 1 and the storage location information is received, the image data and the storage location information are not transferred to the image printing device 2 within a certain period (for example, one month). When the purchase of the product 3 has not been performed, the time limit management unit uses the display 44 of the portable terminal 4 to notify that there is an unpurchased print product 3 or erases the data registered in the server device 1. Or an alarm is displayed.

  Further, when the number of image data and storage location information that have not been transferred to the image printing apparatus 2 reaches a certain number, that is, when the number of unpurchased printed materials 3 reaches a certain number, the time limit management unit The display 44 of the mobile terminal 4 may be used to notify that the unpurchased printed matter 3 has accumulated, or to display an alarm that data registered in the server device 1 will be deleted. Accordingly, it is possible to prevent the printed matter 3 from being purchased and to prevent only the data from being registered in the server device 1 and to efficiently use the database 18 of the server device 1.

  After transferring the image data and the storage location information to the image printing apparatus 2, that is, when it is considered that the printed matter 3 has been purchased, the video registration / playback application displays the two-dimensional code 32 on the display 44 of the portable terminal 4. An instruction to read and try to play a moving image may be displayed. When the portable terminal 4 reads the two-dimensional code 32 and accesses the server device 1, the server device 1 can grasp that the moving image-added photo has been purchased for the registered moving image data and image data.

  The server device 1 determines a data storage period (for example, two years) when there is an access to playback of a moving image, and when the end of this storage period approaches, the end of the storage period is near to the mobile terminal 4 that has been accessed. You may notify that. The server device 1 may accept an extension of the storage period and purchase of moving image data from the mobile terminal 4 for a fee. The payment of the fee is performed by online payment using a credit card, for example. When the user selects the extension of the storage period, the server device 1 extends the storage period of the registration data. When the user selects the purchase of moving image data, the server device 1 transmits the moving image data to the mobile terminal 4 and deletes the moving image data from the database 18. Accordingly, it is possible to prevent the moving image data that is no longer reproduced from being registered in the server device 1 and to efficiently use the database 18 of the server device 1.

  The server device 1 confirms the terminal information, application ID, access source IP address, etc. of the mobile terminal 4 and limits the size of data registered (uploaded) from the same mobile terminal 4 within a certain period. Good.

  In the first embodiment, the example in which the image data of the still image cut out from the moving image data is registered in the server device 1 and the two-dimensional code is combined with the still image and printed on the printed matter 3 has been described. However, if there is no favorite image among the still images cut out from the image data, other image data in the memory 41 is selected, registered in the server device 1, transferred to the image printing device 2, and transferred to the printed matter 3. You may make it print.

  When transmitting the storage location information to the mobile terminal 4, the server device 1 may transmit the two-dimensional code print position information together. The image printing apparatus 2 receives the print position information together with the storage location information from the portable terminal 4 and synthesizes a two-dimensional code image based on the print position information. This is to prevent the two-dimensional code 32 from interfering with the feature point comparison when performing the feature point comparison of the images (step S116 in FIG. 8).

  The portable terminal 4 preferably copies the image data transmitted to the server device 1, holds the copied image data so that it cannot be edited, and transfers the image data to the image printing device 2. In addition, when image data that cannot be edited is transferred from the portable terminal 4, the image printing apparatus 2 performs control so that image editing using the editing function (adding a stamp, a frame, etc.) of the own apparatus cannot be performed. When image data is edited after being transmitted to the server device 1 and before being printed by the image printing device 2, the feature points between the edited image on the printed matter 3 and the image stored in the server device 1 are different. This is because they can be inconsistent.

  In the first embodiment, the example in which the image printing apparatus 2 performs the coding process of the storage location information has been described. However, the image printing apparatus 2 may perform the moving image registration / playback application. In this case, the two-dimensional code image is transferred from the portable terminal 4 to the image printing apparatus 2.

  As shown in FIG. 7, when the sample image 80 of the printed matter 3 is displayed on the touch panel 21, it is preferable that the two-dimensional code in the sample image 80 is a two-dimensional code based on dummy information. Thereby, the act of photographing the sample image 80 displayed on the touch panel 21 with the portable terminal and reproducing the moving image can be prevented.

  In the first embodiment, it may be possible to select the presence / absence of user authentication during video playback. For example, when registering image data and video data from the mobile terminal 4 in the server device 1, it is possible to select whether or not the authentication key information is registered. When the authentication key information is not registered, the user authentication process at the time of moving image reproduction is omitted.

  Further, the presence / absence of user authentication may be selected when the printed matter 3 is purchased in the image printing apparatus 2. In this case, the server device 1 transmits two storage location information, that is, storage location information for performing user authentication and storage location information for which user authentication is not performed, to the mobile terminal 4. The portable terminal 4 transfers the image data and the two storage location information to the image printing apparatus 2. A selection screen for selecting presence / absence of user authentication is displayed on the image printing apparatus 2, and storage location information corresponding to the user's selection is encoded and printed on photographic paper. The image printing apparatus 2 may change the selling price of the printed matter 3 depending on the presence / absence of user authentication.

[Second Embodiment]
FIG. 9 is a schematic configuration diagram of a moving image data reproduction system according to the second embodiment. As shown in FIG. 9, the moving image data reproduction system includes a server device 100, an image printing device 200, and a portable terminal 400. The portable terminal 400 is a smartphone or tablet device owned by the user. The mobile terminal 400 stores a program (moving image reproduction application) for reproducing moving image data. A unique application ID is assigned to each moving image playback application for each user (mobile terminal) at the time of installation.

  The server device 100 stores image data and moving image data corresponding to the image data. The server apparatus 100 transmits image data, storage location information (for example, URL) for accessing the corresponding moving image data, and authentication key information to the image printing apparatus 200. The authentication key is necessary for user authentication described later, and is, for example, a password.

  The image data is, for example, image data of a person such as a sports player or a celebrity, an animal, or a car. The moving image data is data of a moving image in which an object in the image is moving or producing a sound. The case where the image data is human image data will be described below.

  When the fee is paid by the user, the image printing apparatus 200 encodes the storage location information received from the server apparatus 100 and generates a two-dimensional code. Then, the image printing apparatus 200 combines the two-dimensional code image and the person image based on the image data received from the server apparatus 100, prints the combined image on photographic paper, and outputs a printed matter 300. As a result, as shown in FIG. 10, a printed material 300 on which a person image 310 and a two-dimensional code 320 are printed is created.

  Further, after payment of a fee from the user, the image printing apparatus 200 displays an authentication key. For example, a multi-digit password as an authentication key is displayed. The user records the password by writing it down.

  When the moving image playback application is executed on the portable terminal 400 and the two-dimensional code 320 on the printed material 300 is photographed with the camera of the portable terminal 400, the portable terminal 400 reads the storage location information from the two-dimensional code 320 and sends it to the server device 100. to access.

  When the server device 100 is accessed for the first time, user authentication using a password is performed. The user inputs the password displayed on the image printing apparatus 200 at the time of image purchase on the password input screen of the portable terminal 400. When the input password is transmitted to the server device 100 and authenticated as a legitimate user, the subsequent processing can proceed. If the password is incorrect, the user is not authenticated and the process cannot proceed.

  After the user authentication, the mobile terminal 400 acquires image data from the server device 100 and instructs the user to capture the person image 310 of the printed material 300 with the camera of the mobile terminal 400. When the user captures a human image 310 with the camera of the mobile terminal 400, the mobile terminal 400 compares and compares the feature points of the captured human image 310 and the image acquired from the server device 100. When the two images match each other as a result of the collation, the mobile terminal 400 acquires moving image data corresponding to the person image 310 from the server device 100 and reproduces the moving image on the display. A known AR technique is used for moving image reproduction, and the moving image is superimposed and reproduced on the printed material 300 photographed by the camera of the portable terminal 400.

  After the user authentication, the server device 100 acquires the application ID from the mobile terminal 400 and stores it as an authorized user application ID. At the time of the second or subsequent access to the server apparatus 100, the application ID is automatically transmitted from the portable terminal 400 to the server apparatus 100, and user authentication using the application ID is performed. That is, user authentication is automatically performed using the application ID, and the user does not need to input a password.

  As described above, in the moving image data reproduction system, the image printing apparatus 200 sells the printed matter 300 on which the person image 310 and the two-dimensional code 320 are printed. After purchasing the printed material 300, the user reads the two-dimensional code 320 on the printed material 300 with the mobile terminal 400, accesses the server device 100 to receive / reproduce the moving image data, and views the moving image corresponding to the person image 310. can do.

  In addition, when the printed material 300 is purchased, the image printing apparatus 200 presents a password as an authentication key to the user. When the mobile terminal 400 accesses the server device 100 for the first time, this authentication key is used to perform authentication processing as to whether or not the user is a legitimate user, so that a moving image can be prevented from being viewed by a third party. Thereby, for example, when the number of mobile terminals that perform video playback is managed and restricted, the number of playback terminals by authorized users decreases by being played on a third-party mobile terminal (by a third party). Video playback rights are used).

  Hereinafter, the server apparatus 100, the image printing apparatus 200, and the mobile terminal 400 that constitute the moving image data reproduction system will be described.

  FIG. 11 is a configuration diagram of the server apparatus 100. The server device 100 includes an image data transmission unit 101, a storage location information transmission unit 110, a terminal information acquisition unit 120, a video data transmission unit 130, a video distribution management unit 140, an authentication unit 150, and a database 160, and is configured by a computer, for example. Is done.

  The database (storage unit) 160 stores image data, moving image data, and management information. The image data and moving image data are provided from a licensor, for example.

  FIG. 12 shows an example of management information. The management information is divided into a plurality of boxes, and each box includes storage location information, user application ID, authentication key information, number of sellable devices, number of reproducible devices, image information, and moving image information. The management information is divided into boxes by management units for image sales and video distribution.

  The number of sellable items is the number of printable products 300 that can be sold (upper limit number).

  The storage location information is information necessary for accessing the server apparatus 100 when reproducing the moving image, and a two-dimensional code 320 encoded with the information is printed on the printed material 300. For example, in image sales corresponding to the box 001, the same number of storage location information as the number X1 that can be sold is prepared. These X1 storage location information are different URLs, but the same box (box 001) is referred to and the same moving image data is reproduced by the conversion process inside the server apparatus 100. .

  In response to a request from the image printing apparatus 200, the storage location information transmission unit 110 transmits any of the storage location information that has not been transmitted to the image printing apparatus 200. As a result, the printed matter 300 sold by the image printing apparatus 200 has a different two-dimensional code 320 even if the person image 310 is the same.

  When the number of prints 300 sold reaches the number that can be sold, there is no storage location information that has not been sent, so the server device 100 notifies the image printing device 200 that the print device 300 has been sold out.

  The authentication key information is used for user authentication, and is displayed on the display of the image printing apparatus 200 when an image is purchased. The authentication key information is transmitted to the image printing apparatus 200 together with the storage location information.

  The authentication unit 150 performs user authentication processing. The authentication unit 150 collates the authentication key information corresponding to the storage location information when the mobile terminal 400 has accessed the server device 100 and the authentication key information (password entered by the user) transmitted from the mobile terminal 400. Authentication. When the authentication unit 150 authenticates with a regular user, the terminal information acquisition unit 120 acquires the application ID from the mobile terminal 400. The acquired application ID is registered in the user application ID corresponding to the storage location information in the management information as the application ID of the authorized user.

  The number of reproducible devices indicates the number of portable terminals 400 that can reproduce a moving image with one printed matter 300. Therefore, the number of user application IDs that can be registered corresponding to one storage location information is the number of reproducible devices.

  The number of sellable devices and the number of reproducible devices may be set by a licensor that provides image data and moving image data. The number of reproducible devices need not be set. Further, the storage location information may be one type without setting the number of available sales.

  The image information indicates information about image data to be sold. The moving image information indicates information about moving image data corresponding to image data.

  The image data transmission unit 101 transmits image data to the image printing apparatus 200 and the portable terminal 400. For example, when the image data and the moving image data provided from the licensor are registered in the server apparatus 100, the image data transmission unit 101 transmits the image data to the image printing apparatus 200. Further, when the mobile terminal 400 accesses the server device 100 based on the storage location information, the image data transmission unit 101 refers to the image information of the box corresponding to the storage location information and transmits the image data to the mobile terminal 400. To do.

  For example, when the storage location information is included in the box 001, the image data transmission unit 101 transmits the image data P1 to the portable terminal 400, and when the storage location information is included in the box 002, the image data transmission is performed. The unit 101 transmits the image data P2 to the portable terminal 400.

  The moving image data transmission unit 130 transmits moving image data to the mobile terminal 400 in response to a request from the mobile terminal 400. The moving image data transmitted to the portable terminal 400 corresponds to the image data transmitted to the portable terminal 400.

  The moving image distribution management unit 160 specifies data to be distributed to the mobile terminal 400, updates management information, and the like.

  FIG. 13 is a block configuration diagram of the image printing apparatus 200. As illustrated in FIG. 13, the image printing apparatus 200 includes a CPU (central processing unit) 201, a touch panel (display unit, operation unit) 210, a charging unit 220, a printer 230, a communication unit 240, and a memory 250. The image printing apparatus 200 is connected to the server apparatus 100 via the communication unit 240 so as to be communicable.

  The memory 250 stores the control program, the image sales program, and the image data received from the server device 100. The memory 250 is a memory of at least one of flash memory type, hard disk type, multimedia card micro type, card type memory (eg, SD or XD memory), RAM, SRAM, ROM, EEPROM, PROM, magnetic memory. Includes media.

  When the CPU 201 executes the control program, it functions as a control unit that controls each unit of the image printing apparatus 200.

  When the CPU 201 executes the image sales program, a sample image display unit 260, a storage location information acquisition unit 270, an encoding processing unit 280, an image composition unit 290, and an authentication key display unit 292 are realized as shown in FIG. As a result, the printed material 300 can be sold.

  Using the image data received from the server device 100, the sample image display unit 260 displays a sample image 700 of the printed material 300 on the touch panel 210 as shown in FIG. When the user selects a purchase image and pays a fee, the storage location information acquisition unit 270 acquires storage location information and an authentication key corresponding to the purchased image from the server device 100.

  The encoding processing unit 280 encodes the storage location information acquired by the storage location information acquisition unit 270 to generate a two-dimensional code image. The image synthesis unit 290 creates a synthesized image by synthesizing the two-dimensional code image with the purchased image. When the combined image is printed on the photographic paper by the printer 230, the printed matter 300 is output.

  The authentication key display unit 292 displays the authentication key acquired by the storage location information acquisition unit 270 on the touch panel 210 as shown in FIG.

  The image printing apparatus 200 reads image data from a storage medium in which image data captured by a digital camera or the like is stored, displays the read image on the touch panel 210, and selects an image and designates a print size and the number of prints from the user. A function of receiving and printing out an image by the printer 230 may be provided.

  FIG. 17 is a block configuration diagram of the mobile terminal 400. The portable terminal 400 includes a CPU 401, a memory 410, a camera 420, a communication unit 430, a GPS 440, and a display (touch panel) 450.

  The memory 410 stores a moving image playback application (application program). The memory 410 is a memory of at least one of flash memory type, hard disk type, multimedia card micro type, card type memory (for example, SD or XD memory), RAM, SRAM, ROM, EEPROM, PROM, magnetic memory. Includes media.

  When the CPU 401 executes the video playback application, a code reading unit 460, an authentication processing unit 462, an image acquisition unit 470, a feature point comparison unit 480, and a video playback unit 490 are realized as shown in FIG. Playback can be performed.

  The code reading unit 460 reads storage location information from the two-dimensional code 320 printed on the printed material 300 using the camera 420. The authentication processing unit 462 displays an authentication key input screen on the display 450 and transmits the authentication key input from the user to the server apparatus 100. Further, the authentication processing unit 462 transmits the application ID to the server apparatus 100 after user authentication.

  The image acquisition unit 470 acquires image data from the server device 100 after user authentication. The acquisition unit 470 acquires the person image 310 on the printed material 300 using the camera 420.

  The feature point comparison unit 480 compares the feature points between the image acquired from the server device 100 and the person image 310 of the printed matter 300 captured by the camera 420. When the feature points match, the moving image reproduction unit 490 receives the moving image data from the server device 100 and reproduces it. When the feature points do not match, it is displayed on the display 450 that playback is impossible.

  The moving image reproduction unit 490 reproduces the received moving image data by superimposing the received moving image data on the person image 310 photographed by the camera 420 using a known AR technique. For example, the feature point of the detected person image 310 is tracked to estimate the position and orientation of the camera 420, and the camera image and the moving image are aligned.

  The GPS 440 acquires the position information of the mobile terminal 400 and notifies the server apparatus 100 of the position information in response to a request from the server apparatus 100.

  FIG. 19 is a diagram showing the flow of processing of image sales and moving image playback according to this embodiment.

  When sales images and moving images are provided from the licensor and the number of sellable devices and the number of reproducible devices are set, management information including these pieces of information is registered in the database 160 (step S201). The server apparatus 100 generates the number of storage location information corresponding to the number that can be sold and stores it in the management information. As the management information is registered, the server apparatus 100 transmits image data to the image printing apparatus 200 (step S202). The transmission timing of the image data from the server apparatus 100 to the image printing apparatus 200 is arbitrary.

  The transmitted image data is stored in the memory 250. As a result, the image printing apparatus 200 starts selling images. The sample image display unit 260 displays the sample image 700 of the printed material 300 on the touch panel 210 as shown in FIG. 15 using the image data.

  When the user operates the image printing apparatus 200 to purchase an image and pays a fee (step S203), the storage location information acquisition unit 270 of the image printing device 200 stores storage location information of moving image data corresponding to the purchased image. Then, the server device 100 is requested for authentication key information (step S204).

  Based on the request from the image printing apparatus 200, the server apparatus 100 refers to the box corresponding to the management information in the database 160 and transmits unsent storage location information and authentication key information to the image printing apparatus 200. (Step S205). For example, when the management information shown in FIG. 12 is stored in the database 160 and the image purchased in step S203 is the image P1, the server device 100 stores the unsent storage location information included in the box 001 and the authentication key information. And send. A transmitted flag is set in the transmitted storage location information in the management information. The authentication key information may be transmitted from the server apparatus 100 to the image printing apparatus 200 together with the image data in step S202.

  When the image printing apparatus 200 acquires the storage location information from the server device 100, the encoding processing unit 280 encodes the storage location information and generates a two-dimensional code image. Then, the image composition unit 290 composes the two-dimensional code image and the image purchased in step S203 to generate a composite image (step S206).

  The printer 230 prints this composite image on photographic paper (step S207). During the printing process, as shown in FIG. 16, authentication key information is displayed on the touch panel 210 (step S208). The user takes a picture of the displayed screen with the camera 420 of the portable terminal 400 or records the authentication key in a memo pad. Thereafter, the user obtains a printed matter 300 on which the person image 310 and the two-dimensional code 320 output from the image printing apparatus 200 are printed (step S209).

  When the user executes the moving image playback application of the portable terminal 400, the camera 420 is activated and a two-dimensional code reading instruction is displayed on the display 450 (step S210). The portable terminal 400 acquires storage location information by photographing the two-dimensional code 320 of the printed matter 300 with the camera 420 (step S211).

  When portable terminal 400 accesses server device 100 based on the storage location information (step S212), server device 100 requests portable terminal 400 for an authentication key for user authentication (step S213). When the authentication key input screen is displayed on the display 450 of the portable terminal 400, the user inputs the authentication key recorded at the time of image purchase (step S214). The portable terminal 400 transmits the input authentication key to the server device 100 (step S215).

  The server apparatus 100 performs an authentication process using the received authentication key (step S216) and notifies the authentication result to the portable terminal 400 (step S217). When authenticated as a regular user, the image acquisition unit 460 of the mobile terminal 400 requests the server device 100 for image data (step S218). The server device 100 refers to the management information box corresponding to the storage location information when accessed from the mobile terminal 400, and transmits the image data to the mobile terminal 400 (step S219). For example, when the storage location information is included in the box 001, the server device 100 transmits the image data P1 to the portable terminal 400.

  When the portable terminal 400 receives image data from the server device 100, an instruction to read the person image 310 is displayed on the display 450. When the person image 310 of the printed material 300 is photographed by the camera 420, the feature point comparison unit 480 compares the feature points of the image received from the server device 100 and the person image 310 photographed by the camera 420 (step S220). When the feature points match, the mobile terminal 400 requests the moving image data from the server device 100 (step S221).

  The server apparatus 100 transmits the moving image data corresponding to the image data transmitted to the mobile terminal 400 in step S219 to the mobile terminal 400 (step S222). For example, the server device 100 refers to the management information box 001 and transmits the moving image data M1 corresponding to the image data P1 to the portable terminal 400.

  When the mobile terminal 400 receives the moving image data, the moving image reproduction unit 490 reproduces the moving image data by superimposing it on the person image 310 photographed by the camera 420 using a known AR technique (step S223).

  In addition, after authenticating with a regular user, the server apparatus 100 acquires an application ID from the mobile terminal 400 and registers it in management information in association with storage location information. In the second and subsequent video playback, when there is an access based on the storage location information from the mobile terminal 400, the server device 100 acquires the application ID from the mobile terminal 400, and the acquired application ID is registered as the app ID of the authorized user. The user authentication is performed automatically.

  As described above, according to the present embodiment, when the printed matter 300 output from the image printing apparatus 200 is photographed by the portable terminal 400, the moving image is superimposed on the printed matter 300 and reproduced to the portable terminal 400. Video data can be distributed. Further, by presenting an authentication key (password) when the printed material 300 is sold and requesting the input of the authentication key when the moving image is reproduced for the first time, only authorized users can reproduce the moving image.

  In addition, by setting the number of sellable and reproducible devices using management information stored in the database 160 of the server apparatus 100, it is possible to limit the number of prints 300 issued and the number of video playback terminals. For example, the value of the printed material 300 can be increased by limiting the number of issued sheets. In addition, by limiting the number of moving image playback terminals, it is possible to suppress duplication / distribution of the printed material 300.

  Since it is necessary to input an authentication key when the moving image is reproduced for the first time, an unauthorized user who has not purchased the printed material 300 cannot reproduce the moving image. Therefore, it is possible to prevent the unauthorized user from using the right to play a moving image.

  Different videos may be played back depending on the position of the user (mobile terminal 400) and the video playback time. In this case, as shown in FIG. 20, a plurality of moving images corresponding to conditions such as position and time are defined in the management information. The position of the user (mobile terminal 400) is acquired by the GPS 440. For example, if condition 1 is set to time 5:00 to 10:00, condition 2 is set to time 10:00:00 to 18:00, and condition 3 is set to time 18:00:00 to 5:00, then morning, noon, and night You can change the video to be played.

  When “position” is set as the condition, a specific moving image is played at a specific location. For example, by playing a video at an event venue, a special video related to the event can be viewed.

  In the management information condition, not only the position and time but also various device information (manufacturer, setting language, model name, IP address zone, network segment) that can be acquired from the mobile terminal 400 can be set. An application ID may be set in the management information condition.

  In the management information, a distribution period of moving image data may be set. Further, the distribution period of the moving image data may be extended by additional charging. In this case, the distribution period of the moving image data is different for each storage location information.

  The moving image data reproduction system may include a plurality of image printing apparatuses 200. The server apparatus 100 may set an image sales period for each image printing apparatus 200.

  When the sample image display unit 260 displays the sample image 700 on the touch panel 210, the two-dimensional code in the sample image 700 is preferably a two-dimensional code based on dummy information. As a result, it is possible to prevent the act of shooting the sample image 700 displayed on the touch panel 210 with the mobile terminal and playing back the moving image.

  When the server apparatus 100 transmits the storage location information in response to a request from the image printing apparatus 200, the print position information of the two-dimensional code may be transmitted together. The image composition unit 290 composes a two-dimensional code image with the image purchased by the user based on the print position information, and creates a composite image. Thus, by specifying the print position of the two-dimensional code, the two-dimensional code can be printed without deteriorating the quality of the person image. The code print position information may be determined by a licensor that provides image data. The code print position information may be transmitted when the server apparatus 100 transmits image data to the image printing apparatus 200 (step S202 in FIG. 19).

  In the above embodiment, an example in which image data is transmitted from the server apparatus 100 to the image printing apparatus 200 has been described. The image data and the authentication key information may be written in the memory 250 of 200.

  In this case, the image printing apparatus 200 may generate (issue) storage location information and code the storage location information to generate a two-dimensional code image. The image printing apparatus 200 includes a storage location information generation unit that generates storage location information by adding an additional digit number to a number that can be referred to by a corresponding box in the server device 100 (hereinafter referred to as an original number). By changing the additional digit number every time an image is purchased, the printed matter 300 sold by the image printing apparatus 200 has a different two-dimensional code 320 even if the person image 310 is the same. Since the storage location information includes a source number that allows the storage location of the moving image data to be specified even if the additional digit number is different, the same box is referred to by the internal processing of the server device 100. ing.

  The original number used by the image printing apparatus 200 for generating the storage location information can be written in the memory 250 by an operator operating the image printing apparatus 200, for example.

  When the moving image data reproduction system includes a plurality of image printing apparatuses 200, the number ID of the image printing apparatus 200 may be included in the additional digit number. Thereby, each image printing apparatus 200 can generate different storage location information.

  As described above, the image printing apparatus 200 generates the storage location information, whereby the management load of the storage location information in the server device 100 can be reduced. In addition, by giving an upper limit to the additional digit number, the number of printed products 300 sold can be managed by the image printing apparatus 200. Further, the communication function with the server apparatus 100 can be omitted from the image printing apparatus 200.

  In the second embodiment, the receipt printer of the image printing apparatus 200 may print the authentication key on the receipt and output it.

  In the second embodiment, the example in which the authentication key is presented to the user from the image printing apparatus 200 when the printed material 300 is purchased has been described. However, the user may be able to register the authentication key. In this case, when the printed material 300 is purchased, a two-dimensional code indicating the URL information of the authentication key registration site is displayed on the image printing apparatus 200. The user reads the two-dimensional code using the camera 420 of the portable terminal 400, accesses the authentication key registration site on the server device 100, and registers the authentication key.

  The URL information of the authentication key registration site is created in association with the storage location information. User authentication is performed when the user inputs an authentication key registered by himself / herself during the first playback of the moving image.

  When the mobile terminal 400 accesses the authentication key registration site, the server apparatus 100 may acquire an application ID from the mobile terminal 400 and register the acquired application ID as an authentication key. When the mobile terminal 400 accesses the server apparatus 100 based on the storage location information, user authentication using the application ID is automatically performed.

  In the second embodiment, it may be possible to select the presence / absence of user authentication during video playback. For example, it is possible to select whether or not user authentication is performed when purchasing the printed matter 300 in the image printing apparatus 200. In response to the selection, the server apparatus 100 transmits storage location information for performing user authentication or storage location information for which user authentication is not performed to the image printing apparatus 200. When the mobile terminal 400 accesses the server device 100 based on storage location information that does not perform user authentication, the user authentication process is omitted. The image printing apparatus 200 may change the selling price of the printed material 300 depending on the presence / absence of user authentication.

  The moving image reproduced on the portable terminals 4 and 400 is not limited to the one superimposed on the printed matter 3 and 300, and may be reproduced on the displays 44 and 450 regardless of the position of the printed matter 3 and 300.

  At least a part of the moving image data reproduction system described in the first and second embodiments described above may be configured by hardware or software. When configured by software, a program for realizing at least a part of the functions of the moving image data reproduction system may be stored in a recording medium such as a flexible disk or a CD-ROM, and read and executed by a computer. The recording medium is not limited to a removable medium such as a magnetic disk or an optical disk, but may be a fixed recording medium such as a hard disk device or a memory.

  Further, a program for realizing at least a part of the functions of the moving image data reproduction system may be distributed via a communication line (including wireless communication) such as the Internet. Further, the program may be distributed in a state where the program is encrypted, modulated or compressed, and stored in a recording medium via a wired line such as the Internet or a wireless line.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 Server apparatus 2 Image printing apparatus 3 Printed matter 4 Portable terminal

Claims (7)

A reading unit that reads storage location information of moving image data in the server device from a code image printed on a printed matter;
When authentication key information is requested from the server device with access to the server device based on the storage location information read by the reading unit, the authentication processing unit transmits the authentication key information to the server device in response to the request. When,
An image acquisition unit that acquires image data from the server device when the server device is authenticated as a regular user;
A comparison unit that compares feature points between an image acquired from the server device and an image on the printed matter acquired using a camera;
A video playback unit that receives the video data from the server device and plays back the received video data when the feature points match;
As a program that allows the mobile terminal computer to function. The computer further
A transmission unit for transmitting the moving image data and image data stored in the storage unit and the authentication key information to the server device;
A receiving unit for receiving data storage location information from the server device;
A transfer unit that transfers the image data and the storage location information to an image printing apparatus that creates the printed matter;
The program according to claim 1, wherein the program is made to function as: A server device that stores image data, moving image data, and authentication key information in a storage unit, and transmits the moving image data to a mobile terminal,
Authentication key information is requested from the portable terminal that has read the storage location information from the code image of the printed matter on which the image data and the code image obtained by encoding the storage location information for storing the moving image data are printed. And an authentication unit that performs user authentication using the authentication key information transmitted by the mobile terminal in response to this request and the authentication key information stored in the storage unit,
When the authentication unit authenticates with a regular user, a moving image data transmission unit that transmits the moving image data to the mobile terminal;
A server device comprising: A receiving unit that receives the image data, moving image data, and authentication key information from the mobile terminal;
A storage location information transmission unit for transmitting the storage location information to the mobile terminal;
The server device according to claim 3, further comprising:   The server apparatus according to claim 3, wherein the image data, the storage location information, and the authentication key information are transmitted to an image printing apparatus that creates the printed matter. A moving image data reproduction method using a portable terminal, an image printing device, and a server device,
The mobile terminal transmits moving image data and image data stored in a storage unit, and authentication key information to the server device,
The server device stores the moving image data, image data, and authentication key information received from the mobile terminal, and transmits data storage location information to the mobile terminal,
The portable terminal transfers the image data and the storage location information to the image printing apparatus;
The image printing apparatus prints a composite image obtained by synthesizing the code image obtained by encoding the storage location information and the image data on a photographic paper, and outputs a printed matter.
The portable terminal uses the camera to read the storage location information from the code image printed on the printed matter and access the server device,
The server device requests authentication key information from the mobile terminal in response to access from the mobile terminal, authentication key information transmitted from the mobile terminal in response to the request, and stored authentication key information; User authentication using
When the server device authenticates as a regular user, the mobile terminal acquires image data from the server device, and an image acquired from the server device and an image on the printed matter acquired using the camera. A moving image data reproducing method comprising: comparing feature points, and receiving the moving image data from the server device and reproducing the received moving image data when the feature points match. A moving image data reproduction method using a portable terminal, an image printing device that stores image data, and a server device that stores the image data and moving image data,
When the image printing apparatus receives a purchase order for the image data, the image data storage location information of the moving image data in the server apparatus is encoded to generate a code image, and the image data and the code image are combined. Is printed on photographic paper, the printed matter is output and the authentication key information is displayed.
The portable terminal uses the camera to read the storage location information from the code image printed on the printed matter and access the server device,
The server device requests authentication key information from the mobile terminal with access from the mobile terminal, performs user authentication using the authentication key information transmitted from the mobile terminal in response to the request,
When the server device authenticates as a regular user, the mobile terminal acquires image data from the server device, and an image acquired from the server device and an image on the printed matter acquired using the camera. A moving image data reproducing method comprising: comparing feature points, and receiving the moving image data from the server device and reproducing the received moving image data when the feature points match.

Images