JP6725591B2 - Photographing amusement device, control method for a photographing amusement device, and control program for a phototaking amusement device - Google Patents

Description

The present invention relates to a photo shooting game device, a photograph sticker creating device, a control method for a photo shooting game device, and a control program for a photo shooting game device. In particular, a user generates an image generated by using a photographed image taken by a camera. The present invention relates to a photography game device, a photograph sticker creating device, a control method of the photography game device, and a control program of the photography game device, which have a function to be provided to.

2. Description of the Related Art There is known a photography game device installed in a game center or the like and taking a photograph of a device user (user, player) or the like to generate an image. An example of a photo shooting game device is a photo sticker creating device that performs graffiti editing (writing with a pen, placement of stamps, etc.) on a taken image and then provides it as a printed matter such as a sticker.

An image different from the image obtained by the photographing is used for the photo-taking game device, by using the image obtained by photographing the user, trimming the image, or performing the collage using the image. It is known to have a function of generating a certain image to provide it to the user. Such a photography game device provides the generated provided image to the user by transmitting the generated provided image to a mobile terminal or the like owned by the user. For example, the photography game apparatus allows the user to select an image to be transmitted to the mobile terminal, and uses an image cut out from the selected image as the provided image for transmission to the mobile terminal.

The provided image is, for example, that the photography game device and the image provision server cooperate with each other in the photography game system configured by the photography game device as described above and the image provision server connected to be communicable. Provided to the user. For example, in such a photography game system, an image obtained by photographing the user is transmitted from the photography game device to the image providing server, and the image is made available through the image providing server. , Provide to the user. The image transmitted to the image providing server is provided to the user as image data by using the user's mobile terminal or the like.

Patent Document 1 below discloses a photograph sticker creating apparatus that crops a predetermined area of a photographed image of a user as a subject and creates an image to be provided to the user. This device is configured so that the user can select the filter processing after the image cutting operation for providing the image to the user.

JP, 2013-228699, A

The popularity of high-performance mobile terminals such as so-called smartphones is increasing among users year by year. There is a growing need for exchanging images with acquaintances using such mobile terminals, and displaying images on their own weblogs, social networking services (SNS), and the like.

If the user can generate an attractive image for the user, such as a highly designed image or an image as intended, by using the photography game apparatus according to such needs, the user's satisfaction will be improved. improves. That is, as an example, when posting an image created using the photo sticker creating device to a web service such as SNS, the user's face is clearly displayed in the image, while the faces of other users are hidden or unclear. There is a need such as wanting to keep it displayed. This is because when the face of another user is clearly displayed in the image, it is necessary to respect other users' intentions regarding the use of the image. In addition, there is a need to perform graffiti editing by emphasizing an image partially.

In the above case, blurring is effectively applied to an image, for example, blurring other portions while clarifying only the user's own portion, or partially blurring portions that do not undergo graffiti editing. If an attractive image can be generated in this way, user satisfaction is improved. However, heretofore, there has been no photography game device capable of applying such effective blurring. In response to the needs described above, graffiti such as pens and stamps are used to carry out editing work to hide desired parts, and the images created by them become unattractive images. There was a problem that sometimes.

The present invention has been made to solve such a problem, and is capable of easily generating an image to which blurring has been applied, a photography game device, a photograph sticker creating device, a photography game device control method, and a photograph. The purpose is to provide a control program for the photographing and playing device.

According to an aspect of the present invention to achieve the above object, a photography game device that provides a user with a provided image generated by using a photographic image obtained by shooting with a camera is provided with a plurality of images obtained by shooting with the camera. Among the photographic images, a photo selecting unit that selects a photographic image to be used for generating the provided image, and a user operation related to the processing process to be performed on the photographic image selected by the photo selecting unit are received, and the processing process is performed based on the reception result. A processing means, and a blurring means for accepting a user's operation for blurring processing applied to a photographic image processed by the processing means after the user's operation for processing, and performing blurring processing based on the reception result; And a generation unit configured to generate a provided image based on a processing result by the processing unit and the blurring unit, and a user operation regarding the processing process includes an operation of a cutting range of a photographic image, a scaling operation of a photographic image, a rotation operation of a photographic image, And at least one operation of selecting a type of filter processing for performing a combination of a plurality of image processes applied to a photographic image.
Preferably, the blurring unit receives the user's operation regarding the blurring process in which the entire area of the photographic image is subjected to the blurring when starting the reception of the user's operation regarding the blurring process.
Preferably, the blurring unit has a presenting unit that presents a plurality of blurring patterns to the user in a selectable manner, and a blurring pattern selecting unit that receives an operation by the user to select one of the plurality of blurring patterns to be applied, The plurality of blur patterns include a first blur pattern that uniformly blurs the entire area of the photographic image, and a second blur pattern that includes a specific region to which blur is not applied as part of the photographic image.

According to another aspect of the present invention, there is provided a method of controlling a photography game device that provides a user with a provided image generated by using a photographic image obtained by shooting with a camera. A photo selection step of selecting a photo image to be used to generate a provided image among images, and a processing step of accepting a user operation related to a modification process applied to the photo image selected in the photo selection step and performing a modification process based on the acceptance result And a blurring step of performing a blurring process on the basis of a reception result after accepting a user's operation regarding a blurring process applied to a photographic image processed in the processing step after the user's operation regarding the machining process, And a generation step of generating a provided image based on the processing result in the blurring step, and the user operation relating to the processing processing is an operation of a cutting range of a photographic image, a scaling operation of a photographic image, a rotation operation of a photographic image, and a photograph. It includes at least one operation of selecting a type of filter processing for combining a plurality of image processes applied to an image .

According to still another aspect of the present invention, a control program of a photography game device that provides a user with a provided image generated by using a photographic image obtained by shooting with a camera, includes a plurality of images captured by the camera. Processing for selecting a photo image to be used for generating a provided image from among the photo images, accepting a user operation relating to the modification process to be applied to the photo image selected in the photo selection step, and performing modification processing based on the acceptance result After the step and the user operation related to the processing process, the user operation related to the blurring process applied to the photographic image processed in the processing step is accepted, and the blurring process is performed based on the acceptance result. The computer performs the generation step of generating the provided image based on the processing result in the step and the blurring step, and the user's operations related to the processing processing include the operation of the cutting range of the photographic image, the operation of scaling the photographic image, and the rotation of the photographic image. The operation includes at least one of an operation and an operation of selecting a type of filter processing for combining a plurality of image processes applied to a photographic image .

According to these aspects of the invention, the operation of the user regarding the blurring process applied to the provided image is accepted in a state where the cutout range is set by the range setting unit and the filter processing is selected by the processing selection unit. Therefore, it is possible to provide a photography game device, a photograph sticker creating device, a control method of the photography game device, and a control program of the photography game device that can easily generate an image to which blurring has been applied.

It is a figure which shows the network connection example of the photograph sticker play system in one of the embodiment of this invention. It is a side view which shows the hardware constitutions of a photograph sticker preparation apparatus. It is a top view which shows the hardware constitutions of a photograph sticker preparation apparatus. It is a flow chart which shows play using a photograph sticker creation device. It is a block diagram explaining the composition regarding control of a photograph sticker creation device. It is a flow chart which shows an example of basic operation of a photograph sticker creation device. It is a sequence diagram which roughly shows operation|movement of the photograph sticker preparation apparatus and a server at the time of a user's play. It is a flow chart explaining the flow at the time of play of external monitor acceptance. It is a flow chart explaining the flow at the time of the play of photography. It is a 1st flowchart explaining the flow at the time of play of graffiti acceptance. It is a 2nd flowchart explaining the flow at the time of play of graffiti acceptance. It is a figure which shows an example of a graffiti edit screen. It is a flow chart which shows operation at the time of graffiti editing. It is a flowchart which shows the operation|movement at the time of cut image creation. It is a figure which shows a cut screen. It is a figure which shows a blurring edit screen. It is a figure which shows a cut image graffiti screen. It is a figure explaining the screen transition of an edit screen at the time of creation of a cut image. It is a flowchart of a cut screen reception process at the time of displaying a cut screen. It is a flowchart of a cut edit process. It is a figure explaining an example of operation when rotation operation is performed in the direction which makes a rotation angle large. It is a figure which shows the example of the trim area|region after performing rotation operation with respect to an original image. It is a flow chart which shows operation of the 1st rotation processing. It is a figure explaining the example of a display of a trim field when rotation operation is performed in the direction which makes a rotation angle small. It is a flow chart which shows operation of the 2nd rotation processing. It is a figure explaining the example of a display of the trim field when rotation operation and enlargement/reduction operation are performed. It is a flow chart explaining operation of rotation reset processing. It is a figure explaining an example of operation when a rotation operation is performed. It is a figure explaining the layer structure of the blurring preview image in a blurring edit screen. It is a flowchart which shows the blurring edit reception process. It is a figure explaining a blurring edit function. It is a figure explaining operation|movement when a pattern selection operation is performed. It is a figure explaining operation|movement when a position designation operation is performed. It is a figure explaining operation|movement when a size selection operation is performed. It is a figure which shows the example of a display of the blurring edit part when another blurring pattern is selected. It is a figure explaining operation|movement when a blurring pattern is selected. It is a figure explaining another example of operation when a blur pattern is selected. It is a figure which shows the blurring edit screen which concerns on the example of a changed completely type of this Embodiment. It is a figure which shows an example of a cut-out picture graffiti screen when a rotation operation is performed and an image after trimming is generated. It is a figure explaining the layer structure of the image preview-displayed on a cutout graffiti screen. It is a flow chart which shows cut-out picture graffiti acceptance processing. It is a figure explaining the layer structure of the image preview-displayed on the cutout graffiti screen in the modification of this Embodiment. It is a flow chart which shows operation at the time of collage creation. It is a figure explaining the screen transition of the edit screen at the time of collage creation. It is a figure which shows a design selection screen. It is a figure which shows the design selection screen at the time of selecting "simple collage." It is a figure which shows a design selection screen when "SNS A cover collage" or "SNS B cover collage" is selected. It is a figure which shows a collage screen when the design of "free collage" is selected. It is the 1st figure which shows the photograph selection screen when the design of "simple collage" is selected. It is the 2nd figure which shows the photograph selection screen when the design of "simple collage" is selected. FIG. 51 is a diagram showing an example of a result of operating the zoom bar from the state shown in FIG. 50. It is a figure which shows a collage screen when the design of "simple collage" is selected. It is a figure explaining the example of the conventional filter process. It is a figure explaining the density adjustment example of the filter process in this Embodiment. It is a flow chart which shows a cut picture creation processing in a photograph sticker creation device concerning a modification of this embodiment. It is a figure which shows the clipping image graffiti screen which concerns on this modification. It is a flowchart which shows the blurring edit reception process. It is a figure explaining the layer structure of the image preview-displayed on a cutout graffiti screen. It is a figure explaining the change process of the blurring process target.

Hereinafter, an example of a photo sticker playing system using the photo shooting playing device according to the embodiment of the present invention will be described.

The photograph sticker playing system (an example of an image providing system) is composed of a photograph sticker creating device (an example of a photograph taking and playing device) and an image providing server (an example of an image providing device). The image providing server acquires, from the photograph sticker creating apparatus, a plurality of images taken when the user plays the photograph sticker creating apparatus. Then, the acquired plurality of images can be provided to the user who played.

The photograph sticker creating apparatus outputs a sticker to be provided to the user by using a photographed image obtained by photographing the user with a camera, and also executes various functions. The photograph sticker creating apparatus generates a provided image to be provided to the user by using the captured image, and transmits the image to the image providing server. As a result, the image providing server provides the image to the user. The photograph sticker creating device generates a collage (collage image) obtained by collating photographed images or a cutout image (cutout image) obtained by cutting a part of the photographed image as a provided image, in addition to the image printed on the sticker and output. It has a function. As the collage image, for example, a background image displayed based on a user's setting operation in a web service provided on the Internet can be generated.

[Embodiment]

FIG. 1 is a diagram showing a network connection example of a photograph sticker playing system according to one of the embodiments of the present invention.

The photograph sticker creating apparatus 1 is provided with a photograph sticker playing system 901 together with an image providing server (hereinafter sometimes simply referred to as a server) 601 and a portable terminal device (hereinafter sometimes referred to as a portable terminal) 701 (701a, 701b). Constitute. The photo sticker creating apparatus 1 is installed in various stores such as a game center. The server 601 is managed by, for example, a data center. The mobile terminal 701 is owned by, for example, a user (user) who plays the photo sticker creating apparatus 1. Each device of the photo sticker playing system 901 is connected to a network 801 such as the Internet. Thereby, the photograph sticker creating apparatus 1 and the portable terminal 701 can communicate with the server 601 via the network 801. The photograph sticker creating apparatus 1 and the mobile terminal 701 may be able to communicate with each other.

The image providing server 601 is an electronic computer having a general hardware configuration, and includes a communication unit 603, a storage unit 605, a control unit 650 that controls each unit of the apparatus, and the like. The communication unit 603 connects the server 601 to the network 801 via a LAN (local information communication network) or the like. The storage unit 605 is, for example, an HDD (Hard Disk Drive). A control program 607 is stored in the storage unit 605. The control unit 650 includes, for example, a CPU and a memory. The control unit 650 controls the operation of each unit of the server 601 by executing the control program 607 and the like.

The mobile terminal 701 is, for example, a so-called feature phone or smartphone. The mobile terminal 701 has a communication unit 703, a storage unit 705, and a control unit 750. The communication unit 703 can be connected to the network 801 via a wireless LAN or a mobile phone network, for example. The storage unit 705 is, for example, a flash memory. A control program 707 is stored in the storage unit 705. The mobile terminal 701 further includes an operation unit 711, a display unit 713, a camera 715, and the like. The control unit 750 is composed of, for example, a CPU and a memory. The control unit 750 controls the operation of each unit of the mobile terminal 701 by executing the control program 707 and the like.

The photograph sticker creating apparatus 1 transmits the image data generated at the time of playing to the server 601. The server 601 stores the transmitted image data. The server 601 manages the image data in association with the data of the user who transmitted the image data. The server 601 has a function of accepting access from the mobile terminal 701 or the like and publishing image data corresponding to the user who owns the mobile terminal 701 to the mobile terminal 701. Thus, the user can use the mobile terminal 701 to acquire the image data stored in the server 601.

[Schematic configuration of photo sticker creating apparatus 1]

FIG. 2 is a side view showing the hardware configuration of the photograph sticker creating apparatus 1. FIG. 3 is a plan view showing the hardware configuration of the photograph sticker creating apparatus 1.

As shown in FIG. 2, the photograph sticker creating apparatus 1 includes a front housing (imaging housing) 510, a back housing 540, and an edit output device 570. The front case 510, the back case 540, and the edit output device 570 are arranged side by side and used as one photo sticker creating apparatus 1.

The front case 510 is provided with an advance customer service section 520 in which an external monitor 521, a coin insertion section 525 and the like are arranged. The advance customer service section 520 is arranged on the left side surface of the front case 510 of the photograph sticker creating apparatus 1 (it may be selectively arranged on one side, or may be on the right side surface). A front illumination device 511, a camera 515, an operation monitor 517, and the like are arranged inside the front housing 510.

A back lighting device 541 is arranged inside the back housing 540.

A seal outlet 575 is provided at the front of the edit output device 570. An edit reception unit 580 including an edit monitor 581, a touch pen 583, a non-contact communication device 585, a speaker 587, and the like is provided on both sides of the edit output device 570.

As shown in FIG. 3, the front case 510 and the back case 540 are combined to form a shooting corner (shooting booth). An opening is provided on both sides of the photographing corner, and this opening can be covered with a curtain (not shown). Also, the periphery of the edit output device 570 can be covered with a curtain (not shown). This allows the user to play without looking into the appearance of the game being played, the editing screen, and the like by another user.

As described above, various monitors (external monitor 521, operation monitor 517, editing monitor 581, etc.) are arranged in the photograph sticker creating apparatus 1. These monitors display various types of guidance during play, and also accept operational inputs from the user. Further, advertisements and advertisements are displayed on the monitor both when playing and when not playing. At this time, voice guidance, advertisements, etc. may be output from the speakers provided in each part of the apparatus.

FIG. 4 is a flowchart showing a play using the photograph sticker creating apparatus 1.

In the present embodiment, the play using the photograph sticker creating apparatus 1 is performed by roughly following the following four stages. Play is performed during operation in the normal operation mode.

When a specified number of coins are inserted into the coin insertion unit 525 of the advance customer service unit 520, the play starts. In step S1, the external monitor 521 accepts. At this time, the user stands at the position P1 shown in FIG. At this stage, guidance and advertisement regarding various plays such as images and sheets to be shot, edited, and created are provided to the user before the shooting is started. The user also performs various selection operations.

In step S2, shooting is performed. At this time, the user stands at the position P2 shown in FIG. 3, that is, in the shooting corner. In the shooting corner, based on various selection operations received by the advance customer service section 520, shooting is performed for the user according to the shooting course selected by various operations. At the same time, various operations by the user are accepted, and scribbleable image data is created.

In step S3, graffiti is accepted. At this time, the user stands at the position P3 (graffiti corner) shown in FIG. That is, the user stands so as to face either the left or right edit accepting unit 580a, 580b. In the graffiti reception, guidance regarding various selection tasks is given to the user who has finished playing in the shooting corner. Then, various selection operations for the sticker to be output and graffiti operations performed by the user are accepted. The image printed on the sticker is processed based on the acceptance result accepted at this time.

In step S4, the seal is output. At this time, the user stands at the position P4 shown in FIG. That is, the user waits in front of the seal discharge port 575 until the seal is discharged from the seal discharge port 575. When the seal is discharged from the seal discharge port 575, a series of main plays performed near the photograph sticker creating apparatus 1 are finished.

In this way, as the user moves in four stages while playing, the number of user groups who can use the photograph sticker creating apparatus 1 per unit time increases. That is, a maximum of 5 users can use the photo sticker creating apparatus 1 at the same time. Since it takes time to receive graffiti, it is configured such that two sets of users can play the stage of graffiti acceptance at the same time by using the two editing acceptance units 580a and 580b.

Since the hardware configuration of the photograph sticker creating apparatus 1 is known, detailed description thereof is omitted here. The photograph sticker creating apparatus 1 may have a hardware configuration different from the above. For example, a display panel is provided near the seal outlet 575 so that a user waiting there can see the information, and the user can use the display panel to display a guide or display an advertisement or the like. Good.

FIG. 5 is a block diagram illustrating a configuration relating to control of the photograph sticker creating apparatus 1.

The photograph sticker creating apparatus 1 has a control unit (control device) 501 including a CPU 502, a memory 503, an image processing unit 504, a storage unit 505, a communication unit 509, and the like, such as a PC (personal computer). ing.

The image processing unit 504 generates a pre-combine image to be used in the subsequent processing based on the information of the photographic image (photographed image) taken by the camera 515, or according to the graffiti accepted by the edit accepting unit 580. An edited image is generated, or a pre-combination image and an edited image are combined to generate a combined image. That is, the image processing unit 504 uses the captured image obtained by the camera 515 according to the acceptance result of the graffiti or the like accepted by the edit accepting unit 580 or the acceptance result of the operation input on the external monitor 521 or the like, and the sheet An image used for the subsequent processing, such as an image to be printed on the printer or an image to be transmitted to the server 601, is processed or an image is generated.

The storage unit 505 is, for example, a flash memory or an HDD, and has a control program 507.

The control unit 501 controls the operation of each unit of the photograph sticker creating apparatus 1 by the CPU 502 executing the control program 507.

The communication unit 509 has, for example, a PHS communication module, and can connect the photograph sticker creating apparatus 1 to the network 801.

The control unit 501 controls the external monitor 521, the speaker 527, the coin control unit 525a, and the like for the advance customer service unit 520. The coin control unit 525a controls the coin insertion unit 525, confirms the insertion state of coins, and notifies the control unit 501.

The control unit 501 controls the camera 515, the operation monitor 517, the strobe control unit 530, and the like for the front housing 510 and the back housing 540. The strobe control unit 530 controls the front illumination device 511 and the back illumination device 541 to emit light in an appropriate manner at a proper time.

The control unit 501 controls the edit monitor 581, the non-contact communication device 585, the speaker 587, the printing unit 590, and the like for the edit output device 570. The printing unit 590 prints (prints) the image processed by the image processing unit 504, and conveys the printed sheet to the sticker discharge port 575. The printing unit 590 outputs the sheet from the sticker discharge port 575.

Note that the configuration shown in FIG. 5 shows a conceptual configuration. For example, a PC is provided on the photographing corner side (the front housing 510 and the back housing 540), another PC is also provided on the graffiti corner side (editing output device 570), and these operate in cooperation to control. The functions of the unit 501 and the like may be realized.

[Explanation of operation of photo sticker game system 901]

The photograph sticker creating apparatus 1 cooperates with the server 601 and the mobile terminal 701 to roughly perform the following operation. First, with reference to FIG. 6, the basic operation of the photograph sticker creating apparatus 1 will be mainly described until the photograph sticker creating apparatus 1 can execute a play. Next, with reference to FIG. 7, a play performed using the photo sticker playing system 901 will be described.

FIG. 6 is a flowchart showing an example of the basic operation of the photograph sticker creating apparatus 1.

As shown in FIG. 6, when the photograph sticker creating apparatus 1 is started up, a startup process is performed in step S21. Here, various control programs 507 are read and executed, and if necessary, communication processing with the server 601 is performed. When the update data, the function setting command, and the like are transmitted from the server 601 in the startup process, the control unit 501 applies the update data and the function setting command to the photograph sticker creating apparatus 1. As a result, the photograph sticker creating apparatus 1 can be managed via the server 601. Note that such an operation may not be performed.

In the present embodiment, in the startup process, a process of synchronizing the internal clock of the photograph sticker creating apparatus 1 with another time on the network is performed. As a result, the internal clock of the photograph sticker creating apparatus 1 is maintained relatively accurately, and the play time can be accurately recorded. Note that such time synchronization processing may be performed by various known methods. Further, it may be performed not only at the time of startup but also periodically (for example, every day).

In step S22, the control unit 501 displays the demo screen on the external monitor 521 or another monitor.

In step S23, the control unit 501 confirms whether to enter the test mode. For example, when a predetermined switch or the like arranged at a position accessible only to the administrator is operated, the control unit 501 determines to enter the test mode.

In addition, in step S24, the control unit 501 confirms whether or not a consideration for playing has been received.

The control unit 501 waits while displaying the demo screen until the consideration is accepted or it is confirmed that the test mode is entered.

When it is determined in step S23 that the test mode is entered, the test mode is executed in step S26. In the test mode, the administrator can set various functions of the photo sticker creating apparatus 1. That is, the test mode is an operation mode for function setting. When the test mode ends, the demo screen is displayed again (S22).

When it is determined in step S24 that the specified number of coins have been inserted into the coin insertion portion 525 and the consideration has been accepted, in step S25, play is executed. The play is performed as described in FIG. When the play using the photograph sticker creating apparatus 1 ends, the operation returns to step S22.

FIG. 7 is a sequence diagram schematically showing the operations of the photograph sticker creating apparatus 1 and the server 601 during the user's play.

When the user inserts a coin into the photograph sticker creating apparatus 1 to execute the play, the play is started. This time point is recorded as the play start time. As shown in FIG. 7, in step S51, the photograph sticker creating apparatus 1 performs photographing and editing. That is, the external monitor reception (S1), the photographing (S2), and the graffiti reception (S3) described in FIG. 4 are performed. The user can perform graffiti editing input in the editing stage.

When the editing is completed, the user performs an operation for selecting an image to be acquired on the mobile terminal 701 on the photograph sticker creating apparatus 1. In addition, the user performs an operation of inputting a mail address for receiving information for obtaining an image on the photograph sticker creating apparatus 1.

In step S52, the photograph sticker creating apparatus 1 associates the transmission image data based on the photographed image and the mail address with each other, and transmits them to the server 601. At this time, the photograph sticker creating apparatus 1 also sends the transmission image together with the attribute information. As the attribute information, for example, the image ID, the shooting date and time, the information about the type of image such as the shooting mode and the play course name, and other information about the play are transmitted as the attribute information.

In step S53, the photo sticker creating apparatus 1 performs printing. When printing is completed, the printed sheet (sticker) is discharged from the sticker discharge port 575.

In step S54, the user acquires the sheet discharged to the seal discharge port 575.

On the other hand, when data is transmitted from the photograph sticker creating apparatus 1 to the server 601, the server 601 receives the transmitted information in step S55.

In step S56, the server 601 performs a database recording process using the received information.

The server 601 generates image data for the mobile terminal (acquisition image data) based on the received transmission image data, and holds the image data so that the image data can be browsed through an acquisition page for allowing the user to acquire the image data. The acquisition page is held so that it can be acquired from the outside by the web server function of the server 601, for example. At this time, an acquisition URL for accessing the acquisition page is generated. In step S57, the server 601 transmits the acquisition URL (acquisition page address) to the user. At this time, for example, using the mail address transmitted from the photograph sticker creating apparatus 1, the information is transmitted to the user's portable terminal 701 or the like by electronic mail.

In step S58, the user mobile terminal 701 receives the acquisition URL.

In step S59, the user operates the mobile terminal 701 to access the acquisition URL by using a web browser or the like operating on the mobile terminal 701.

In step S60, the server 601 transmits the data of the acquisition page to the mobile terminal 701. At this time, the mobile terminal image data of the image browsed when the acquisition page is displayed is also transmitted to the mobile terminal 701.

In step S61, the mobile terminal 701 displays an acquisition page including an image based on the acquired acquisition page and image data. Thus, the user can obtain the image for the mobile terminal from the server 601. As a result of playing, the user can receive the sheet and can acquire the image for the mobile terminal. Therefore, the enjoyment of playing is increased for the user.

Next, the operation of the photograph sticker creating apparatus 1 during play will be specifically described. When playing the photo sticker creating apparatus 1, the flow of each stage is as follows, for example. Each operation is performed under the control of the control unit 501. In each process, the display contents of the external monitor 521, the operation monitor 517, the editing monitor 581 and the like will be mainly described, but voice guidance using the speakers 527 and 587 and the like is appropriately performed along with the screen display.

FIG. 8 is a flow chart for explaining the flow at the time of playing the external monitor reception.

As shown in FIG. 8, when the play is started, the play is explained in step S101. For example, by displaying an image on the external monitor 521 or outputting a sound from the speaker 527, a series of flows of play and a play course described later will be described.

In step S102, the selection of the play course is accepted. In this embodiment, a plurality of play courses are provided according to the atmosphere of the image that can be generated. The user can select and play these play courses. The control unit 501 determines the selected play course as the play course of the play, and thereafter controls the play with a predetermined control content (such as a shooting course) according to the play course.

In step S103, a name input is accepted. For example, a screen for prompting the user to input a name is displayed. The entered name is used when editing graffiti or as part of the design of the background or frame.

In step S104, a screen for selecting a background or the like that differs depending on the course is displayed to the user who has selected the course. For example, a display/guidance such as "Please select 6 backgrounds" is performed, and the user selects a desired background or sheet design.

In step S105, the control unit 501 determines whether the shooting corner is empty (whether it is in use).

If the shooting corner is not available in step S105, the control unit 501 causes the external monitor 521 to display a wait screen until the shooting corner is available in step S106. For example, an advertisement screen of a website accessible by a mobile terminal is displayed as a wait screen.

If the photographing corner is available in step S105, the photographing corner guidance screen is displayed in step S107. As a result, the user who has completed various operations in the advance customer service section 520 is guided to the shooting corner.

The control unit 501 uses the information received by the advance customer service unit 520 to perform shooting at the shooting corner.

FIG. 9 is a flow chart for explaining the flow at the time of playing shooting.

As shown in FIG. 9, in step S121, the control unit 501 causes the operation monitor 517 to display a shooting start screen. A screen that prompts the user to start shooting is displayed. When the user touches the operation monitor 517, the operation shifts to the shooting sequence.

In step S122, the shooting sequence is started. A captured image is obtained by the capturing sequence. It should be noted that in the present embodiment, shooting is performed, for example, six times per play. This allows the user to create a photograph sticker or acquire an image provided via the server 601 based on the six different captured images.

In step S123, image selection and brightness selection are performed. Here, it is selected which of a plurality of settings (for example, settings in each of 5 stages) is to be applied while displaying a preview of the captured image.

In step S124, the control unit 501 determines whether the graffiti corner is free (is not in use). For example, if one of the edit reception units 580a and 580b is not being used by another user, it is determined that the graffiti corner is open.

If the graffiti corner is not empty in step S124, the control unit 501 causes the operation monitor 517 to display a wait screen until the graffiti corner is empty in step S125. As the weight screen, the same advertisement screen as described above can be displayed.

If the graffiti corner is vacant in step S124, the graffiti corner guidance screen display is performed in step S126. As a result, the user who has completed shooting is guided to the graffiti corner. At this time, the user may be prompted to move to one of the editing accepting units 580a and 580b, whichever is more appropriate. For example, a guide such as "Move to the 1st graffiti corner on the right."

FIG. 10 is a first flowchart illustrating the flow of graffiti acceptance during play. FIG. 11 is a second flowchart for explaining the flow at the time of playing graffiti acceptance.

As shown in FIG. 10, when the graffiti acceptance is started, the control unit 501 causes the edit monitor 581 to display a data transfer start screen in step S131. Here, the image data created based on the play course and background image selected on the external monitor and the image and brightness of the eyes selected in the shooting corner are transferred to the graffiti corner from the shooting corner. .. Then, a screen indicating that is displayed.

In step S132, the screen touch is accepted. Here, the touch operation of the edit monitor 581 is received using the touch pen 583. When a touch operation is performed or when a predetermined time elapses, the process proceeds to the next process.

When the touch operation is accepted, graffiti guidance is performed in step S133. The user is informed that the graffiti operation will be started. For example, a message such as “Next time you write!” is displayed. After the image data is transferred, various processes are performed on the image data used for graffiti during the period in which this image is displayed. When the processing for the image data is completed, the next processing is performed.

In step S134, graffiti editing is started. The graffiti edit is performed by displaying a graffiti edit screen on the edit monitor 581 and receiving an operation from the user. The graffiti edit screen includes an image based on the captured image. The user can perform graffiti editing on each image within a predetermined time. By the graffiti editing, graffiti called "pen" performed by writing using the touch pen 583, a predetermined pattern, and a pattern generated according to the user's input contents (name input, etc.) up to this point are touch pen. Graffiti called “stamp” arranged at the position designated by 583 can be performed. When these graffiti are performed, an edited image including the graffiti is created. The edited image and the image initially displayed on the graffiti editing screen are combined to generate a scribbled image. In addition, when graffiti is not performed on the image, the edited image not including graffiti and the original image are combined to generate an image without graffiti.

In step S135, an explanation screen for selecting the number of divisions is displayed to guide the user to move to sheet design selection.

In step S136, the seat design selection is accepted. Here, for example, the user receives a selection of the number of images to be printed per sheet. The seat design selection is performed, for example, according to the selected play course.

As shown in FIG. 11, a transmission image selection process is performed in step S138. In the present embodiment, at the time of a basic play, the user's mobile terminal 701 can be made to acquire, for example, one image of the captured image or the composite image created by the play. The control unit 501 receives from the user an operation of selecting an image to be acquired by the mobile terminal 701. The image is not an image set to be provided to the user free of charge regardless of the user's selection, such as a photographed image, a graffiti image that can be printed as a sticker, and a bonus image generated as described below. You can choose from all of the images. Note that up to two users each select a desired image or when a predetermined time elapses, the next screen is displayed. When a predetermined time has elapsed and a time-out has occurred, the image selected at the time-out is selected.

In step S140, the address input screen is displayed. Here, the input of the e-mail address or the like of the mobile terminal 701 is accepted. When the e-mail address or the like is input, the information is transmitted to the server 601. Thereby, for example, the server 601 notifies the portable terminal 701 of the URL that enables the selection image selected in step S138 to be acquired by a method such as electronic mail. The user can access at least the selected image from the images separately sent from the photograph sticker creating apparatus 1 to the server 601 by accessing the URL with the mobile terminal 701.

The address input screen in step S140 may be configured so that transmission by non-contact communication (NFC communication or the like) can be selected. When this is selected, the non-contact communication operation screen is displayed in step S141. The control unit 501 can control the non-contact communication device 585 and transmit information such as a URL that enables acquisition of the selected image to the mobile terminal 701 held over the non-contact communication device 585. The non-contact communication operation screen includes a description of actions to be performed by the user. The non-contact communication operation screen may be displayed until the communication to the mobile terminal 701 is successful or the “return to address input” button is operated, for example.

When the input is completed in step S140, in step S142, the control unit 501 determines whether the printing unit (printer) 590 is empty (is not in use).

If the printing unit 590 is not empty in step S142, the control unit 501 causes the edit monitor 581 to display the advertisement screen until the printing unit 590 is empty in step S143. For example, the same advertisement screen as the website described above is displayed.

If the printing unit 590 is empty in step S142, printing is performed in step S144. The control unit 501 generates image data to be printed and transfers it to the printing unit 590. As a result, the printing unit 590 prints the sticker. It should be noted that if an error such as running out of paper has occurred in the printing unit 590, a printer error screen may be displayed. At this time, contact information for performing maintenance is displayed.

In step S145, the graffiti corner end screen is displayed on the edit monitor 581. The user is guided to wait in front of the sticker discharge port 575 until printing is completed. As a result, the seal is discharged from the seal discharge port 575, and the series of plays ends.

[Explanation about graffiti editing]

In the present embodiment, graffiti editing is performed by displaying the following graffiti editing screen (normal graffiti screen).

FIG. 12 is a diagram showing an example of the graffiti edit screen.

As shown in FIG. 12, the graffiti editing screen 100 is configured so that two users can simultaneously perform graffiti editing operations (sometimes referred to as “normal graffiti”). That is, the graffiti edit screen 100 is roughly divided into two left and right edit screens 101 (101a, 101b). Icons, images, and the like showing the same function are arranged on each edit screen except for the remaining time display 119 described later and a part of the display (display for changing the date or name). Note that the following description of the edit screen may be given with reference to the area LH assigned to one user on the left side, and the edit screens 101a and 101b are not particularly distinguished, and are collectively referred to as edit screens. It is called screen 101.

The edit screen 101 includes a graffiti target image 111, a thumbnail portion 113, a palette 115, a simple scribble setting button 116, a command icon 117 (117a, 117b, etc.), a remaining time display 119, and the like. In the thumbnail portion 113, as an image based on the photographed photograph, an image sent from the photographing corner or an image after graffiti is added to the thumbnail is displayed. In the graffiti target image 111, the image selected as the editing target in the thumbnail portion 113 is displayed. The user operates the palette 115 or the like for the image displayed on the graffiti editing screen 100 to arrange characters or figures on the image (so-called “doodle”. Specifically, writing lines or characters or a predetermined character). You can paste stamp images, frame images, etc.). Also, the user can operate the simple scribble setting button 116 to automatically arrange characters or figures by face discrimination processing or the like, and perform graffiti on the image. As the command icon 117, buttons for executing various operations, such as the edit end button 117a and the undo/redo button 117b, are displayed, and the user can intuitively operate using these buttons. The remaining time display 119 displays, for example, the remaining time in seconds, excluding the time that has already elapsed, of the time when the user is allowed to perform graffiti editing. The user needs to perform graffiti editing and bonus image editing work described later within the displayed time.

The plurality of images displayed in the thumbnail portion 113 can be jointly edited by the left and right users during the same play. The image to be edited by one user is displayed in the thumbnail portion 113 with a display indicating that “scribble” or the like, and is controlled so that the other user cannot select it as an edit target. It By performing such exclusive control, the editing of each image can be efficiently advanced by two users.

Here, in the present embodiment, graffiti edit screen 100 includes a creation button 118 that is operated to create a bonus image (sometimes referred to as “bonus graffiti”). That is, in the graffiti editing, the user is also allowed to create a bonus image other than the graffiti reflected on the sticker paper.

The create button 118 is displayed when a predetermined condition is satisfied (may be referred to as “appearance”). For example, the create button 118 may be made to appear when a predetermined time has elapsed from the start of graffiti editing, or when all the images displayed in the thumbnail portion 113 have been scribbled once. .. As a result, most of the time allotted to the graffiti editing operation will be spent on the bonus image creation work, while the graffiti necessary for outputting a highly complete sticker is hardly performed. It can be prevented. Therefore, as a whole, the satisfaction of the user can be greatly increased. Until the create button 118 is displayed, for example, a preliminary image surrounded by a broken line may be displayed in the area where the create button 118 is to be displayed, or an image in which the color of the create button 118 is dimmed is displayed. This may be replaced by displaying a grayscale image. Further, no image may be displayed until the creation button 118 appears. The create button 118 may be displayed from the beginning when graffiti editing is started.

As the create button 118, two buttons (first create button 118a and second create button 118b) are displayed. In the present embodiment, two types of images can be created as bonus images. That is, by operating the first creation button 118a, a cutout image (cutout image) obtained by cutting out a part of a captured image can be created (this function is sometimes referred to as "cutout image creation"). Further, by operating the second creation button 118b, a collage (collage image) using the photographed image can be created (this function may be referred to as "collage creation").

The cutout image is a trimmed image (image after trimming) created by partially cutting (trimming) one captured image obtained by the previous play, and the trimmed image and frame. A composite image obtained by synthesizing images with each other, or a composite image obtained by synthesizing edited images with graffiti on them (images obtained by combining the trimmed image with the edited image, after trimmed image with the frame image, and edited The image is a composite image).

The collage image is an image created by combining a plurality of captured images obtained by the previous plays and the trimmed images thereof with the scribble image and the template image.

The user displays these cutout images and collage images on profile images and user-related web pages that are treated as user images in web services such as SNS (social networking services) provided on the Internet. Can be used as a background image.

Note that, for example, the creation button 118 may be displayed with another name such as “blog button” or “SNS button” according to the purpose of the bonus image to be created, or the creation button 118 may be displayed on the editing screen 101. May display a single button. When a single button is displayed as the create button 118, a screen that prompts the user to select whether to create a cutout image or a collage is displayed on the screen that transitions when the create button 118 is operated. By presenting the image, one of the cutout image and the collage designated by the user may be created.

When the cutout image or the collage image is transmitted to the server 601 as described above, the user can obtain the image by accessing the server 601 using the mobile terminal 701 as follows. The operation of the server 601 described below is performed by the control unit 650 of the server 601 executing the control program 607 to control each unit of the server 601.

The server 601 provides information to the mobile terminal 701 in response to access from the mobile terminal 701 owned by the user. Further, it receives from the mobile terminal 701 information corresponding to the operation input by the user to the mobile terminal 701, and performs processing according to the operation. Specifically, the server 601 functions as a web server according to the operation of the web browser operating on the mobile terminal 701. Then, by appropriately providing web page information and image information such as a document described in HTML (Hypertext Description Language) to the mobile terminal 701, the display unit 713 displays a screen viewable by the user. The server 601 may be configured to display a screen on the display unit 713 by providing information in a predetermined format or image information to a predetermined application running on the mobile terminal 701.

FIG. 13 is a flowchart showing the operation at the time of graffiti editing.

As shown in FIG. 13, during graffiti editing, normal graffiti and bonus graffiti can be appropriately performed until the graffiti time ends (the period given to graffiti expires).

That is, when the graffiti edit is started, the normal graffiti screen (doodle edit screen 100) is displayed in step S301, and the normal graffiti can be performed. Along with this, timing of the graffiti time is started.

In step S303, the control unit 501 determines whether to create a cutout image (whether to enter a cutout image creation mode). When the first creation button 118a is operated during normal graffiti, it is determined that a cutout image is created.

If it is determined in step S303 to create, in step S304, the control unit 501 creates a cut image (details will be described later). Once the cut image creation is completed, the graffiti editing screen 100 is returned (return to step S301).

In step S305, the control unit 501 determines whether to create a collage (whether to enter the collage creation mode). If the second creation button 118b is operated during normal graffiti, it is determined to create a collage.

If it is determined in step S305 to create a collage, the control unit 501 creates a collage in step S306 (details will be described later). Once the collage creation is completed, the screen returns to the graffiti edit screen 100 (return to step S301).

When a cutout image or collage is being created, even if the cutout image or collage is incomplete (even if it is in the process of being created), you can interrupt the creation and return to the normal scribble screen ( S301). Even in such a case, when the create button 118 is operated again, creation of each image can be restarted (S304, S306).

In step S307, the control unit 501 determines whether or not the graffiti time has ended. The processes of steps S301 to S306 are performed until the doodle time ends. That is, the user can perform either normal scribble, cut image creation, or collage creation until the scribble time ends.

When the graffiti time ends in step S307, the graffiti editing ends in step S308. After that, the operation shown in FIG. 13 is continuously performed.

Note that the processes of steps S301 to S306 described above may be performed independently by the users on the left and right of the editing screen 101. That is, when one of the two users is normally performing graffiti, the other user can create a cutout image or a collage. The graffiti time may be measured in common for each user.

During graffiti editing, the edit screen is roughly changed according to the user's operation or the like. As a result, it is possible to perform “normal scribble”, create cutout images, and create collages while the respective suitable editing screens are displayed.

[Explanation of cut image creation]

FIG. 14 is a flowchart showing the operation when creating a cut image.

At the time of creating a cutout image, the control unit 501 roughly changes three types of screens (a cutout screen 140, a blurring edit screen 160, and a cutout image graffiti screen 180) while changing the information used to create the cutout image as follows. Accept input.

That is, as shown in FIG. 14, when the cut image is created, the cut screen 140 (step S321), the blurring edit screen 160 (step S323), and the cut image graffiti screen 180 (step S325) as the user's creation work progresses. By sequentially displaying, the user can perform an operation for creating a cutout image.

Note that when transitioning to the cut screen 140, various images used to display the cut screen 140 are generated (step S321).

In addition, when transitioning to the blurring edit screen 160 or the cutout graffiti screen 180, it may take time to generate an image used for creation work on the transition destination screen. In such a case, a predetermined standby screen is displayed (steps S322 and S324).

FIG. 15 is a diagram showing the cut screen 140.

FIG. 15 shows only one side of the cutout screen 140 (only one of the screens configured to be operated by two people on the left and right). The cropping screen 140 is used to set a cropping range of a trimmed image obtained by cropping a captured image when creating a cropped image, and to perform filter processing on the cropped image (image processing in which a combination of a plurality of image processes is designated. It is displayed when performing selection work of (Filter).

Here, as the filter processing, for example, a plurality of combinations of image processing for various elements such as contrast, color balance, tone curve, again, transparency, type of texture and its combining method are set for the original image. It has been done. The application of filter processing means that a combination of a plurality of image processings set in advance as the filter processing is applied to an image.

As shown in FIG. 15, the trimming screen 140 selects a trim area 141 for adjusting the trimming range of a photographed image, a photograph selection area 151 for selecting a photographed image to be trimmed, and a filter process. Filter selection area 153 for The cut screen 140 also includes a decision button 157, a return button 158, and a previous screen button 159. The enter button 157, the return button 158, and the previous screen button 159 are used when changing screens.

The trim area 141 includes an image edge display frame 143, an image display area 145, a zoom bar 147, a rotation bar (angle slide bar) 148, and a rotation reset button 149.

The image edge display frame 143 is a display indicating that the inside is an edge portion of an image finished as a cut image. In the present embodiment, the range surrounded by the image edge display frame 143 is the cutout range, which is cut out when the enter button 157 is operated and becomes the cutout image (hereinafter, sometimes referred to as trimmed image). .. The range outside the image edge display frame 143 by a predetermined distance or the range inside the image edge display frame 143 may be set to be the cutout range.

The image display area 145 is an area surrounded by the image edge display frame 143. In the image display area 145, a portion of the original captured image (original image) to be clipped that is surrounded by the image edge display frame 143 is displayed. Other parts of the original image are hidden. The part of the original image outside the image edge display frame 143 may be displayed in the same manner as the image display area 145, or the display mode such as saturation and density may be changed from the image display area 145 for display. It may have been done. At this time, the captured image is displayed in a state in which the filter processing 155 selected in the filter selection area 153 is reflected.

The zoom bar 147 is a portion operated to enlarge (reduce) the cut range. The zoom bar 147 is composed of a vertically long image of the rail portion and an image of a rectangular knob portion arranged so as to slide along the rail portion. The user can change the size of the original image with respect to the image edge display frame 143 by sliding the knob portion along the rail portion using the touch pen 583 (enlargement/reduction operation). By adopting such a UI, the user can intuitively adjust the clipping range.

In the present embodiment, a case where the size becomes larger than the size of the currently displayed image is called expansion, and a case where the size becomes smaller is called contraction. Since the image quality is deteriorated when the original image is enlarged, the original image is actually reduced and displayed on the cut screen 140 in accordance with the size to be displayed at that time. For example, it is assumed that the image size includes size 1 (0.6 times the original image), size 2 (0.7 times the original image), and original image (1.0 times the original image). At this time, when the size 1 is displayed, the original image is reduced by 0.6 times and displayed on the cut screen 140. When the image is enlarged from size 1 to size 2 and displayed, the image displayed in size 1 is not enlarged but the original image is reduced by 0.7 times and displayed on the cut screen 140. This causes the image to appear to expand when size 1 is changed to size 2.

The rotation bar 148 is a part operated to rotate the original image displayed in the cutout range with respect to the cutout range. The rotation bar 148 is composed of an image of the rail portion displayed horizontally and an image of a rectangular knob portion arranged so as to slide along the rail portion. The user can change the angle of the original image with respect to the image end display frame 143 by sliding the knob portion along the rail portion using the touch pen 583 (rotation operation). By adopting such a UI, the user can intuitively adjust the clipping range. The rotation center of the rotation bar 148 when it is operated is located in the center of the image display area 145, for example.

In order to inform that the size and angle of the original image can be adjusted with the zoom bar 147 and the rotation bar 148, an animation showing the operation method is displayed when the cut screen 140 is displayed for the first time, or an operation method with a pop-up image is displayed. Or a message such as “You can adjust the size of the image here” or “You can rotate the image here” may be displayed near the zoom bar 147 or the rotation bar 148.

Here, in the present embodiment, the rotation reset button 149 is arranged near the rotation bar 148. When the user operates the rotation reset button 149, the angle of the original image with respect to the image edge display frame 143 returns to the initial state (rotation angle 0 degree). This allows the user to more easily create the cut image.

In the trim area 141, the user can move the original image with respect to the image edge display frame 143 in the cut screen 140 by performing an operation of sliding while touching the image display area 145 with the touch pen 583 ( Move operation). Thereby, the user can adjust the desired position in the original image to be the cutout region. When the moving operation is possible, the pointer icon (such as an image indicating the operation position of the touch pen 583) displayed on the cut screen 140 is set to an image different from that when the moving operation is not performed, so that the moving operation is performed. You may make it easy for the user to recognize that there is.

In the image display area 145, a display indicating that the original image can be moved is displayed. For example, as shown in FIG. 15, an arrow icon image 144 is displayed in the center of the image display area 145. The icon image 144 is initially displayed when the original image is arranged in the image display area 145, and then, when the user touches the image display area 145 with the touch pen 583, the icon image 144 is in a non-display state. Accordingly, even a user who creates a cut image for the first time can intuitively know the operation method and can easily perform the creation operation.

On the cut screen 140, the user can select a captured image to be cut and a filter process 155 to be applied to the captured image in each of the photo selection area 151 and the filter selection area 153. The selected result is immediately reflected in the trim area 141, and the position and size of the original image in the cut image to be created, such as the size and filtering of the original image, can be adjusted.

In the photograph selection area 151, for example, six photographed images photographed in the previous play are displayed. In the present embodiment, for example, four up images having a horizontal-to-vertical ratio of 1:1.2 and two full-frame images of 9:16, which are captured in the imaging sequence, are selection candidates. Is displayed as. Usually, a captured image in which an edited image input by graffiti is not combined is used as a target of a cutout image.

In the filter selection area 153, eight types of filter processing 155 are prepared, including those not subjected to special image processing such as color tone and brightness (“no processing”). That is, the user can select whether or not to apply special image processing to the cutout image, and, if so, which of the seven types of filter processing 155 to use.

The user performs an enlarging/reducing operation, a rotating operation, and a moving operation in the trim area 141 as necessary so that a desired image is displayed in the image display area 145, and in that state, the enter button 157 is pressed. To operate. Then, the original image is cut out in the cutting range based on the position and angle of the original image with respect to the image edge display frame 143 currently displayed and the size of the original image (or the enlargement ratio in the cut screen 140). An image is created after trimming. At this time, an image in a state where the selected filter processing 155 is applied (reflected state) is displayed in the image display area 145. That is, at this time, a preview display of the created image is displayed in the image display area 145. The user can adjust the cropping range of the image while checking the image created in this way. Then, the operation using the blurring edit screen 160 is performed.

Note that when transitioning to the cut screen 140, an image to which each of the applicable filter processes 155 is applied is generated in advance for each of the selectable captured images. By using the image generated in this manner, when generating the trimmed image on the cut screen 140, it is possible to quickly perform a preview display of the image display area 145 according to a user operation.

FIG. 16 is a diagram showing the blurring edit screen 160.

In FIG. 16, only one side of the blurring edit screen 160 is shown. The user can use the blurring editing screen 160 to perform a blurring operation on the post-trim image in a desired manner (blurring function). As shown in FIG. 16, the blurring edit screen 160 includes a blurring edit unit 161, a blurring pattern selection unit 171, a decision button 177, a return button 158, and a previous screen button 179. The determination button 177, the return button 158, and the previous screen button 179 are used at the time of screen transition, like the buttons 157 to 159 on the cut screen 140 described above.

A blur preview image 163 is displayed on the blur editing unit 161. The blurred preview image 163 is an image after trimming in the initial state. As the blurring preview image 163, an image to which the blurring pattern has been applied is preview-displayed.

The blurring pattern selection unit 171 presents a plurality of blurring patterns 173 (173a to 173g) to the user in a selectable manner, for example. Further, the blurring pattern selecting unit 171 is provided with a blurring size selecting unit 175 of a region to be blurred with respect to a specific blurring pattern 173.

On the blurring edit screen 160, the user performs a pattern selection operation for selecting a favorite one of the plurality of blurring patterns 173 for the blurring preview image 163 displayed in the blurring editing unit 161. The display of the blurred preview image 163 is changed according to the pattern selection operation. When the user operates the enter button 177, an image is generated with the contents of the blurred preview image 163, and the generated image is adopted as a cutout image which is a base for graffiti editing. That is, when the enter button 177 is operated, the cutout image graffiti screen 180 is displayed so that the blurred preview image 163 at that time can be edited in graffiti.

Here, in the present embodiment, seven types of blurring patterns 173a to 173g are prepared to be applicable on the blurring editing screen 160. The blur pattern 173 roughly includes blur patterns 173b, 173c, 173d, 173e, and 173f that partially include a specific region (hereinafter, also referred to as a focus region) to which the blur of the cut image is not applied, and such a blur pattern. It can be divided into blur patterns 173a and 173g that do not include a region. That is, the blur pattern 173g does not apply blur to the entire area of the image (“no blur”). Further, the blurring pattern 173a uniformly blurs the entire area of the image (“all blur”).

Among the blurring patterns 173, a plurality of blurring patterns 173 including a focus area to which blurring is not applied are prepared, each having a different focus area shape. That is, the blur pattern 173b has a heart-shaped focus area (“heart”). The blur pattern 173c has a circular focus area ("Maru"). The blurring pattern 173d has a horizontally long elliptical focus area (“ellipse”). The blur pattern 173e has a vertically long rectangular focus area ("vertical"). The blur pattern 173f has, for example, a mountain-shaped focus area below the image (“mountain”).

Here, among the blurring patterns 173, the blurring pattern 173f of “mountain” can be selected only when the image in which the whole body of the user is included in the angle of view is clipped on the clipping screen 140. It is configured. This is because the blur pattern 173f is suitable for, for example, emphasizing the user's feet in an image in which the lower portion of the image is the focus area 165a and the whole body is within the angle of view. Not limited to this, whether or not each blur pattern 173 can be selected is automatically changed according to the photograph shape of the image that has been cut out (angle of view of the close-up image or the full-body image). You may do it. Further, the selectable blurring pattern 173 may be automatically changed according to a predetermined appearance condition based on the information about the shooting course and other play, shooting, etc., without being limited to the photograph shape of the image.

When the user selects one of the blur patterns 173 in the blur pattern selection unit 171, the control unit 501 specifies the focus area according to the selected blur pattern. As a result, the user can generate a cutout image that includes the focus area of a shape that the user thinks is preferable and that blurs other areas. When the blur pattern 173g of "no blur" is selected, the blur is not applied. In other words, at this time, the focus area is specified as the entire area of the image. On the other hand, when the "blurred" blur pattern 173a is selected, the entire area of the image is blurred uniformly. In other words, at this time, the focus area is specified as not included in the image.

Note that, when the blur pattern 173 including the focus area is selected, the position or size of the focus area in the cutout image can be changed. For example, in order to change the size of the focus area, the blur size selection unit 175 may select an appropriate size. As a result, the size of the focus area is changed according to the size selected by the blur size selection unit 175. Further, in order to change the position, a drag operation (an example of a position specifying operation) of the focus area may be performed in the blurring editing unit 161. As a result, the focus area moves in the cut image in accordance with the drag operation. In accordance with such an operation, the blurring editing unit 161 updates the display of the blurring preview image 163 at any time, so that the preview display is performed. The user can edit the blur while checking the obtained image.

Note that the degree of blurring and the type of blur may be changed. For example, the type of blurring processing may be selectable, such as whether to perform blurring using a Gaussian filter or blurring using a moving average filter. In addition, whether the degree of blurring should be relatively large (blurring with "mist"), or small (blurring with "light"), or between them ("normal" It is also possible to make it possible to select "around blur" or the like.

In addition, while blurring the range corresponding to the focus area, the blurring mode may be different between the focus area and the other areas. At this time, the area outside the focus area may not be blurred.

FIG. 17 is a diagram showing a cut-out image graffiti screen 180.

FIG. 17 shows only one side of the cutout graffiti screen 180. As shown in FIG. 17, the cutout graffiti screen 180 displays the palette 115 and the like as in the above-described edit screen 101, and the editing result of the blurring edit screen 160 is reflected as the target of graffiti. The target image 181 is displayed. The cutout image graffiti screen 180 includes a blurring change button 191, an image change button 193, an edit end button 195, a return button 158, and a processing density adjustment unit 185.

The user can perform graffiti on the target image 181 in the same manner as when performing “normal scribble” while the cutout graffiti screen 180 is displayed. When the return button 158 is operated on the cut-out image graffiti screen 180, the target image 181 and the contents of the graffiti are once stored in that state, and the graffiti edit screen 100 is returned to. When the edit end button 195 is operated on the cut image graffiti screen 180, a series of cut image creation is completed. As a result, the target image 181 in the state where the graffiti is drawn is created as a cutout image. The cutout image may be created once the cutout image creation is completed, or the cutout image may be created when the scribbling time is over.

In FIG. 17, a stamp (disguise stamp) 811 suitable for being placed on the face of the subject is selectably displayed on the palette 115. Further, a stamp set selection button 812 is displayed on the palette 115 in a selectable manner. In the present embodiment, two combinations of stamps 811 (disguise stamp sets) displayed on the palette 115 are preset, and the stamp set selection button 812 is operated to select one of them. .. Specifically, the disguise stamp set includes a combination of a stamp 811 that is colored appropriately for a subject with blackish (dark color) clothes and a subject with whiteish (light color) clothes. , And a combination of stamps 811 that are colored appropriately. The stamp set selection button 812 is, for example, a display asking which color of the subject's clothes, “Which is your fashion today?”, and whether it is blackish (blackish) or whitish (whiteish) And a display of buttons for selecting whether or not there is. By performing an operation of selecting one of these buttons, the user can switch the disguise stamp set that can be displayed on the palette 115 and used for graffiti.

In this way, the stamp 811 that is colored differently according to the color of the clothing of the subject can be used, and the following effects can be obtained. That is, when there is only one type of stamp 811, the stamp 811 may not be conspicuous because it overlaps with the clothing depending on the color of the clothing, and the presence of the stamp 811 may be reduced. However, by using a disguise stamp set of a color corresponding to the color of clothes, graffiti can be drawn using the stamp 811 having a strong presence, regardless of the color of clothes, and a highly complete image is created. be able to. In order to solve the above problem, it may be possible for the user to directly change the color of the material such as the stamp 811. In this case, however, in this case, the design intention of the material is changed by changing the color. Is impaired, and it is difficult for the user to adjust to a desired color. On the other hand, in the present embodiment, since the disguise stamp set prepared in advance including the color is used, the stamp 811 that is in total harmony with the shooting theme of the play, the image processing, and the like is used. It can be used, and editing using the stamp 811 can be easily performed. The ability to change the color of the stamp 811 that can be used according to the color of the clothing of the subject can be adopted not only when creating a cutout image, but also when editing a general graffiti.

The stamps 811 of the disguise stamp sets are of substantially the same shape, and the colors of the solid-painted portion and the edges are mainly different, but the stamps 811 are not limited to this. Three or more disguise stamp sets may be provided. Further, the stamp is not limited to the disguise stamp, and other stamps may be selected from a plurality of combinations according to the selection of the clothing color by the user as described above. As the stamp set selection button 812, a button for selecting the color of an element other than the clothing of the subject such as hair color is provided, and the combination of materials (stamps, etc.) to be used is selected according to the selection result. You may For example, the combination of materials selected according to the selection result of clothing color and the combination of materials selected according to the selection result of hair color may be set separately.

Further, the control unit 501 does not require the user to select the color of the element of the subject, detects the color included in the image of the graffiti target, and automatically selects a combination of materials that can be used for graffiti accordingly. It may be done. For example, if the ratio of dark colors such as black is more than a predetermined value, use a combination of materials that corresponds to black clothing, otherwise use a combination of materials that correspond to white clothing. May be. Alternatively, the subject in the image may be detected, and the combination of materials may be automatically determined based on the color of the predetermined portion (for example, the color of the hair portion).

Furthermore, the color of the material such as the stamp 811 may be changeable within a range that does not impair the design intent. In this case, a slide bar such as the zoom bar 147 described above may be provided so that the color of the material of the stamp 811 can be gradually changed in multiple steps. For example, when preparing a stamp 811 whose theme is based on black, brown, etc., gradually change the color from black to brown by operating the slide bar to change the color of the clothes and hair color of the subject. It may be possible to select a desired color that is in harmony with the above. As a result, it is possible to perform rich graffiti editing with easy operation.

Here, the processing density adjusting unit 185 includes an adjusting bar 187 and a density reset button 188. The user performs an operation using the processing density adjusting unit 185 to adjust the degree of applying the filter processing 155 that is determined to be applied on the cut screen 140 (hereinafter, also referred to as density adjustment). be able to. For example, when the operation of sliding the slider of the adjustment bar 187 to the right is performed, the degree to which the filter processing 155 is applied increases correspondingly (the filter processing 155 becomes dark), and when the operation of sliding the slider to the left is performed, The degree to which the processing 155 is applied becomes small (the filter processing 155 becomes light). Further, when the density reset button 188 is operated, the “density” (applicability) of the filter processing 155 is returned (reset) to the initial state. Details of the adjustment function of the application degree of the filter processing 155 (hereinafter, also referred to as a density adjustment function) will be described later.

The cut image created through the cut image graffiti screen 180 is transmitted to the image providing server 601. Thus, the user can obtain the cut image by accessing the server 601.

The transition between these screens can be summarized as follows.

FIG. 18 is a diagram for explaining the screen transition of the edit screen when the cut image is created.

As shown in FIG. 18, when the first creation button 118a of the creation buttons for bonus graffiti is operated on the graffiti editing screen 100, if the cut image is not created yet in the play, the cut screen 140 is displayed. A transition is made (S201). When the first creation button 118a is operated while the cut image already created in the play is stored, the cut image graffiti screen 180 is directly displayed (S203). As a result, if there is a cut image that has already been saved, the edit state can be immediately continued.

On the cut screen 140, when the enter button 157 is operated, the screen changes to the blur edit screen 160 (S205). At this time, image processing for generating the blurring preview image 163 displayed on the blurring editing screen 160 is performed. If it takes time, a screen display indicating that the process is in a waiting state is displayed.

When the return button 158 is operated on the cut screen 140, the screen returns to the graffiti edit screen 100 (S215).

When the enter button 177 is operated on the blurring edit screen 160, the cutout image scribble screen 180 is displayed (S207). At this time, image processing for generating the target image 181 to be displayed on the cutout graffiti screen 180 is performed. If it takes time, a screen display indicating that the process is in a waiting state is displayed.

On the blurring edit screen 160, when the return button 158 is operated, a transition is made to the graffiti edit screen 100 (S213). At this time, the image created through the cut screen 140 up to that point may be saved as a cut image.

In the blurring edit screen 160, when the previous screen button 179 is selected, the screen transitions to the cut screen 140 (S209). At this time, the cutting screen 140 may be changed while the cutting range is adjusted last time, but the present invention is not limited to this.

When the return button 158 is operated on the cutout graffiti screen 180, the edited result is saved and the graffiti edit screen 100 is displayed (S211).

When the blurring change button 191 is operated on the cut-out image graffiti screen 180, a predetermined confirmation screen 192 is displayed, and then the screen shifts to the blurring edit screen 160 according to the user's instruction (S217). The confirmation screen 192 includes a message prompting the user to confirm that the information regarding the graffiti currently being edited is deleted as the screen returns to the blurring edit screen 160 or the like. The user decides to return to the blur editing screen 160 or the like by further giving an instruction while the confirmation screen 192 is displayed, or cancels the return to the blur editing screen 160 or the like and continues to the target image 181. You can choose whether to do graffiti editing.

Similarly, when the image change button 193 is operated on the cut-out image graffiti screen 180, a predetermined confirmation screen (not shown) is displayed, and then the screen changes to the cut-out screen 140 according to the user's instruction (S219). ..

[Explanation for rotating operation]

Here, the rotation operation is accepted while the cut screen 140 is displayed as follows.

FIG. 19 is a flowchart of the cut screen reception process when the cut screen 140 is displayed.

In FIG. 19, the overall processing when accepting a user operation while the cut screen 140 is displayed is roughly shown. That is, when the cut screen 140 is displayed, the cut screen reception process is started. The cut screen reception process is performed under the control of the control unit 501 and is repeatedly performed while the cut screen 140 is displayed.

As shown in FIG. 19, in step S231, it is determined whether or not the operation of selecting the captured image used for the cutout image has been performed. If it is determined that the operation has been performed, an image selection process is performed in step S232. Through the image selection process, the captured image selected by the user is selected as a display target in the image display area 145.

In step S233, it is determined whether or not an operation has been performed on the trim area 141. When it is determined that the operation has been performed, the cut and edit processing is performed in step S234.

In step S235, it is determined whether filter processing has been selected in the filter selection area 153. If it is determined that the selection has been made, a processing selection process is performed in step S237. That is, the filter processing 155 is selected to be applied according to the user's operation, and the captured image after the filter processing 155 is applied is selected as the display target in the image display area 145.

In step S238, the preview image, that is, the image in the image display area 145 on the cut screen 140 is updated. Thereby, the user can intuitively perform the operation while constantly reflecting the operation on the cut screen 140 while looking at the preview image.

FIG. 20 is a flowchart of the cut and edit processing.

As shown in FIG. 20, in step S501, it is detected whether or not the zoom bar 147 has been operated. When the zoom bar 147 is operated, that is, when the enlargement/reduction operation is performed by the user, the size changing process is performed as described above in step S502.

In step S503, it is detected whether the rotary bar 148 has been operated. When the rotation bar 148 is operated, that is, when the rotation operation is performed by the user, it is determined in step S504 whether or not the operation is in a direction away from 0 degree (for tilting the original image further). It is judged whether or not it is an operation.).

If the direction is away from 0 degree in step S504, the first rotation process is performed in step S505. The first rotation process will be described later.

If it is not the direction away from 0 degree in step S504, the second rotation process is performed in step S506. The second rotation process will be described later.

In step S507, it is detected whether the rotation reset button 149 has been operated. When the reset button is operated, rotation reset processing is performed in step S508. The rotation reset process will be described later.

In step S509, it is detected whether or not the moving operation is performed. When the moving operation is performed, it is determined in step S510 whether or not the original image can be moved according to the moving operation. If the original image is movable, the image is moved in accordance with the moving operation in step S511. It For example, if the edge of the original image is already on the periphery of the image display area 145 and further movement causes a margin (area outside the original image) to enter the image display area 145, it is determined that the image cannot be moved. Note that a blank space may be allowed to be included in the image display area 145 (may be determined to be movable).

Here, in the present embodiment, when a rotation operation is performed, the original image rotates with respect to the image edge display frame 143 with the center (image edge display frame 143) of the image display area 145 as the rotation center. At this time, since the original image and the image edge display frame 143 are substantially rectangular, if the original image is rotated at the same enlargement ratio, a blank space (a part other than the original image) may be included in the image display area 145. .. In the present embodiment, in order to prevent this, when rotating the original image, a process of enlarging the image by an amount corresponding to the rotation amount is performed as necessary so that the margin does not enter the image display area 145. Done. Such processing is performed in the first rotation processing.

[Description of First Rotation Processing]

FIG. 21 is a diagram illustrating an example of an operation when a rotation operation is performed in a direction of increasing the rotation angle.

With reference to FIG. 21, an operation when the rotation operation of rotating the image P that is the original image with respect to the image edge display frame 143 is performed will be described.

As shown in step S71, it is assumed that the state before the rotating operation is such that the entire widthwise direction of the vertically long rectangular image P is inside the substantially square image edge display frame 143.

In such a case, if only the rotation is performed and the image P is not enlarged, the process is shown in step S72. That is, when the rotation operation is performed, the image P rotates with respect to the image edge display frame 143 with the center portion as the rotation center 143a. Then, as shown by the shaded area, a blank space, which is an area outside the image P, is inserted between the image P and the corner of the image edge display frame 143.

In the present embodiment, the image P is enlarged according to the rotation in order to avoid such a blank space. That is, as shown in step S73, the rotation operation is performed, and the image P is rotated around the rotation center 143a. At this time, the image P is enlarged at any time so that a margin is not generated due to the rotation. When the image P rotates, first, when the peripheral edge of the image P and any one of the corners of the image end display frame 143 overlap, the image P starts to be enlarged, and thereafter, as the rotation angle increases, The image P is enlarged so that the corner portion of the image edge display frame 143 is kept on the peripheral portion of the image P.

In this way, the image P is automatically enlarged by the control unit 501 in accordance with the rotation operation, so that it is possible to prevent a blank space from entering the inside of the image edge display frame 143 even after the rotation.

FIG. 22 is a diagram showing an example of the trim area 141 after the rotation operation is performed on the original image.

In FIG. 22, the original image is shown rotated to some extent with respect to the image edge display frame 143. As described above, in a state in which the image display area 145 is rotated so that no margin is included in the image display area 145, a margin is included in the image display area 145 when the enlargement ratio of the original image is smaller than that state. Therefore, in the present embodiment, when the original image is rotated with respect to the image edge display frame 143, the original image is automatically enlarged, and the enlargement ratio is controlled so as not to be lower than that state. To be done.

Further, in the present embodiment, when the original image is rotated with respect to image edge display frame 143, the user is visually shown that the enlargement ratio of the original image cannot be lower than that state. Specifically, as shown in FIG. 22, a gray-out area 147g showing an unadjustable range is displayed on the zoom bar 147. Even if the user performs an operation to move the slider of the zoom bar 147 to the grayout area 147g, the slider does not enter the grayout area 147g (that is, the enlargement ratio in the grayout area 147g cannot be selected). Are controlled by the control unit 501. Therefore, it is possible to prevent a blank space from entering the inside of the image edge display frame 143.

Note that the gray-out display 147g is not limited to that shown in FIG. 22, and may be shown in a color or mode different from that of other portions so that it can be seen that the range is not adjustable. If so, it can be used appropriately.

FIG. 23 is a flowchart showing the operation of the first rotation processing.

When the process is started, as shown in FIG. 23, in step S521, it is determined whether or not the enlargement ratio of the zoom bar 147 is the maximum.

If it is the maximum in step S521, the rotation operation is ignored and the process is exited in step S522. That is, in this case, the image is not rotated.

In step S523, it is determined whether or not the image is cut off when rotated, that is, whether or not the margin is included in the image display area 145 when rotated. When it is determined that the sheet is out of view (when it is determined that the margin is included), the processes of steps S524 to S526 are performed.

In step S524, the zoom bar 147 is automatically adjusted in the enlargement direction. Enlargement of the image is performed so that the image is not cut off.

In step S525, the range in which the image can be scaled after rotation is calculated. A range in which a blank is not included in the image display area 145 when the image is enlarged or reduced (is not cut off) is a range in which the image can be enlarged or reduced.

In step S526, the display of the gray-out area 147g is updated. The display of the gray-out area 147g is updated based on the calculated expandable/reducible range.

In step S527, the image is rotated. That is, the rotation of the image is executed according to the user's operation.

In step S528, the display of the rotation bar 148 is updated. The position of the slider on the rotary bar 148 is the position corresponding to the user's operation (that is, the position following the touch pen 583).

When the process of step S528 is performed, the cut and edit process is subsequently performed.

[Description of Second Rotation Processing]

FIG. 24 is a diagram illustrating a display example of the trim area 141 when the rotation operation is performed in the direction of decreasing the rotation angle.

With reference to FIG. 24, a change in the display content of the trim area 141 when the rotation operation of rotating the image P that is the original image with respect to the image edge display frame 143 is performed will be described.

As shown in step S701, it is assumed that the original image is displayed in a rotated state inside the image edge display frame 143 as the state before the rotation operation. Here, the slider of the rotary bar 148 is at the maximum position in the adjustment range, and the size of the rotation angle is approximately maximum. At this time, the gray-out area 147g displayed as described above is displayed so as to cover substantially the entire area of the zoom bar 147, and the magnitude of the enlargement ratio of the original image is substantially the maximum.

When the gray-out area 147g covers substantially the entire area of the zoom bar 147, even if the user operates the zoom bar 147 to reduce the enlargement ratio of the original image, such an operation is ignored and is not reflected.

In such a case, when the rotation operation is performed in the direction in which the rotation angle approaches 0 degree, the result is as follows. That is, as shown in step S702, the image P rotates with respect to the image edge display frame 143 with the center portion as the rotation center 143a. In this case, the margin does not immediately enter the image display area 145 even if the image enlargement ratio is reduced, so that the range of the zoom bar 147 covered by the gray-out area 147g is slightly reduced. In other words, the gray-out area 147g becomes shorter (shrinks). At this time, the original image is not automatically reduced, and the position of the slider on the zoom bar 147 does not change before and after the rotating operation.

In this way, since the gray-out area 147g becomes shorter with the rotation operation, the user can easily see that the gray-out area 147g can be reduced.

When the rotation operation is further performed and the rotation angle becomes 0 degree, the image is at the 0 degree position as shown in step S703. At this time, the enlargement ratio of the original image remains the same, and the position of the slider on the zoom bar 147 does not change before and after the rotating operation. When the rotation angle is 0 degree, no blank space is generated, so the gray-out area 147g is erased (is not displayed).

This allows the user to easily know that the image can be reduced until the enlargement ratio becomes the minimum.

FIG. 25 is a flowchart showing the operation of the second rotation process.

In step S531, the image is rotated. That is, the rotation of the image is executed according to the user's operation.

In step S532, the display of the rotation bar 148 is updated. The position of the slider on the rotary bar 148 becomes the position according to the user's operation.

In step S533, the range in which the image can be enlarged or reduced after rotation is calculated. That is, a range is calculated so that no margin is included in the image display area 145 when the image is enlarged or reduced.

In step S534, the display of the gray-out area 147g is updated based on the calculated expandable/reducible range.

When the process of step S534 is performed, the cut and edit process is subsequently performed.

FIG. 26 is a diagram illustrating a display example of the trim area 141 when the rotation operation and the enlargement/reduction operation are performed.

When the enlarging/reducing operation is performed after the rotating operation is performed in the direction of decreasing the rotation angle, the following is performed.

In FIG. 26, step S711 corresponds to step S702 of FIG. 24 described above. That is, the original image is rotated slightly from 0 degree, and the enlargement ratio is substantially maximum.

Here, when the enlargement/reduction operation is performed in the direction of decreasing the enlargement ratio of the image, the image is reduced, and the process is performed as shown in step S712. That is, the image is reduced within a range in which the image can be enlarged or reduced depending on the rotation angle. At this time, even if the user operates the zoom bar 147 so that the enlargement ratio is smaller than the expandable/reducible range, the size is reduced to the lower limit of the expandable/reducible range. This prevents a blank space from entering the image display area 145.

When the zoom bar 147 is operated so that the enlargement ratio is smaller than the expandable/reducible range determined according to the rotation angle, the image enlargement ratio is decreased according to the operation of the zoom bar 147, and the rotation angle is changed. It may be possible to prevent a blank from entering the image display area 145 by rotating the image so as to approach 0°. When allowing the image to be rotated following the operation of the zoom bar 147 in this manner, the gray-out area 147g may not be displayed on the zoom bar 147.

[Explanation of rotation reset processing]

The operation when the rotation reset button 149 is pressed will be described with reference to FIG.

When the rotation reset button 149 is pressed in the state shown in step S711, the state becomes as shown in step S713. That is, the enlargement ratio of the image is maintained at approximately the maximum, and the rotation angle of the image returns to 0 degree. Since the rotation angle of the image returns to 0 degrees, the gray-out area 147g of the zoom bar 147 is erased.

On the other hand, when the rotation reset button 149 is pressed in the state shown in step S712, the state becomes as shown in step S714. That is, the enlargement ratio of the image is maintained in the state of step S712, and the rotation angle of the image returns to 0 degree. Further, similarly to step S713, since the rotation angle of the image returns to 0 degree, the gray-out area 147g of the zoom bar 147 is erased.

In this way, when the rotation reset button 149 is pressed, the rotation angle of the image returns to 0 degree. When the rotation bar 148 is used to change the angle of the image from 0 degrees, it may be difficult to perform the operation of accurately returning the angle to 0 degrees again using the rotation bar 148. However, by using the rotation reset button 149 in this manner, the rotation angle of the image can be set to 0 degree easily and reliably.

When the rotation reset button 149 is pressed, the enlargement ratio of the image is maintained as it is. Therefore, it is possible to easily perform an operation such that only the rotation angle is returned to 0 degree and the intended range is displayed in the image display area 145.

When the rotation reset button 149 is pressed, the image enlargement ratio may be returned to the initial state.

FIG. 27 is a flowchart illustrating the operation of the rotation reset process.

As shown in FIG. 27, when the rotation reset button 149 is operated, the image is rotated in step S541. That is, the rotation angle of the image is returned to 0 degree.

In step S542, the display of the rotation bar 148 is updated and the slider position is returned to the 0 degree position.

In step S543, the gray-out area 147g of the zoom bar 147 is deleted. This allows the user to easily know that the image can be reduced in a wide range.

When the process of step S543 is performed, the cut and edit process is subsequently performed.

When the rotation operation is performed so that the rotation angle becomes large, the position of the rotation center 143a of the image may be changed in accordance with the rotation operation.

FIG. 28 is a diagram illustrating an example of an operation when a rotation operation is performed.

As shown in FIG. 28, the operation when the rotation operation for rotating the image edge display frame 143 with respect to the image P that is the original image is performed will be described.

Here, as shown in step S76, it is assumed that the rotation angle of the original image P is 0 degree and the enlargement ratio is the maximum in the expandable/reducible range as the state before the rotating operation.

When the rotation operation is performed in such a case, the step S77 is performed. That is, when the rotation operation is performed, the image P rotates with respect to the image edge display frame 143 with the center portion as the rotation center 143a. Then, the corner of the image edge display frame 143 comes into contact with the peripheral edge of the original image P.

Here, when the enlargement ratio of the original image P is the maximum, if the original image P is further rotated around the rotation center 143a as it is, a margin is inserted in the image display area 145. Therefore, the position of the rotation center 143a with respect to the original image P may be changed so that no blank space is included in the image display area 145. That is, when the rotation operation is further performed from the state of step S77, the position of the original image P with respect to the image edge display frame 143 is maintained so that the corner of the image edge display frame 143 is kept in contact with the peripheral edge of the original image P. Is changed, as shown in step S78. In step S78, the position of the rotation center 143a, that is, the center position of the image edge display frame 143 is displaced from the position of the rotation center 143z (shown by the broken line) in step S77.

By performing such control, it is possible to effectively prevent a blank space from entering the image display area 145. By smoothly changing the display of the preview image in accordance with the rotation operation, it is possible to provide a user interface with less discomfort for the user.

As described above, in the present embodiment, the user can easily perform the rotation operation on cut screen 140. The user can fit a desired range in the image display area 145 to create a cutout image, and thus the satisfaction of the user who plays can be improved.

Regarding the rotation operation, whether or not the rotation operation can be executed is changed or the range of the rotatable angle is changed according to the type of the original image and the aspect ratio of the original image. Good. For example, when an image with a relatively large aspect ratio is selected as the original image when creating a cutout image, the rotation operation cannot be performed or the range of rotatable angles can be set to be relatively small. You may do so. In addition, for example, an “up image” that is a captured image in which the user's upper body is captured in the image, and a “full-body image” that is a captured image in which the user's head to toes are captured in the image. In the case where "and" is selectable as the original image, when "Full body image" is selected as the original image, the rotation operation is disabled or the range of the rotatable angle is made relatively small. Good.

As described above, when the rotation operation cannot be performed according to the selected type of the original image or the aspect ratio, for example, the rotation bar 148 may be hidden on the cut screen 140, or the user cannot see the rotation bar 148. The rotation bar 148 may be displayed in a light color or grayed out so that it can be understood that the operation cannot be performed.

To prevent the margin from entering the image display area 145 when the rotation operation is performed, for example, when the type of the original image is a “whole body image” or when the aspect ratio of the original image is relatively large, It is necessary to increase the enlargement ratio of the image considerably. If the enlargement ratio of the image is large, block noise may be noticeable when the cut image is created, and the image may appear to be deteriorated. In addition, even if the original image was intended to have a wide field of view, such as a "whole body image", so that a wide range of the subject fits in the captured image, only a part of the original image is included in the cropped image. Since it cannot be displayed, the intention of shooting cannot be reflected. Therefore, in such a case, by making the rotation operation inexecutable, the user can easily create an attractive cutout image.

[Explanation about blurring function]

FIG. 29 is a diagram for explaining the layer structure of the blur preview image 163 on the blur editing screen 160.

As shown in FIG. 29, the blurring preview image 163 is configured by stacking a trimmed image layer 951a, a mask layer 951c, and a blurring layer 951b in order from the bottom.

The trimmed image layer 951a is a layer in which the trimmed image is arranged.

The blur layer 951b is a layer in which an image obtained by applying blur to the entire surface of the trimmed image is arranged.

The mask layer 951c is a layer in which so-called alpha channel mask data for specifying a region corresponding to the focus region is arranged. An area of the blur layer 951b that overlaps the mask data is a transparent area.

For example, when the heart-shaped blurring pattern 173b is selected, heart-shaped mask data serving as a focus area is arranged in the mask layer 951c. Then, the blurred preview image 163 is an image in which the trimmed image layer 951a is visible in the mask data portion and the blurred layer 951b is visible around the trimmed image layer 951a. That is, an image that is blurred except for the focus area is displayed. When the enter button 177 is operated, the target image 181 on the cutout graffiti screen 180 is prepared based on these three layers.

When a drag operation (position designation operation) for moving the focus region is performed, only the mask layer 951c follows the operation and is displaced with respect to other layers. Also, when an operation of changing the size of the focus area is performed, the size of the mask data of the mask layer 951c is changed. As a result, the area in which the post-trimming image layer 951a is visible, that is, the focus area moves or the size changes, and the blurred preview image 163 that reflects the user's operation is displayed.

As described above, in the present embodiment, when the position specifying operation or the size changing operation for the focus area is performed, only the mask layer 951c is changed accordingly, and as a result, the blurred preview image 163 is displayed. The displayed contents are changed in real time. The trimmed image itself is not processed each time such an operation is performed, and the blurred preview image 163 is changed by using the data of the alpha channel. Therefore, the display content of the blurred preview image 163 corresponding to the user's operation is changed. The followability of is improved, and blur editing can be performed comfortably.

When the blur pattern 173g having no blur in the entire area is selected, mask data for masking the entire area may be arranged in the mask layer 951c. As a result, the image of the post-trim image layer 951a without blurring is displayed as the blurring preview image 163. Further, when the blur pattern 173a in which the entire region is uniformly blurred and the focus region is not included is selected, no mask data is arranged in the mask layer 951c. As a result, the image of the blur layer 951b is displayed as the blur preview image 163 in the entire area. In these cases, the blurred preview image 163 may be displayed without using the mask layer 951c.

When the trimmed image is generated on the cut screen 140, the blurring function is performed on the blurring edit screen 160 using the trimmed image as follows (blurring edit acceptance process).

FIG. 30 is a flowchart showing the blurring edit acceptance process.

As shown in FIG. 30, when the blurring editing screen 160 is displayed, the blurring preview image 163 is displayed on the blurring editing unit 161 (preview display) in step S251. At this time, the blurred preview image 163 is displayed, for example, in a state in which the entire area of the trimmed image is blurred, that is, the blurred pattern 173a is selected. Note that the preview display may be performed while another blur pattern 173 is selected. For example, the preview display may be performed without blurring (the blurring pattern 173g is selected).

In step S252, it is detected whether the type of blurring has been changed. That is, when the blurring pattern 173 different from the currently selected one is selected, it is detected. When such a pattern selection operation is performed, the process proceeds to step S253. That is, in step S253, a process of changing the blur is performed according to the pattern selection operation performed by the user. Specifically, the mask data of the mask layer 951c is changed according to the changing operation.

In step S254, it is determined whether the focus area can be moved. That is, it is determined whether or not the blur pattern 173 (173b to 173f) that has blur and includes the focus area is selected. When it is determined that the focus area cannot be moved (when it is “blurred” or “blurred”), the process proceeds to step S258.

In step S255, it is determined whether the position designation operation or the size selection operation is performed on the focus area. That is, when a drag operation for moving the focus area is performed, it is detected. Further, when the blur size selection unit 175 selects a size different from the current size, it is detected. If any operation has been performed, the process proceeds to step S256. That is, in step S256, a process of changing the position of the mask data or changing the size (enlargement ratio) is performed according to the operation performed by the user.

When the process of step S253 or step S256 is performed, the display of the blurred preview image 163 is updated in step S257. As a result, the user can confirm the result of the operation on the preview display.

In step S258, it is determined whether the previous screen button 179 or the enter button 177 has been operated. When an operation is performed, a screen transition according to the operation is performed. Until the operation is performed, the processing from step S252 is repeated.

FIG. 31 is a diagram illustrating a blur editing function.

In FIG. 31, a blurring editing unit 161 and a blurring pattern selecting unit 171 are shown. The shaded area in the image of the blur editing unit 161 indicates that blur is applied. In the following description, when the heart-shaped blurring pattern 173b is selected and the size of the focus area is, for example, the second size (medium) of three levels (large, medium, and small) is selected. Assume

On the blurring editing unit 161, a blurring preview image 163 in which a focus area 165a is provided so as to correspond to the blurring pattern 173b is displayed. In the present embodiment, the boundary portion 165b between the focus area 165a and the blur area 165c outside the focus area 165a is displayed so that the blur amount looks smaller than that of the blur area 165c. As a result, from the focus area 165a to the blur area 165c, the boundary portion 165b seems to be gradually blurred. The effect at the boundary portion 165b can be realized by adjusting the mask data of the mask layer 951c, for example, but is not limited to such a method. Further, the boundary portion 165b may not be provided. In the following description, the illustration and description of the boundary portion 165b may be omitted.

Here, in this case, the focus area 165a is movable. In such a case, an icon display 164a indicating that the focus area 165a is movable is displayed at the center of the focus area 165a. The icon display 164a may be displayed, for example, between the first movement of the focus area 165a and the time before the user performs a position designation operation of the focus area 165a, but the present invention is not limited to this. ..

FIG. 32 is a diagram illustrating an operation when a pattern selection operation is performed.

With reference to FIG. 32, a change in the display content of the blurring edit unit 161 when the pattern selection operation is performed will be described.

As shown in step S81, it is assumed that the blurring is applied to the entire area of the image (that is, the blurring pattern 173a is selected) as the state before the operation.

In such a case, when the blurring pattern 173g of "no blur" is selected by the pattern selection operation, the process is shown in step S82. That is, the same image as the trimmed image is displayed without blurring over the entire image.

When the heart-shaped blurring pattern 173b is selected by the pattern selection operation from the state shown in step S81 or the state shown in step S82, the state becomes as shown in step S83. That is, the blur editing unit 161 is provided with a heart-shaped focus area 165a corresponding to the blur pattern 173b and a blur area 165c. At this time, since the focus area 165a is movable, the icon display 164a is arranged in the central portion and the user can perform a position designation operation.

FIG. 33 is a diagram for explaining the operation when the position designation operation is performed.

With reference to FIG. 33, a change in the display content of the blurring edit unit 161 when the position designation operation is performed will be described.

Step S84 is in the same state as step S83 of FIG. That is, the heart-shaped blurring pattern 173b is selected, and the position designation operation has not been performed yet.

Here, when the user performs a drag operation for moving the focus area 165a to the left, the process is as shown in step S85. That is, the focus area 165a moves to the left in the blur editing unit 161 according to the user's drag operation.

When a drag operation is performed from the state of step S84 or step S85 so as to move the focus area 165a to the upper right position, step S86 is performed. That is, the focus area 165a moves to the upper right position in the blur editing unit 161 according to the user's operation.

In this way, the position of the focus area 165a changes according to the position designation operation, so that it is possible to appropriately meet the needs such as not wanting to blur the periphery of the user's face.

In the position designation operation, for example, the movement range of the focus area 165a may be limited according to the positional relationship between the outer shape of the focus area 165a and the blurred preview image 163.

FIG. 34 is a diagram for explaining the operation when the size selection operation is performed.

With reference to FIG. 34, a change in the display content of the blurring edit unit 161 when the size selection operation is performed will be described.

Step S87 is in the same state as step S83 of FIG. That is, the heart-shaped blurring pattern 173b is selected, and the size selection operation has not been performed yet. In the present embodiment, the blur size selection unit 175 can select three sizes of “large”, “medium”, and “small”. In the initial state, the size of “medium” is automatically selected. Has been selected.

Here, when the user performs a size selection operation for setting the size to “small”, the process is as shown in step S88. That is, the size of the focus area 165a is reduced according to the user's operation. In other words, the focus area 165a is changed to, for example, a small area having a similar shape.

Further, when the size selection operation for setting the size to “large” is performed from the state of step S87 or step S88, the process becomes as shown in step S89. That is, the size of the focus area 165a is enlarged according to the user's operation.

Since the size of the focus area 165a changes according to the size selection operation as described above, the focus area 165a can be changed to a desired size while maintaining the characteristic shape, and the size can be easily changed in a desired manner. Blur can be applied.

In the example shown in FIG. 34, the position designation operation is not performed from step S87 to step S89. In such a case, the icon display 164a displayed in step S87 may be continuously displayed in both step S88 and step S89. For example, a size selection operation may be performed. The icon display 164a may be hidden when the display is off. Further, the icon display 164a may be changed in display state with the passage of time, such as being hidden after a predetermined time has elapsed since being displayed.

The size selection operation may be one in which the size of the focus area 165a can be selected in more stages than in the above example. At this time, the size may be selectable by using, for example, a user interface such as the zoom bar 147 or a user interface that receives an instruction of repeated enlargement or reduction.

In the size selection operation, the size that can be selected is limited according to the shape of the focus region 165a (blurring pattern 173) or according to the positional relationship between the focus region 165a and the blurring preview image 163. You may do it.

FIG. 35 is a diagram showing a display example of the blurring editing unit 161 when another blurring pattern 173 is selected.

In FIG. 35, the case where the blur pattern 173c is selected, the blur pattern 173d is selected, the blur pattern 173e is selected, and the blur pattern 173f is selected are shown from the top. Has been done. When any of these blurring patterns 173 is selected, the focus area 165a is movable.

In this way, since the plurality of blurring patterns 173 are set, the user can select a desired blurring pattern 173 and create a blurred image with a blurring method close to ideal.

Here, when the focus area is provided up to the entire edge portion of the post-trim image, the movement of the focus area 165a with respect to the position designation operation may be restricted.

FIG. 36 is a diagram for explaining the operation when the blur pattern 173e is selected.

FIG. 36 shows an example of the position specifying operation when the blur pattern 173e is arranged on the post-trimming image.

In the initial state in which the blurring pattern 173e is applied in step S84a, the focus area 165a is provided up to the upper and lower end portions of the post-trim image. A boundary portion 165b is provided between the focus area 165a and the blur area 165c so that the boundary area 165a is gradually blurred from the focus area 165a toward the blur area 165c.

Here, when the position designation operation is performed so as to move the focus area 165a downward, the process is shown in step S85a. That is, in step S85a, the position of the focus area 165a does not move downward regardless of the position designation operation, and the state shown in step S84a is maintained.

If the focus area 165a is moved downward as shown in parentheses in the figure, the portion above the focus area 165a where the focus area 165a is not provided is inside the cutout image. Then, it becomes impossible to generate an image in which the setting intention of the blur pattern 173e in which the strip-shaped focus area 165a is provided in the vertical direction is reflected. Further, at this time, since the area such as the boundary portion 165b is not provided at the upper end of the focus area 165a, the boundary between the focus area 165a and the blur area 165c becomes conspicuous, and the image that makes the user feel uncomfortable. Becomes Therefore, with respect to the blur pattern 173e, the movement limit is set so that the movement of the focus region 165a in the vertical direction is ignored.

When the position designation operation is performed so as to move the focus area 165a to the left from step S84a or step S85a, the process proceeds to step S86a. That is, since the movement restriction of the focus area 165a is not provided in the left-right direction, the focus area 165a moves to the left according to the position designation operation.

Note that such an example is for a case where the size of the alpha channel mask corresponding to the focus area 165a is smaller than that of the trimmed image, but the size of the mask is set to be larger than that of the trimmed image. In some cases, the movement restriction may not be provided.

FIG. 37 is a diagram illustrating another example of the operation when the blur pattern 173e is selected.

In FIG. 37, unlike the above case, the size of the mask of the alpha channel is set to be larger than that of the image after trimming. That is, as shown in step S84b, the focus area 165a is prepared so that it can be applied to the outside of the edge portion of the trimmed image.

When the position designation operation is performed so as to move the focus area 165a downward, the step S85b is performed. That is, in step S85b, the focus area 165a moves downward according to the position designation operation. However, the state in which the focus area 165a can be applied to the upper end of the trimmed image is maintained even after the movement, and the same result as when the movement of the focus area 165a is limited is obtained.

When the mask of the alpha channel corresponding to the focus area 165a is set large in this way, the focus area for the position designation operation is determined according to the positional relationship between the outer edge of the mask and the outer edge of the trimmed image. A movement restriction of 165a may be provided.

Here, in addition to the various editing methods described above, the blur editing screen 160 may be provided with the following editing functions. For example, the focus area 165a may be rotatable. At this time, the focus area 165a may be rotated every 90 degrees or the operation similar to the above-described rotation operation may be accepted to rotate the focus area 165a. Further, various image processing such as coloring or changing brightness may be applied to the focus area 165a or the area outside the focus area 165a. Also, a plurality of focus areas 165a may be arranged.

FIG. 38 is a diagram showing a blur editing screen 160b according to a modified example of the present embodiment.

As shown in FIG. 38, the blur editing screen 160b is the same as the blur editing screen 160 described above except that a rotation button 174 and a blur adding button 176 are provided. In this example, a plurality of focus areas 165a can be arranged, and the focus areas 165a can be arranged after being rotated.

The blurring addition button 176 is a button used for arranging a plurality of focus areas 165a for one image. For example, by operating the blurring addition button 176 and then selecting a desired blurring pattern 173, the focus area 165a having a shape corresponding to the newly selected blurring pattern 173 is arranged in the blurring editing unit 161. It should be noted that the plurality of blurs may be realized by, for example, arranging the mask data of the alpha channel having the shape corresponding to each focus area 165a in different layers. In this case, the position designation operation and the size changing operation can be applied to each layer, so that the positions and sizes of the plurality of focus areas 165a can be individually edited.

By arranging a plurality of focus areas 165a, for example, when generating a cutout image showing two users, the cutout image can be blurred such that the face or the like of each user is set as the focus area 165a.

The rotation button 174 is arranged below the blurring pattern 173 corresponding to the rotatable focus area 165a so that the focus area 165a can be arranged after being rotated. The rotation button 174 is provided with a right rotation button and a left rotation button, and each time the rotation button 174 is operated, the focus area 165a corresponding to the blurring pattern 173 has a predetermined angle (for example, Rotate only 10 degrees). Thereby, the focus area 165a after being rotated can be arranged. Further, with the rotation of the focus area 165a, the preview display of the image being edited to which the focus area 165a is applied and the display content of the blur pattern 173 are changed.

The rotation button 174 is not displayed for the perfect circular blur pattern 173c whose shape does not change before and after the rotation and the blur pattern 173a of "all blur". In addition to the rotation button 174, a reset button for returning the rotation angle to the initial state may be arranged.

Since such a rotation button 174 is provided and the focus area 165a can be rotated and then arranged, or can be rotated in the arranged state, various blurring can be performed. Further, particularly when the image is rotated on the cut screen 140 to generate the trimmed image, the focus region 165a can be rotated according to the rotation angle of the image. Therefore, even when the image is rotated, the focus area 165a having a shape suitable for the image can be arranged.

For example, in the case where the focus area 165a is located up to the peripheral edge of the image such as the “vertical” blurring pattern 173e, the focus area 165a is surely provided up to the peripheral edge of the image even when rotated. It suffices if mask data is prepared. For example, in the case where the blurring pattern 173e is applied, even if the strip-shaped focus area 165a is arranged along the diagonal line of the image, the focus area 165a covers the periphery of the image. As described above, the mask data may be prepared so that the length of the focus region 165a in the longitudinal direction is longer than the length of the diagonal line of the image.

When the image is rotated on the cut screen 140 and the trimmed image is generated, the shape of the focus area 165a may be automatically rotated according to the rotation angle of the image.

The shape of the focus area 165a may be arbitrarily set by the user. For example, an eraser tool or a stamp tool for the user to perform a pen operation or the like may be prepared on the blurring edit screen 160, and the mask data may be arranged on the mask layer 951c as operated by the tool. .. As a result, the user can freely set the area to be blurred and the area to be made clear. At this time, the generation mode of the mask data generated by the eraser tool may be changed. For example, various focus areas 165a can be set by changing the transparency (density) of the mask data or changing the size of the generation area (size of the pen tip).

Alternatively, the boundary between the subject and the background may be determined to generate a mask (person mask) having the shape of the subject, and the subject may be set as the focus area 165a so that the blurring can be applied only to the background portion. At this time, by blurring the outer edge portion of the subject together with the background, an image having a stereoscopic effect such as a portrait photograph may be created.

FIG. 39 is a diagram showing an example of the cut-out image graffiti screen 180 when the trimmed image is generated by performing the rotation operation.

In the present embodiment, as shown in FIG. 39, when a rotation operation is performed to generate an image after trimming, in the palette 115 displayed on the cutout graffiti screen 180, a predetermined stamp or the like is displayed in the image. It is configured to be displayed in a state of being rotated at an angle according to the rotating operation.

In FIG. 39, the case where the image is rotated counterclockwise by about 30 degrees and the trimmed image is generated is shown. At this time, the stamp 811 as shown in FIG. 17 described above is also displayed selectably in a state of being rotated by the same angle as the rotation angle of the image by the rotation operation (stamp 811a).

Thus, by changing the initial display state of the material for graffiti on the cut image graffiti screen 180 according to the angle at which the image is rotated on the cut screen 140, the angle of the user's material is adjusted to the angle of the image. No need to make adjustments. Therefore, it becomes possible to easily and swiftly perform graffiti with rich contents, and the satisfaction of the user who plays the game becomes high. Further, when the rotation angle of the stamp 811 or the like is automatically changed in this way, an angle step (for example, 10 degrees each time the rotation button is operated) when rotating the stamp 811 according to the user's manual operation performed on the pallet 115. It is sufficient to rotate the image at the same angle as the rotation angle of the image that can be rotated in finer angle steps. As a result, the rotated image and the stamp 811 or the like arranged thereon can be surely harmonized.

It should be noted that the material for which the rotation angle is automatically changed in this way may be limited to a predetermined type. For example, as described above, a stamp (stamp 811 or the like) that is supposed to be placed according to the position of the head or eyes of the subject is automatically rotated, and a stamp including characters or the like is not rotated. Thus, it can be set appropriately.

[Explanation regarding cut-out graffiti and density adjustment function]

FIG. 40 is a diagram illustrating a layer configuration of an image preview-displayed on the cut-out image graffiti screen 180.

As shown in FIG. 40, the image is configured by stacking a lower person layer 952a, an upper person layer 952b, a frame layer 952c, and a graffiti layer 952d in order from the bottom.

The lower person layer 952a is a layer arranged based on the image generated through the blurring edit screen 160. That is, the image arranged in the lower person layer 952a is generated based on the image to which the filter processing 155 selected on the cut screen 140 and the blur after editing on the blur editing screen 160 are applied. ..

The upper person layer 952b is a layer in which the same image as the lower person layer 952a is arranged.

The frame layer 952c is a layer in which the frame image selected to be applied on the cutout graffiti screen 180 or the like is arranged.

The graffiti layer 952d is a layer in which images are arranged according to the graffiti operation performed on the cut-out picture graffiti screen 180.

The layer configuration is not limited to this. For example, a plurality of layers that are changed according to the graffiti operation may be arranged.

Here, the images arranged in each of the lower person layer 952a and the upper person layer 952b may be generated as follows, for example. That is, in the present embodiment, the lower person layer 952a and the upper person layer 952b are combined by multiplication combining to generate a cut image. Therefore, when both layers 952a and 952b are multiplied and combined, the image generated based on the filter processing 155 is changed so that the image becomes the same as the image preview-displayed on the cut screen 140 or the blurring edit screen 160. It is arranged in both layers 952a and 952b. As will be described later, when the density of the filter processing 155 is changed by the density adjusting function, both layers 952a and 952b are prepared according to the initial state.

FIG. 41 is a flowchart showing the cut-out image graffiti acceptance processing.

When the transition to the cutout image doodle screen 180 is performed, a cutout image doodle acceptance process is executed.

As shown in FIG. 41, in step S271, a preview display of the target image 181 is performed. Note that when the transition is made again to the cut-out image graffiti screen 180 when the graffiti has already been performed, the content may be reflected in the preview display.

In step S272, it is determined whether a graffiti operation has been performed. When the operation is performed, the content of the operation is reflected in step S273.

In step S274, it is determined whether the adjustment bar 187 has been operated. When the operation is performed, the content of the operation is reflected and the density is adjusted in step S275.

In step S276, it is determined whether the density reset button 188 has been operated. When the operation is performed, the density of the filter processing 155 is returned to the initial state in step S277.

In step S278, the display content of the preview display is updated. Thereby, when the user's operation is performed, the result can be confirmed on the cut-out image graffiti screen 180.

In step S279, it is determined whether an operation button accompanied by screen transition such as the edit end button 195 has been operated. When an operation is performed, a screen transition according to the operation is performed. Until the operation is performed, the processing from step S272 is repeated.

Here, when the user performs an operation using the processing density adjusting unit 185, density adjustment is performed as follows.

In the present embodiment, the cut image is generated by multiplying and combining the lower person layer 952a and the upper person layer 952b as described above. Here, the effect that the density of the filter processing 155 is changed is obtained by changing the degree to which the combined result of the multiplication combination is reflected in the result after the density adjustment.

That is, in general, the multiplication synthesis is performed by multiplying the gradation value for each pixel and for each RGB color.

(Synthesis result)=(value of gradation of upper person layer 952b)*(value of gradation of lower person layer 952a)/255

Here, since the upper person layer 952b and the lower person layer 952a are the same image, when the gradation value of the upper person layer 952b (or the gradation value of the lower person layer 952a) is represented by A, The synthesis result is as follows.

(Synthesis result)=A^2 (A squared)/255

Using the combined result and the gradation value (A) of the upper person layer 952b (or the lower person layer 952a), in consideration of the density adjustment count (x percent), the pixel The result after density adjustment (adjustment result) is obtained for each RGB color.

(Adjustment result)=A-(A-(composite result))*x/100

That is, when the count of density adjustment is the highest (when x (percent)=100), the result after density adjustment is the same as the general synthesis result. On the other hand, when the count of density adjustment is the lowest (when x=0), the result after density adjustment is the same as that of the upper person layer 952b or the lower person layer 952a. In the initial state, the density adjustment count x may be set to, for example, an intermediate value of 50%. In other words, the upper person layer 952b and the lower person layer 952a are prepared so that the density of the standard filter processing 155 is obtained in this state.

By performing such density adjustment, the user can obtain a desired filter processing result in accordance with the relationship between the captured image and the filter processing 155 desired to be applied.

The range in which the density can be adjusted may be changed for each selected filter processing 155. This prevents the user from being able to select a density that would not be possible in a normal manner while using a relatively simple processing method. Therefore, the density adjustment does not fail, and it is possible to always generate a high quality cut image.

If the filter processing 155 that does not perform special image processing is selected, the adjustment bar 187, the density reset button 188, and the like are hidden or grayed out, and the operation related to the density adjustment is accepted. You may not be allowed.

The density adjustment may be realized as follows, for example.

FIG. 42 is a diagram illustrating a layer configuration of an image preview-displayed on cut-out image graffiti screen 180 in the modified example of the present embodiment.

The layer configuration shown in FIG. 42 is different in that a lower person layer 954a in which an image not based on the filter processing 155 is arranged is used instead of the lower person layer 952a shown in FIG. The other layers are the same. The image arranged on the lower person layer 954a is the image after blurring applied to the trimmed image to which the filter processing 155 has not been applied, and whether the image processing on the upper person layer 952b has the filter processing 155 applied. Only the difference is.

In such a case, the density adjustment can be performed by changing the display density of the upper person layer 952b. That is, in this case, by operating the adjustment bar 187, the display density of the upper person layer 952b is changed. Then, depending on the display density of the upper person layer 952b, the lower person layer 954a to which the filter processing 155 is not applied can be seen through, and the density of the filter processing 155 appears to change.

[Explanation of collage creation]

In the present embodiment, in collage creation, roughly three types of design collage images, “simple collage”, “cover collage”, and “free collage” can be created. According to the simple collage and the cover collage, a collage image can be generated by arranging a photographed image in a predetermined area in a template image prepared in advance and performing graffiti on it. On the other hand, according to the free collage, a photographed image is arbitrarily arranged, characters and figures are arranged on a canvas in a predetermined range (a stamp image prepared in advance is arranged or written with a pen. ), you can freely generate collage images.

In the present embodiment, the collage image created by the cover collage can be used as a background image suitable for the user to use in a web service provided on the Internet such as a predetermined SNS. For example, the user's setting operation for each of the three web services “SNS A” (first web service), “SNS B” (second web service), and “SNS C” (third web service) A collage image can be generated as a background image displayed based on the.

FIG. 43 is a flowchart showing the operation when creating a collage.

As shown in FIG. 43, when the collage creation is started, the design selection operation is accepted in step S341. The design selection operation is performed by the user selecting a desired design from among three types of designs, “simple collage”, “cover collage”, and “free collage”. In this embodiment, the options of “Cover Collage” are “SNS A Cover Collage”, “SNS B Cover Collage”, and “SNS C Cover Collage”, and each of the above-mentioned first to third web services. Although the three options corresponding to the above are finely divided and provided, the present invention is not limited to this. The design selection operation is performed by displaying the design selection screen.

When a design other than "free collage" is selected in step S341, the process proceeds to step S342. In step S342, the screen transitions to the simple collage editing screen, and a collage image is created.

On the other hand, when “free collage” is selected in step S341, the screen transitions to the free collage editing screen in step S343, and a collage image is created.

FIG. 44 is a diagram for explaining the screen transition of the edit screen when creating the collage.

As shown in FIG. 44, on the graffiti editing screen 100, when the second creation button 118b of the creation buttons related to the graffiti is operated, if the collage image is not created yet in the play, the design selection screen 220 is displayed. (S401). When the second creation button 118b is operated in a state where the collage image already generated in the play is saved, the screen directly shifts to the collage screen 280 for editing the collage and performing scribble (S403). Thus, if there is a collage image that has already been saved, subsequent edits can be immediately performed from the edit state.

A design is selected on the design selection screen 220. When a free collage is selected from a plurality of options and the enter button 227 is operated, the screen changes to the collage screen 280 (S404). On the other hand, when an option other than free collage is selected and the enter button 227 is operated, the screen changes to the photo selection screen 260 (S405).

When the return button 158 is operated on the design selection screen 220, the graffiti editing screen 100 is returned to (S415).

When the enter button 277 is operated on the photo selection screen 260, the screen changes to the collage screen 280 (S407). At this time, a base image of the same size as the size of the transmission image transmitted to the server 601 is generated, and a base size of the display size is generated based on the generated base image. The base image of the transmission size has a relatively high image quality (large number of pixels). The base image of the display size is an image having the number of pixels that can be displayed on the collage screen 280 as it is (without being reduced in size). The base image of the display size is displayed on the collage screen 280.

On the photograph selection screen 260, when the return button 158 is operated, the graffiti edit screen 100 is displayed (S413). At this time, the images generated so far may be saved as a collage image.

On the photo selection screen 260, when the previous screen button 279 is selected, the screen changes to the design selection screen 220 (S409).

When the return button 158 is operated on the collage screen 280, the edit result is saved and the screen is changed to the graffiti edit screen 100 (S411).

When the previous screen button 293 is operated on the collage screen 280, a predetermined confirmation screen is displayed, and then a transition is made to the photo selection screen 260 according to the user's instruction (S417). The confirmation screen at this time is the same as the screen that is also displayed when the cutout image is generated, and the operation performed regarding it is also the same.

FIG. 45 is a diagram showing the design selection screen 220.

As shown in FIG. 45, on the design selection screen 220, a design type selection tab 221, a decision button 227, a previous screen button 229, and a return button 158 are arranged. When the return button 158 or the previous screen button 229 is operated, the graffiti edit screen 100 is returned to.

In the present embodiment, the design type selection tab is composed of five tabs. That is, the tabs are "Easy Collage", "SNS A Cover Collage", "SNS B Cover Collage", "SNS C Cover Collage", and "Free Collage". Of these tabs, the type of design corresponding to the selected tab is displayed in the in-tab display area 223. In the in-tab display area 223, designs selectable by the user are displayed side by side. Further, in the tab display area 223, a sample image using a design of a type corresponding to the tab may be displayed.

The user can select a desired design from among the designs displayed in the in-tab display area 223 of the selected tab and then operate the enter button 227 to determine the design. When the design is determined, the screen changes to the photo selection screen 260 or the collage screen 280 according to the selected design.

Note that FIG. 45 shows a case where “free collage” is selected from the above-mentioned five tabs. In "Free Collage", the external shape of the collage image can be selected from "square", "vertical", "horizontal", and "vertical length". When the design is determined, the collage image of the selected outer shape can be edited on the collage screen 280.

FIG. 46 is a diagram showing the design selection screen 220 when “simple collage” is selected.

As shown in FIG. 46, when the “simple collage” tab is selected, eight types of designs with different predetermined templates and image layouts are displayed in the tab display area 223. The user can select a photo to be arranged in the collage image on the photo selection screen 260 by selecting any design and operating the enter button 227.

FIG. 47 is a diagram showing the design selection screen 220 when “SNS A cover collage” or “SNS B cover collage” is selected.

As shown in the upper part of FIG. 47, when the tab of “SNS A cover collage” is selected, for example, four types of designs such as patterns and letters which are different from each other are displayed in the tab display area 223. .. By selecting one of the designs and operating the enter button 227, the user can select a photo to be placed in the collage image on the photo selection screen 260, as in the case of the “simple collage”.

When the tab of "SNS B cover collage" is selected, four types of designs are displayed in the tab display area 223 as shown in the lower part of FIG. The same applies when the "SNS C Cover Collage" tab is selected. These “cover collages” are different from the “simple collages” in that the design according to the specifications such as the size of the background image of the corresponding SNS is predetermined as an option.

In the present embodiment, the collage image (hereinafter, also referred to as a background image) created by the “cover collage” is an image suitable for being displayed on the web page related to the user himself/herself in the web service. For example, the icon image of the user, the display of the user name, the display of the user profile, and the like are displayed as a background of a predetermined area.

[Explanation about "Free Collage"]

FIG. 48 is a diagram showing the collage screen 280 when the “free collage” design is selected.

First, the creation of a free collage will be described with reference to FIG.

The structure of the collage screen 280 is roughly the same as that of the cutout graffiti screen 180. That is, the palette 115, the return button 158, and the previous screen button 293 are displayed on the collage screen 280. In the center of the collage screen 280, a collage area 281 is displayed according to the result of design selection or the selection result of the photo selection screen 260. A preview display corresponding to the generated collage image is displayed inside the collage area 281 (the display in this collage area 281 may be referred to as a preview image). On the collage screen 280, the image can be generated as a collage image by performing collage or other graffiti so that the preview display displayed in the collage area 281 is as desired.

When the free collage is selected, the user can create a collage image by arbitrarily arranging a design, a photographed image, or the like in the collage area 281. That is, when the design selection screen 220 transits to the collage screen 280, the frame-shaped collage area 281 of the selected design (aspect ratio) is displayed on the collage screen 280. The user can arrange various photographed images, stamps, characters, and other scribbles inside the collage area 281.

Here, the palette 115 has different available functions depending on whether a free collage design is selected or not. For example, a free collage is configured so that a figure or the like based on a photographed image can be arbitrarily arranged in the collage area 281 (the palette used for this may be referred to as a collage palette). On the other hand, in other designs, such a palette 115 cannot be selected, and it is only possible to use a predetermined pattern or character that is not based on a captured image or a function that the user arbitrarily draws.

In the collage palette, for example, a photographed image stamp can be created by cutting (cutting) the selected photographed image in a predetermined shape. The created photographed image stamp can be appropriately arranged in the collage area 281.

Here, in the present embodiment, the processed density adjusting unit 285 may be displayed on the collage screen 280. The processing density adjusting unit 285 includes an adjustment bar 287 and a density reset button 288, like the processing density adjusting unit 185 on the cut-out graffiti screen 180. When image processing such as filter processing is applied to the free collage, the user can change the density by operating the processing density adjustment unit 285.

[Explanation on "Easy Collage"]

Next, the "simple collage" will be described.

FIG. 49 is a first diagram showing the photograph selection screen 260 when the “simple collage” design is selected.

When the design of "simple collage" is selected, a photo selection screen 260 is displayed as shown in FIG. 49, for example. On the photo selection screen 260, in addition to the return button 158, a photo selection area 251, a design display area 261, a zoom bar 267, an enter button 277, and a previous screen button 279 are displayed. The return button 158 is a button operated to return to the graffiti editing screen 100. The previous screen button 279 is a button for returning to the design selection screen 220. The zoom bar 267 is operated for enlarging/reducing the captured image displayed in the collage image, similarly to the zoom bar 147 in the cut screen 140 described above. When a plurality of captured images are to be included in the collage image, the operation result of the zoom bar 267 is reflected on the designated one of the plurality of captured images displayed in the design display area 261. Is configured.

When transitioning from the design selection screen 220 to the photo selection screen 260, an image corresponding to the selected design is displayed in the design display area 261. That is, the template image 263 is displayed in the design display area 261 according to the selection result of the simple collage design. The template image 263 of each design is provided with one or a plurality of display areas for captured images. The image to be arranged in this display area can be selected in the photograph selection area 251.

In the present embodiment, two captured images 265a and 265b can be arranged in the template image 263. One of the photographed images 265a and 265b is selected (a selection frame 266 is displayed in the selected region), and the photographed image to be displayed in the region is selected in the photograph selection region 251. By doing so, the photograph can be displayed.

In the photograph selection area 251, a photographed image obtained by photographing the play is displayed. The user can perform an operation of selecting one of these to be displayed.

Here, a one-shot designation button 252 is arranged in the photo selection area 251. The one-shot designation button 252 is a button that can be applied to the area where the captured images 265a and 265b in the template image 263 are displayed by shuffling the captured images that are selection candidates in the photo selection area 251. That is, when it is necessary to select a plurality of captured images to be displayed corresponding to the template image 263, the user can immediately specify each captured image by operating the one shot designation button 252. .. If the shot image that can be designated by operating the one shot designation button 252 is not appropriate, the shot images can be easily reselected and rearranged by repeatedly operating the one shot designation button 252. it can.

Further, in the photo selection screen 260, with one of the areas where the captured image is displayed being selected, the zoom bar 267 is slid or the captured image is panned similarly to the operation performed in the cut screen 140. By doing so, it is possible to change the area of the original captured image to be displayed in the area.

In the present embodiment, the icon 367 is initially displayed in the selected area. By looking at the icon 367, the user can easily know that the pan operation can be performed on the image in the area.

FIG. 50 is a second diagram showing the photograph selection screen 260 when the “simple collage” design is selected.

50 shows a state in which the photographed image 265a is operated while the photographed image 265a as shown in FIG. 49 is selected. That is, as shown in FIG. 49, immediately after the photographed image 265a is arranged, the icon 367 is displayed if it is selected as an editing target. In this state, when the user touches the captured image 265a, the icon 367 is deleted.

FIG. 51 is a diagram showing an example of the result of operating the zoom bar 267 from the state shown in FIG.

As shown in FIG. 51, when the zoom bar 267 is operated in the direction in which the image is enlarged while the area of the photographed image 265a is selected, the photographed image 265a is enlarged and displayed in the design display area 261. To be done. Also, when a pan operation for moving the captured image 265a with respect to the design display area 261 is performed, the display is updated at any time, and the range displayed as the captured image 265a changes. This allows the photographed images 265a and 265b to be displayed together with the template image 263 in the design display area 261, and the display of the photographed images 265a and 265b can be easily adjusted while confirming that a desired collage image can be obtained. it can.

FIG. 52 is a diagram showing the collage screen 280 when the “simple collage” design is selected.

Also in FIG. 52, the collage screen 280 is basically displayed in the same manner as described with reference to FIG. 48, and the image can be edited. When transitioning from the photo selection screen 260 to the collage screen 280 when creating the collage image of the simple collage, the image generated when the enter button 277 on the photo selection screen 260 is operated is displayed in the collage area 281. .. That is, in the collage area 281, a preview display corresponding to the generated collage image is displayed.

It should be noted that the collage area 281 includes photographed image layers (captured images of the template image 263 and the display layer of the template image 263) including the photographed images 265a and 265b and the template image 263 corresponding to the image of which the content is confirmed through the photo selection screen 260. An image in which a display layer including 265a and 265b is overlapped with an edit layer displayed on the upper side is displayed. The base image generated as described above is displayed on the captured image layer. When graffiti is drawn on the collage screen 280, the graffiti is added to the editing layer. When image processing such as filter processing is applied to the image of the captured image layer, the density adjustment can be performed by operating the processing density adjustment unit 285, but the present invention is not limited to this.

Note that, unlike the above-described creation of the free collage, the function of using the captured image using the palette 115 on the collage screen 280 in this case (the captured image stamp generated by die cutting as described above can be used. Functions and the like) cannot be performed, and it is only possible to arrange a predetermined figure or character as a stamp in the collage area 281, or to write a character or figure in the collage area 281 using a pen. However, it is not limited to this.

When the scribbling on the collage area 281 is completed, the user operates the edit end button or the return button 158. This completes the generation of the collage.

In this way, even when creating a collage, the density can be adjusted in the same manner as when creating a cutout image. It should be noted that, for example, when a simple collage is performed, the blur selection as described above may be performed on the photo selected on the photo selection screen 260.

[Effects of Embodiment]

In this embodiment, the following effects can be obtained.

Firstly, conventionally, there is a user's need to obtain an image that can be utilized by using, for example, a mobile terminal. If a user can generate an image that is attractive to the user, such as a highly designed image or an image as intended, by using the photograph sticker creating device according to such needs, the user's satisfaction will be improved. improves. That is, as an example, when posting an image created using the photo sticker creating device to a web service such as SNS, the user's face is clearly displayed in the image, while the faces of other users are hidden or unclear. There is a need such as wanting to keep it displayed. This is because when the face of another user is clearly displayed in the image, it is necessary to respect other users' intentions regarding the use of the image. In addition, there is a need to perform graffiti editing by emphasizing an image partially.

In the above case, blurring is effectively applied to an image, for example, blurring other portions while clarifying only the user's own portion, or partially blurring portions that do not undergo graffiti editing. If an attractive image can be generated in this way, user satisfaction is improved. However, heretofore, there has been no photo sticker creating apparatus capable of applying such effective blurring. In response to the needs described above, graffiti such as pens and stamps are used to carry out editing work to hide desired parts, and the images created by them become unattractive images. There was a problem that sometimes.

On the other hand, in the present embodiment, for example, when creating a cutout image, it is possible to generate an attractive image, such as an image including a focus area and a blur area outside the focus area, by using the blur editing screen. Become. In this case, the position, size, shape, etc. of the focus area can be changed appropriately according to the user's operation. Therefore, the user can generate an attractive image with a blur that he/she imagines, and the attractiveness of the play using the photo sticker creating device and the play using the photo sticker playing system can be improved. ..

On the blurring edit screen, the preview image is updated according to the user's operation. Therefore, the user can perform blurring editing while imagining the completed state, and the satisfaction of the user who plays is improved.

The blurring edit screen is displayed after the trimmed image is generated on the cut screen. Therefore, it is possible to effectively perform blurring editing while confirming the final cut-out image on the preview image. That is, it is difficult for the user to grasp the image after blurring before the trimming range and the photograph to be trimmed are determined (before the trimming operation), and the blurring editing operation cannot be easily performed. In addition, if an edit operation for blurring is attempted at the same time as setting the cut range on the cut screen, many operations are required for the user to distinguish the operation of moving the photographic image and the operation of moving the focus area on the cut screen. It is necessary to request, the operability is bad, and it becomes complicated. On the other hand, in the present embodiment, after the trimmed image is once generated, the blurring editing operation is accepted for the trimmed image while displaying the preview image, so that the user can easily perform the blurring editing. it can.

In addition, the blurring edit screen is displayed for the trimmed image after various processing processes such as filter processing are applied on the cut screen, and the blurring edit is accepted. Therefore, in blurring editing, layers related to blurring editing (blurring layer and mask layer) and trimmed image layers may be handled, and after blurring editing, layers of images to which blurring processing and other processing processing has been applied may be handled. Only a relatively simple process needs to be performed in the photo sticker creating apparatus. That is, in order to be able to perform the image processing that needs to be performed using the clear image before applying the blur after performing the blur editing, the layer related to the blur editing and the layer of the image before the blur application are performed. It is necessary to maintain the layer structure of No. 3, and the processing load on the photograph sticker creating apparatus becomes relatively large. On the other hand, in the present embodiment, as described above, the processing load on the photograph sticker creating apparatus can be kept relatively small.

Secondly, if an attractive image can be generated by applying various kinds of image processing such as filter processing according to the needs of the user as described above, user satisfaction is improved. However, conventionally, such image processing such as filter processing is usually applied to the image to a uniform degree regardless of the original image. On the other hand, as the original image, various objects are processed due to factors such as a difference in subject and a difference in environment. Therefore, there were the following problems.

That is, as the original image, for example, a first case in which the face of a subject (such as a user) is relatively bright and a second case in which the face is relatively dark are assumed. Such a difference may occur due to, for example, a difference in skin color or makeup color of the subject. If such an image is subjected to filter processing such as processing into a high-key tone image, good results are obtained in the second case, but in the first case, the face portion of the subject, etc. May be overexposed and the gradation may be lost. On the other hand, for example, when a filter process for processing a dark image is performed, a good result is obtained in the first case, but in the second case, the face color portion of the subject is blackened, Gradation may be lost.

For such a problem, individually adjusting various image processings that constitute the filter processing is that the harmony of a plurality of image processings is maintained and that it is necessary to perform the operation promptly. Have difficulty.

FIG. 53 is a diagram illustrating an example of conventional filter processing.

For example, in FIG. 53, a case is shown in which filter processing that performs saturation adjustment and texture soft light synthesis is applied to the original image. That is, the original image is processed (S901) to reduce the saturation by 30% (S902). Then, a rainbow-colored texture (S903) from the upper right to the lower left of the processed image is combined with 100% of the soft light, and an image subjected to the filter processing is obtained (S904). Regarding such filter processing, it is not easy and time-consuming to individually set the saturation adjustment processing and the synthesis processing to obtain a balanced processed image.

With respect to such a problem, in the present embodiment, for example, by performing the density adjustment as described above at the time of creating a cutout image, the user can adjust the captured image and the filter processing desired to be applied. The desired filter processing result can be obtained. Specifically, for example, when applying high-key filter processing and the user's face is overexposed in the initial state, the user reduces the density of the filter processing to remove overexposure. A reduced image can be obtained. Further, when applying the filter processing 155 of relatively dark tone, if the blackout occurs in the initial state and the gradation of the dark portion becomes poor, the user lowers the density of the filter processing to reduce the dark area. It is possible to obtain an image in which the gradation is maintained.

Since the processing for reflecting the density adjustment as described above can be easily performed, the preview display can be promptly performed according to the user's operation. Therefore, it is possible to accept a further user operation while maintaining the state where the preview image is always displayed.

FIG. 54 is a diagram illustrating an example of density adjustment for filter processing according to the present embodiment.

FIG. 54 shows the density adjustment range for the filter processing that performs the saturation reduction processing and the soft light composition of the texture as shown in FIG. Step S923 is an image with a default density (for example, a density of 50%), in which case the saturation is -30% from the original image and the soft light composition is 50%.

When the adjustment bar 187 is operated to reduce the density, first, the step S922 is performed. At this time, the saturation is -25% and the soft light composition is 40%. That is, the degree of processing is reduced. When the adjustment bar 187 is operated so that the density is reduced most (the slider is moved to the left end), the state of the original image is obtained as shown in step S921.

On the other hand, when the adjustment bar 187 is operated to increase the concentration, first, the step S924 is performed. At this time, the saturation is −35% and the soft light composition is 60%. That is, the degree of processing increases. When the adjustment bar 187 is operated to further increase the density (the slider is moved to the right), the saturation becomes −45% and the soft light composition becomes 80%, as shown in step S925. ..

As described above, in the present embodiment, according to the operation of the adjustment bar 187, it is possible to simultaneously adjust the degree of the plurality of image processes while keeping the balance. Therefore, the user can adjust the image to be filtered as desired while looking at the image to be adjusted within a limited time.

[Explanation of Modifications of this Embodiment]

In the above-described embodiment, for example, when applying blur to a cut image, the blur can be edited on the blur editing screen 160, but the present invention is not limited to this. For example, it may be possible to edit the presence/absence of blurring and the mode when the graffiti is edited on the cutout image. At this time, it may be possible to select whether or not to apply the blurring process to the graffiti (edited image). It should be noted that such an operation may be performed even when the graffiti of another image is edited, such as when creating a collage.

FIG. 55 is a flowchart showing a cut image creating process in the photograph sticker creating apparatus according to a modification of the present embodiment.

As shown in FIG. 55, in this modified example, the cutout screen 140 (step S381), the standby screen as necessary (step S382), and the cutout image graffiti screen are directly displayed (step S383).

FIG. 56 is a diagram showing a cut-out image graffiti screen 180a according to the present modification.

As shown in FIG. 56, the cutout graffiti screen 180a basically has the same configuration as the cutout graffiti screen 180 in the above-described embodiment. The processing density adjusting unit 185 is also provided in the same manner. On the cut image graffiti screen 180a, a blur palette 115a for performing blur editing is displayed.

The blurring palette 115a roughly includes a blurring pattern selecting unit 821, a density adjusting bar 823, a range adjusting bar 825, and a color selecting unit 835. Further, the blur palette 115a includes a target selection button 831 (831a, 831b).

The blur pattern selection unit 821 is configured to be able to select any one of a plurality of predetermined blur patterns, like the blur pattern selection unit 171 described above. The selected blur pattern is applied to the target image 181 during graffiti editing.

The density adjusting bar 823 and the range adjusting bar 825 are respectively configured so that the sliders can be moved left and right. By performing an adjustment operation on the density adjustment bar 823, the degree of blurring processing (whether the blurring is not so much or the blur amount is increased) can be adjusted. By performing an adjustment operation on the range adjustment bar 825, the size of the focus area corresponding to the blur pattern can be adjusted.

The color selection unit 835 receives an operation of selecting any one of a plurality of colors. When a color is selected, control is performed so that the blurred area is colored in that color.

It should be noted that, except when the blurring pattern is selected and the blurring process is valid, the operation receiving unit (for example, the density adjusting bar 823, the range adjusting bar 825, the color selecting unit 835, the target selecting unit) that assumes that there is blurring is selected. The button 831 or the like) may be hidden or may be displayed so that it can be recognized that the operation cannot be accepted.

FIG. 57 is a flowchart showing the blurring edit acceptance process.

As shown in FIG. 57, in step S291, the blurring palette 115a is selected while the cutout graffiti screen 180a is displayed.

In step S292, it is determined whether a pattern selection operation has been performed. When the operation is performed, the blurring is reflected according to the operation in step S293.

In step S294, it is determined whether blurring is being applied. If it is being applied, the processes of steps S295 and S296 are performed.

In step S295, the blurring edit operation is accepted. That is, the operation of the density adjustment bar 823, the range adjustment bar 825, the color selection unit 835, and the like by the user is accepted. When accepted, the blurring is changed according to the operation.

In step S296, the target change operation is accepted. When accepted, the target of the blurring process is changed according to the operation.

In step S297, the preview display is updated.

In step S298, it is determined whether an operation button accompanied by screen transition such as the edit end button 195 has been operated. When an operation is performed, a screen transition according to the operation is performed. Until the operation is performed, the processing from step S292 is repeatedly performed.

Here, the changing process of the blurring process target accompanying the target changing operation is performed as follows, for example.

FIG. 58 is a diagram illustrating a layer configuration of an image preview-displayed on the cut-out image graffiti screen 180a.

As shown in FIG. 58, the image is configured by superposing a person layer 812a, a lower blur layer 812b, a lower stamp layer 812c, an upper blur layer 812d, and an upper stamp layer 812e in order from the bottom. Has been done. Here, the graffiti is placed on the upper stamp layer 812e or the lower stamp layer 812c. One of the upper blur layer 812d and the lower blur layer 812b is included, and two are not displayed at the same time.

The trimmed image is arranged on the person layer 812a. The person layer 812a is divided into two layers as shown in the above-described embodiment so that the adjustment function of the filter processing can be performed. Omit it.

FIG. 59 is a diagram for explaining the changing process of the blurring process target.

In FIG. 59, the layer configuration diagram of each step is arranged in time series. It is assumed that the blurring process is performed without the graffiti.

At this time, in step S851, the person layer 812a and the lower blur layer 812b are displayed. On the cut-out image graffiti screen 180a, a preview image of the trimmed image to which the blurring process is applied is displayed.

In step S852, graffiti is added.

Then, in step S853, the person layer 812a, the lower blur layer 812b, and the upper stamp layer 812e are displayed. The graffiti is placed on the upper stamp layer 812e. At this time, a preview image is displayed on the cut-out image graffiti screen 180a in a state where the blurring process is not applied to the graffiti, that is, only the person is blurred.

In step S854, the target selection button 831a for including graffiti as a blurring target is operated. Then, the layer moves.

That is, in step S855, the person layer 812a, the lower stamp layer 812c, and the upper blur layer 812d are displayed. By moving the lower blur layer 812b to the upper blur layer 812d in step S853, the upper blur layer 812d is moved to the lower stamp layer 812c. At this time, a preview image of the image to which the blurring process has been applied is also displayed on the cutout graffiti screen 180a.

In step S856, graffiti is added.

Then, in step S857, the person layer 812a, the lower stamp layer 812c, the upper blur layer 812d, and the upper stamp layer 812e are displayed. The added graffiti is placed on the upper stamp layer 812e. At this time, a preview image of the graffiti image in which the blurring process is not applied to the image of step S855 is displayed on the cut-out image graffiti screen 180a. That is, the image of the graffiti in step S852 is displayed with a blurring process, and the image of the graffiti in step S856 is displayed without the blurring process.

In step S858, the target selection button 831b for limiting the blurring target to only the person is operated. Then, the layer moves.

That is, in step S859, the person layer 812a, the lower blur layer 812b, and the lower stamp layer 812c are displayed. The upper blur layer 812d in step S857 moves to the lower blur layer 812b. Further, the lower stamp layer 812c and the upper stamp layer 812e are combined to form the lower stamp layer 812c. At this time, a preview image of the state in which the blurring process is not applied to all the graffiti is displayed on the cutout graffiti screen 180a.

In step S860, the target selection button 831a for including graffiti as a blurring target is operated. Then, the layer moves.

That is, in step S861, the person layer 812a, the lower stamp layer 812c, and the upper blurring layer 812d are displayed. The lower blur layer 812b in step S859 moves to the upper blur layer 812d. At this time, a preview image of the state in which the blurring process is applied to all the graffiti is displayed on the cutout graffiti screen 180a.

It should be noted that the target of blurring is configured to be automatically selected in the initial state according to the situation of the graffiti at that time. That is, when the blurring palette 115a is displayed without the graffiti, only the person is selected to be subjected to the blurring processing. On the other hand, when the blur pallet 115a is displayed in the state of being scribbled, it is selected to perform the blurring process including the scribble. Note that such processing may not necessarily be performed, and processing different from this may be automatically performed. It may be configured so that only the person is always targeted regardless of the state of the graffiti.

As described above, in this modified example, both the graffiti and the blur can be edited on the cutout graffiti screen 180a. In addition, whether the target of the blurring process is only the person or the graffiti is included can be appropriately selected and changed while the graffiti is being edited. These operations can be performed while checking the preview image. Therefore, it becomes possible to easily create an image that is more attractive to the user and that is subjected to more diverse blurring processing.

[Other]

The photograph sticker creating apparatus may not have all the feature points in the above-described embodiment, but may have only some feature points. Even with the photographic sticker creating apparatus having such a configuration, it is possible to obtain an effect according to having the characteristic points.

The control unit of the photograph sticker creating apparatus may be capable of recognizing a region (for example, a face portion) having a predetermined part of a person in a photographic image such as a trimmed image during blurring editing. At this time, the position and size of the focus area may be automatically selected according to the position and size of the recognized area. As a result, blurring editing can be easily performed.

The focus area may be rotated along with the rotation operation performed on the image after the blurring edit is performed once.

The blurring pattern, that is, the shape of the focus area may not be selectable on the blurring edit screen, and may be automatically selected by the control unit as appropriate. At this time, the control unit selects one of a plurality of preset blur patterns according to the attribute of the image to be applied (for example, whether the image is a close-up image or a full-body image). You may make it select a thing automatically.

Note that, similar to the blurring editing function described above, the following processing may be performed for other types of image processing such as mosaic processing and filter processing. That is, when processing (image processing) that applies different effects to the first area in the specified range and the second area around it is performed, the layer for processing and the alpha channel data are arranged. By using the mask layer, the first region and the second region may be distinguished from each other, and the position, size, etc. of the first region may be changed. As a result, it is not necessary to process the original image every time the position specifying operation or the size changing operation of the first area is performed, and it is possible to perform preview display with high followability.

When creating a cutout image or a collage, the image displayed on the cutout screen or the like may be different from the image actually acquired by the user (for example, the image transmitted from the photo sticker creating apparatus to the server). Specifically, for example, the following may be done. That is, a display image with a small number of pixels (a size corresponding to the resolution of the display) is displayed as an original image on a cut screen or the like, so that the cut range can be adjusted, filter processing or blurring can be applied. .. When cropping is performed or when the blur to be applied is determined, the range corresponding to the cropping range set for the display image or the determined processing mode, the more pixels corresponding to the display image are selected. Crop processing and image processing are performed on a large number of images. Then, the cut image is appropriately reduced to a predetermined size (number of pixels). By performing such processing, it is possible to create an image with fine image quality, which has a high sense of resolution particularly in the non-blurring application area.

When a captured image is used in the process of generating a cutout image or a collage, the captured image may be used as it is, or the image after the image processing or the cutout of the captured image (the captured image May be used for processing.

The design at the time of creating the collage does not have to be selectable on the predetermined selection screen as described above, and is automatically selected by the control unit according to various conditions at the time of playing, or randomly at the control unit. May be automatically selected by.

The generated cutout image, collage image, etc. may be provided to the user by another method without being transmitted to the server. For example, the image may be provided to the user by directly communicating with the user's mobile phone and the photograph sticker creating apparatus by wired communication or wireless communication, or by using a portable recording medium or the like, the image may be provided to the user. It may be provided.

INDUSTRIAL APPLICABILITY The present invention is not limited to the photograph sticker creating apparatus, but can be widely applied to a photography game apparatus that provides a processed image to a user using a photographed image and an apparatus including the same.

The processing in the above-described embodiments may be performed by software or a hardware circuit.

It is possible to provide a program for executing the processing in the above-described embodiment, or to record the program in a recording medium such as a CD-ROM, a flexible disk, a hard disk, a ROM, a RAM, or a memory card and provide it to the user. You may The program may be downloaded to the device via a communication line such as the Internet. The processing described in the text of the above flowchart is executed by the CPU or the like according to the program.

It should be considered that the above-described embodiments are illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description but by the claims, and is intended to include meanings equivalent to the claims and all modifications within the scope.

1 Photo sticker creation device (an example of a photo shooting game device)
100 graffiti edit screen 140 cut screen 160 blur edit screen 180, 180a cut image graffiti screen 220 design selection screen 260 photo selection screen 280 collage screen 281 collage area 501 control unit 502 CPU
503 memory 504 image processing unit 505 storage unit 507 control program 509 communication unit 515 camera 570 editing output device 575 sticker outlet 580 editing receiving unit 581 editing monitor 583 touch pen 585 non-contact communication device 587 speaker 590 printing unit 601 image providing server 701 mobile phone Terminal 901 Photo sticker game system

Claims (4)

A photography game device for providing a user with a provided image generated using a photographic image obtained by shooting with a camera,
A plurality of photographic images obtained by shooting with the camera are displayed, and a photographic selecting unit that selects a photographic image used to generate the provided image,
A processing unit that receives a user operation relating to a processing process to be performed on the photographic image selected by the photograph selecting unit, and performs the processing process based on the reception result;
After the user's operation related to the processing, the user's operation related to the blur processing partially applied to the photo image processed by the processing unit is accepted, and the blur processing is performed based on the reception result. Blurring means to do
After the user's operation related to the blurring process, the user's operation related to the graffiti editing process applied to the blurring-processed photo image by the blurring unit is accepted, and the graffiti editing process is performed based on the acceptance result. Editing means,
A processing unit , the blurring unit , and a generation unit that generates the provided image based on a processing result by the graffiti editing unit ,
The operation of the user regarding the processing is a filter processing that performs a combination of a cutting range of the photographic image, a scaling operation of the photographic image, a rotation operation of the photographic image, and a plurality of image processings applied to the photographic image. A photography game device including at least one operation of type selection operation. The blurring means is
Presentation means for presenting a plurality of blur patterns to the user in a selectable manner,
A blur pattern selecting means for accepting an operation of selecting one of the plurality of blur patterns to be applied by the user,
A plurality of blurred patterns, the specific region is not applied URN lend including blurring pattern that includes a portion of the photographic image, photographic game apparatus according to claim 1. A control method for a photography game device for providing a user with a provided image generated by using a photographic image obtained by shooting with a camera,
A plurality of photographic images obtained by shooting with the camera, a photo selecting step of selecting a photographic image to be used for generating the provided image;
A processing step of accepting a user operation regarding a modification process to be applied to the photo image selected in the photo selection step, and performing the modification process based on the acceptance result;
After the user operation related to the processing process, the user operation related to the blurring process partially applied to the photographic image subjected to the processing process in the processing step is accepted, and the blurring process is performed based on the reception result. Blur step to do,
After the user's operation related to the blurring process, the user's operation related to the graffiti edit process applied to the photo image subjected to the blurring process in the blurring step is accepted, and the graffiti edit process is performed based on the acceptance result. Edit step,
A generating step of generating the provided image based on the processing result of the processing step , the blurring step , and the graffiti editing step ,
The operation of the user regarding the processing is a filter processing that performs a combination of a cutting range of the photographic image, a scaling operation of the photographic image, a rotation operation of the photographic image, and a plurality of image processes applied to the photographic image. A method for controlling a photography and amusement device, including at least one operation of a type selection operation. A control program for a photography game device that provides a user with a provided image generated using a photographic image obtained by shooting with a camera,
A plurality of photographic images obtained by shooting with the camera, a photo selecting step of selecting a photographic image to be used for generating the provided image;
A processing step of accepting a user operation regarding a modification process to be applied to the photo image selected in the photo selection step, and performing the modification process based on the acceptance result;
After the user operation related to the processing process, the user operation related to the blurring process partially applied to the photographic image subjected to the processing process in the processing step is accepted, and the blurring process is performed based on the reception result. Blur step to do,
After the user's operation related to the blurring process, the user's operation related to the graffiti edit process applied to the photo image subjected to the blurring process in the blurring step is accepted, and the graffiti edit process is performed based on the acceptance result. Edit step,
Causing the computer to execute a generation step of generating the provided image based on the processing result of the processing step , the blurring step , and the graffiti editing step ,
The operation of the user regarding the processing is a filter processing that performs a combination of a cutting range of the photographic image, a scaling operation of the photographic image, a rotation operation of the photographic image, and a plurality of image processes applied to the photographic image. A control program for a photo-taking and playing device including at least one operation of type selection operation.