JP7431903B2 - Photography system, photography method, photography program, and stuffed animal - Google Patents

Description

The present invention relates to a photographing system, a photographing method, a photographing program, and a stuffed toy. In particular, the present invention relates to a photographing system, a photographing method, a photographing program, and a stuffed animal suitable for photographing stuffed animals.

Conventionally, there has been a communication device that performs a communication action for a user, and includes a structure including a facial part, which is composed of a plurality of constituent parts, and includes at least one constituent part corresponding to a part that makes up a face; a control means for causing the structure to perform a gesture expressing a communication behavior by controlling the motion; and a detection means for detecting the relative position of an object around the structure with respect to the structure; detects the position of the user's face, and the control means controls the structure to make the structure perform different gestures depending on the angle between the direction the face part faces and the direction of the user's face seen from the face part. A communication device that controls the operation of a computer is known (for example, see Patent Document 1). According to the communication device described in Patent Document 1, natural communication behavior can be performed in consideration of the user's orientation with respect to the face of the structure.

Japanese Patent Application Publication No. 2018-051701

In recent years, the ``nui-tori'' culture has become widespread, in which images of toys such as stuffed animals and dolls (hereinafter simply referred to as ``stuffed animals'') are taken in various places such as indoors, on the go, or while traveling. There is. In ``nui-tori,'' images of stuffed animals as the main character are uploaded to social networking services (SNS) and are enjoyed by many people. Here, in "stuffed photography", the situation, such as the location where the stuffed animal is present, is appropriately grasped, and an image corresponding to the situation is often captured.

In "stuffed photography," it is preferable to adjust the state of the stuffed animal to its surroundings, but with stuffed animals that do not have a driving part, it is difficult to make the stuffed animal take a pose that matches its surroundings. Further, the communication device described in Patent Document 1 cannot take into account the surrounding situation of the stuffed animal, which is important in "stuffing". In other words, although the communication device described in Patent Document 1 focuses on natural communication behavior between the user and the communication device, it cannot take into account the situation in which the stuffed animal is placed. In addition, the communication device described in Patent Document 1 makes the stuffed toy suitable for "stuffing" to enhance the lovability of the stuffed toy itself, and changes the pose of the stuffed toy so that the user becomes attached to it. It is not possible to take images that include

Therefore, an object of the present invention is to provide a photographing system, a photographing method, a photographing program, and a stuffed toy that are suitable for photographing stuffed animals and are capable of photographing images with high added value.

In order to achieve the above object, the present invention provides a photographing system comprising an information terminal and a stuffed toy that can operate based on predetermined information supplied from the information terminal, wherein the information terminal captures an imaging area in which the stuffed toy is included. The stuffed toy includes an imaging unit that captures an image, and an imaging area information acquisition unit that acquires imaging area information that is information regarding the imaging area, and the stuffed toy includes at least one component, a drive unit that operates the component, and the imaging area information. An imaging system is provided that includes a drive control section that controls the operation of the drive section based on the following.

According to the photographing system, photographing method, photographing program, and stuffed toy according to the present invention, it is possible to provide a photographing system, a photographing method, a photographing program, and a stuffed toy that are suitable for photographing stuffed animals and can capture images with high added value.

FIG. 1 is a schematic diagram of a photographing system according to the present embodiment. 1 is a functional configuration block diagram of an information terminal according to the present embodiment. FIG. FIG. 2 is a functional configuration block diagram of the stuffed toy according to the present embodiment. FIG. 1 is a schematic diagram of a stuffed toy according to the present embodiment. FIG. 3 is a data configuration diagram of each storage unit according to the present embodiment. FIG. 3 is a flow diagram of processing in the imaging system according to the present embodiment. FIG. 3 is a diagram of image processing by an image processing unit according to the present embodiment. It is a modification of the flowchart of processing in the imaging system according to the present embodiment. It is a figure of the example of creation of additional information concerning this embodiment. It is a flowchart of the processing of the imaging system concerning other embodiments.

[Embodiment]
<Overview of shooting system 5>
The photographing system 5 according to the present embodiment includes an information terminal having a camera, and a toy such as a stuffed animal or doll (hereinafter referred to as a "stuffed toy" in the present embodiment) having a drive unit driven by a battery. The drive unit operates in cooperation with the information terminal. In other words, the stuffed animal drive unit operates based on information regarding the imaging area of the camera, and the information terminal can capture an image in which the stuffed animal within the imaging area behaves like the main character. That is, in the photographing system 5, the information terminal grasps the situation of the imaging area including the stuffed toy, and the drive section of the stuffed toy operates based on the situation grasped by the information terminal. Then, an image including the stuffed animal (the stuffed animal in action or after a predetermined action) is captured by the information terminal. Thereby, the photographing system 5 can take a high-value-added image suitable for sewing pictures, and can provide a stuffed animal with high pettiness.

FIG. 1 shows an overview of a photographing system according to an embodiment of the present invention.

Specifically, the photographing system 5 includes an information terminal 10 and a stuffed animal 20 having a drive unit that can operate based on predetermined information supplied from the information terminal 10. The information terminal 10 has a camera (imaging unit), and the camera takes an image of an imaging area. The predetermined information is information regarding the imaging area, and includes, for example, the object 1 (for example, a person) included in the imaging area, the scenery/background, the stuffed animal 20, other stuffed animals, the imaging location, and/or the location of the imaging area. This is information regarding date and time (hereinafter referred to as "imaging area information"). As an example, the information terminal 10 acquires imaging area information of an imaging area in a shooting preparation state in which the information terminal 10 is in a state where it can accept an imaging instruction that instructs the camera to capture an image and waits for an imaging instruction.

For example, as shown in FIG. 1A, a case will be described in which an object 1 (person) and a stuffed animal 20 are included in the imaging area of the information terminal 10. In this case, the information terminal 10 acquires information indicating that the person who is the object 1 along with the stuffed animal 20 is included in the image capturing area and information indicating the movement of the person as image capturing area information by analyzing the image of the image capturing area. . The information terminal 10 can acquire imaging area information in real time and/or continuously. The information terminal 10 then supplies the acquired imaging area information to the stuffed animal 20 via wireless communication.

The stuffed animal 20 includes at least one component. As an example, the stuffed toy 20 has constituent members such as a head, a body, four limbs, and ears, and includes one constituent member and another constituent member adjacent to the first constituent member, such as a connection area between the head and the body. The drive unit is configured to have a drive unit in the connection area with the drive unit. The stuffed animal 20 also includes a drive control section that controls the operation of the drive section based on the imaging area information.

When the drive control unit of the stuffed toy 20 acquires the imaging area information from the information terminal 10, it operates the drive unit based on the imaging area information to operate the constituent members. For example, the drive control unit operates each drive unit included in the stuffed toy 20 so as to follow the movement of the person included in the imaging area, and operates each component that constitutes the stuffed toy 20. In the example of FIG. 1B, the imaging area information includes information indicating that the person who is the object 1 is raising his right arm. Therefore, the drive control unit operates the drive unit that can raise the right arm of the stuffed toy 20 based on the imaging area information received from the information terminal 10, thereby bringing the right arm of the stuffed toy 20 into the raised state. In this state, the information terminal 10 can capture an image of the stuffed animal 20.

As a result, according to the photographing system 5, the stuffed toy 20 included in the photographing area is displayed in a photographed image in which the stuffed toy 20 included in the photographed area is independently expressing joy, anger, sorrow, and happiness together with the person (object 1) in the photograph. It is possible to capture images that look like

The information terminal 10 may include a mobile phone or smartphone with a camera function, a laptop computer with a camera function or to which a web camera can be connected, a tablet PC, a PC with a camera function or to which a web camera can be connected, or a PC with a camera function or to which a web camera can be connected. The information terminal has an imaging function, such as a portable game machine that has a camera function or can connect a web camera, and/or a home game machine that has a camera function or can connect a web camera. The details of the photographing system 5 according to the present embodiment will be explained below, but the names, numerical values, etc. in the above explanation and the following explanation are merely examples, and it should be noted that the invention is not limited to these names, numerical values, etc. I would like to add.

<Details of shooting system 5>
FIG. 2 shows an example of the functional configuration of the information terminal according to the present embodiment, and FIG. 3 shows an example of the functional configuration of the stuffed toy according to the present embodiment. Moreover, FIG. 4 shows an outline of an example of a stuffed toy according to this embodiment. Furthermore, FIG. 5 shows an example of the data structure of each storage unit according to this embodiment.

[Overview of configuration of imaging system 5]
The photographing system 5 according to the present embodiment includes an information terminal 10 and a stuffed toy 20 that operates based on imaging area information acquired by the information terminal 10. As shown in FIG. 2, the information terminal 10 includes an imaging unit 100, an imaging control unit 102 that controls the operation of the imaging unit 100, an imaging area information acquisition unit 104 that acquires information about the imaging area, and an imaging area information acquisition unit 104 that acquires information about the imaging area. an image analysis unit 106 that analyzes an image of the image, an imaging area information storage unit 108 that stores imaging area information, an information terminal side transmitting/receiving unit 110 that transmits and receives predetermined information, and an instruction receiving unit 112 that receives instructions from the outside. , an image storage unit 114 that stores images, an image processing unit 118 that executes image processing, an additional information generation unit 120 that generates additional information, and a supply unit that supplies predetermined images and/or additional information to a predetermined server. 122, a stuffed animal information storage section 124 that stores information about stuffed animals, a stuffed animal information update section 126 that updates information about stuffed animals, a friend information storage section 128 that stores information about stuffed animal friends, and images of the imaging area, etc. It has a display section 130 that displays.

Further, as shown in FIG. 3, the stuffed toy 20 stores one or more constituent members 200 that make up the stuffed toy 20, a stuffed toy-side transmitting/receiving unit 202 that transmits and receives predetermined information, and a scenario of the operation of the stuffed toy 20. An operation information storage section 204, one or more drive sections 208 that operate the component 200, a drive control section 206 that controls the operation of the drive section 208, a sensor 210 that measures acceleration, etc., a microphone 212, and a speaker. 214, a battery 220, a battery remaining amount checking section 222 that checks the remaining amount of the battery 220, and a charging/discharging control section 224 that controls charging/discharging of the battery.

Note that all or part of the functions of each component included in the information terminal 10 may be provided by other components, or may be configured separately. Further, the stuffed toy 20 may have a part of each component included in the information terminal 10 or a part of the function of each component. Furthermore, the information terminal 10 may have a part of each component included in the stuffed animal 20 or a part of the function of each component. For example, the information terminal 10 may have some of the functions of the operation information storage section 204 and the drive control section 206.

In a modification of the present embodiment, the server has some of the functions of the information terminal 10 (for example, the server has the image analysis unit 106), and the information acquired by the information terminal 10 (for example, the imaging area (image information) may be analyzed in the server, and the drive control unit 206 of the stuffed toy 20 may operate the drive unit 208 based on the image analysis result in the server. However, in the following, a configuration in which no server exists will be described.

[Details of the configuration of the photographing system 5: Configuration of the information terminal 10]
(Imaging unit 100, imaging control unit 102)
The imaging unit 100 captures an image of an imaging area. Further, the imaging control unit 102 controls the operation of the imaging unit 100. For example, the imaging unit 100 is controlled by the imaging control unit 102 and captures an image (captured image) of an imaging area that includes the stuffed animal 20. Here, the imaging control unit 102 may, for example, capture an image in a state in which it is possible to perform imaging according to an imaging instruction from a user and in a state in which it is waiting for an imaging instruction (that is, in a shooting preparation state) before accepting an imaging instruction. The image capturing unit 100 can also capture an image. The imaging control unit 102 can also cause the imaging unit 100 to capture images in a ready state in real time and/or continuously. The imaging unit 100 supplies the image captured during the imaging preparation state to the imaging area information acquisition unit 104, the image analysis unit 106, and/or the display unit 130, and also supplies the image to the image storage unit 114, and/or provides a predetermined image. can be temporarily stored in memory. Then, the imaging control unit 102 causes the imaging unit 100 to capture an image when receiving an imaging instruction from the user, and performs imaging at the time of the imaging instruction and/or during a predetermined period before and after the time. The captured image of the area is stored in the image storage unit 114 and/or displayed on the display unit 130.

(Imaging area information acquisition unit 104)
The imaging area information acquisition unit 104 acquires imaging area information that is information regarding the imaging area. The imaging area information acquisition unit 104 can acquire imaging area information in a shooting preparation state. In addition, the imaging area information acquisition unit 104 acquires images continuously captured by the imaging unit 100 in a shooting preparation state in real time, at each predetermined point in time, or at predetermined time intervals. Imaging area information may also be acquired. The imaging area information acquisition unit 104 supplies the acquired imaging area information to the imaging area information storage unit 108.

Here, the imaging area information includes information regarding objects included in the imaging area, information regarding the background of the imaging area, positional information of the imaging area (location information of the imaging position), information on the imaging preparation state of the imaging area and date and time at the time of imaging, This is at least one piece of information selected from the group consisting of temperature, humidity information, weather information, and the like. Examples of the object include a person, a stuffed toy 20, a stuffed toy different from the stuffed toy 20 that is the subject of the captured image, and various articles included in the imaging area. In addition, information regarding the object includes the type of the object (if the object is a stuffed animal, the type of stuffed animal, etc.), the state of the object (the movement of the object, and if the object is a person, information about the person's movements, posture, facial expressions, etc.) information), etc.

Note that the imaging area information acquisition unit 104 is located near the information terminal 10 (for example, within a predetermined distance from the information terminal 10; the predetermined distance is, for example, Information indicating whether or not there is another stuffed animal within the range (distance at which wireless communication of the terminal-side transmitting/receiving unit 110 is possible) may be acquired as the imaging area information. For example, the imaging area information acquisition unit 104 determines whether communication is possible between the information terminal 10 and another stuffed animal, and if it is determined that communication is possible, the other stuffed animal exists near the information terminal 10. Information indicating that the image is to be captured is acquired as imaging area information.

Alternatively, the imaging area information acquisition unit 104 assigns a unique stuffed toy ID to each of the plurality of stuffed animals in advance, or assigns a stuffed toy to a stuffed toy that is near the information terminal 10 and can communicate with the information terminal 10 each time the shooting preparation state is set. 20 may be assigned to the stuffed animal (if there are multiple stuffed animals, a different ID may be assigned to each of the multiple stuffed animals). Then, the imaging area information acquisition unit 104 supplies commands to each of the stuffed toy drive control units 206 corresponding to each stuffed toy ID to perform different operations. Next, the imaging area information acquisition unit 104 obtains information about the stuffed animals included in the imaging area and the stuffed animals not included in the imaging area, based on the movement of the stuffed animal included in the imaging area and the stuffed toy ID of the stuffed animal that supplied the command corresponding to the movement. A stuffed animal existing near the terminal 10 is identified. The imaging area information acquisition unit 104 may acquire this identification result as imaging area information.

The imaging area information acquisition unit 104 acquires position information, date and time information, weather information, etc. of the imaging area using the GPS function, clock function, and function of acquiring information from an external server of the information terminal 10. Further, the imaging area information acquisition unit 104 acquires information regarding objects included in the imaging area, information regarding the background of the imaging area, etc. by image analysis of the captured image received from the imaging unit 100.

(Image analysis unit 106)
That is, the information terminal 10 includes an image analysis unit 106 that analyzes images. The image analysis unit 106 analyzes the image of the imaging area in the imaging preparation state acquired by the imaging unit 100 and/or the captured image of the imaging area acquired by the imaging unit 100 in response to an imaging instruction, and uses the analysis result as imaging area information. Generate as. The imaging area information acquisition unit 104 acquires the generated imaging area information. The image analysis unit 106 can perform image analysis using conventionally known image processing, pattern matching techniques, and the like.

The image analysis unit 106 can also learn by reading captured images of objects, backgrounds, etc. to be imaged from the image storage unit 114 or an external server. In this case, the image analysis unit 106 can identify the object or background included in the imaging region by comparing the learning result with the feature amount of the image in the imaging region. Furthermore, the image analysis unit 106 can also analyze the motion and/or state of an object included in the imaging area in real time. As an example, the image analysis unit 106 compares a predetermined model of a predetermined object with the feature amount of the object included in the imaging area, and determines how the object is moving and/or how the object is moving. It is also possible to analyze whether the state is Note that the image analysis unit 106 may recognize objects included in the image using, for example, Regional Convolutional Neural Network (R-CNN), high-speed RCNN, semantic segmentation, instance segmentation, or the like.

For example, the image analysis unit 106 analyzes the image in the imaging area, identifies whether or not the object included in the imaging area is a person, and if the object is identified as a person, determines the movement of the person and/or Can identify facial expressions. The image analysis unit 106 also identifies whether or not the object included in the imaging area is a stuffed toy, and if the object is determined to be a stuffed toy, the image analysis unit 106 can identify the characteristics (for example, type, attributes, etc.) of the stuffed toy. . Furthermore, when the object included in the imaging area is an item that is not a person (for example, food and drinks, merchandise, personal effects, vehicles such as cars, etc.), the image analysis unit 106 can identify the object ( For example, it is possible to specify the product name, etc.). Furthermore, the image analysis unit 106 can also specify what kind of background or scenery the image capturing area is.

(Imaging area information storage unit 108)
The imaging area information storage unit 108 stores imaging area information. The imaging area information storage unit 108 stores the imaging area information acquired by the imaging area information acquisition unit 104 in association with an imaging area ID that identifies the imaging area information. The imaging area information storage unit 108 can also store the imaging area information in association with the date and time when the imaging area information was acquired (acquisition date and time). That is, the imaging area information storage unit 108 can also store past imaging area information.

In this case, the image analysis unit 106 can analyze the image of the imaging region at the time when the imaging unit 100 captures the image of the imaging region in the imaging preparation state, and/or the image of the imaging region at a time before that time. As a result, for example, the image analysis unit 106 acquires information indicating what is captured in the imaging area (for example, landscapes, backgrounds, and information regarding changes, information regarding the movements and facial expressions of the person included in the imaging area, and their changes, and/or information regarding the type of stuffed toy that is different from the subject stuffed animal 20 included in the imaging area) as imaging area information. can. The imaging area information storage unit 108 supplies stored information to predetermined components in response to requests from other components of the information terminal 10 .

(Information terminal side transmitter/receiver 110)
The information terminal side transmitting/receiving unit 110 supplies predetermined information from a predetermined component of the information terminal 10 to the stuffed animal 20. Further, the information terminal side transmitting/receiving section 110 receives predetermined information from a predetermined component of the stuffed animal 20. Further, the information terminal side transmitting/receiving unit 110 can supply predetermined information from predetermined components of the information terminal 10 to an external server or the like, and can also receive predetermined information from an external server or the like. Note that the communication format is not particularly limited as long as it is wireless communication. For example, the information terminal side transmitting/receiving unit 110 can utilize short-range wireless communication such as Bluetooth (registered trademark). This also applies to the stuffed animal side transmitting/receiving section 202. This allows the information terminal 10 and the stuffed animal 20 to communicate wirelessly with each other.

(Instruction reception unit 112)
The instruction receiving unit 112 receives various instructions from the user. The various instructions include, for example, an instruction to capture an image of the imaging area in the imaging preparation state. In response to the received instruction, the instruction receiving unit 112 supplies the instruction to a component of the information terminal 10 that executes the instruction, and the component that receives the instruction executes an operation according to the instruction.

(Image storage unit 114)
The image storage unit 114 stores image information in association with an image ID that identifies the image. The image information includes an image of the imaging area in a shooting preparation state, a captured image captured by the imaging unit 100 in response to an imaging instruction, and/or a compositing image to be combined with the stuffed animal 20 included in the captured image (used for image compositing). (including the image member that will be displayed). Note that in this embodiment, "image", "captured image", and "composition image" include both still images and moving images. Furthermore, the still images and moving images may include accompanying audio information. The image storage unit 114 supplies stored image information to predetermined components in response to requests from other components of the information terminal 10 .

(Stuffed animal information storage section 124)
The stuffed toy information storage unit 124 stores stuffed toy information that is information about the stuffed toy in association with a stuffed toy ID that identifies the stuffed toy. The stuffed animal information includes information such as the type, name, gender, attributes, and personality of the stuffed animal. The stuffed animal information storage section 124 can store stuffed animal information about the stuffed animal 20 that the user owns and/or stuffed animal information about the stuffed animal that the user does not own. The stuffed animal information storage section 124 supplies predetermined information to predetermined components in response to actions from other components of the information terminal 10 .

(Stuffed toy information update unit 126)
The stuffed toy information update unit 126 updates the stuffed toy information stored in the stuffed toy information storage unit 124. For example, when the instruction receiving unit 112 receives a predetermined instruction from the user, the stuffed toy information updating unit 126 can update the stuffed toy information.

(Friend information storage unit 128)
The friend information storage unit 128 stores a friend stuffed toy ID that identifies another stuffed toy (second stuffed toy) as a friend of the stuffed toy (first stuffed toy) identified by the stuffed toy ID in association with the stuffed toy ID, and a first stuffed toy ID. Information indicating the relationship between the stuffed animal and the second stuffed animal (for example, information indicating the number of times they have been photographed together in the same captured image, and information on the degree of intimacy calculated based on the information indicating the number of times, etc.) ) is stored. The friend information storage unit 128 supplies friend-related information to predetermined components in response to actions from other components of the information terminal 10.

(Image processing control unit 116, image processing unit 118)
The image processing control section 116 controls the operation of the image processing section 118. The image processing control unit 116 determines whether to synthesize a predetermined image at the display position of the stuffed animal 20 displayed on the display unit 130 based on information such as the imaging area information and/or the remaining battery level of the stuffed animal 20. do. If the image processing control unit 116 determines that the images should be combined, it causes the image processing unit 118 to perform the image combination. In addition to image compositing processing, the image processing unit 118 can also perform processing such as image conversion and transformation of captured images, and information extraction such as feature amounts from captured images.

The image processing unit 118 is controlled by the image processing control unit 116 and generates a composite image by combining a predetermined image at a display position of the display unit 130 of the stuffed animal 20 included in the imaging area. The image processing unit 118 then displays the composite image on the display unit 130. The image processing unit 118 can also store the composite image in the image storage unit 114 in association with a composite image ID that identifies the composite image. Note that the image processing unit 118 can generate a composite image using the composite images stored in the image storage unit 114.

(Additional information generation unit 120)
The additional information generation unit 120 generates additional information corresponding to the captured image captured by the imaging unit 100, that is, what kind of behavior the object and/or the stuffed animal 20 included in the captured image are doing, or what state they are in. Additional information indicating whether or not there is an image is generated based on the imaging area information. The additional information generation unit 120 generates the imaging area information acquired by the imaging area information acquisition unit 104, the imaging area information stored in the imaging area information storage unit 108, and/or the captured image stored in the image storage unit 114. Additional information is generated based on the imaging area information at the time the image was captured. The additional information is text information, graphic information, etc. that indicates what kind of behavior or motion the object and/or stuffed toy 20 included in the imaging area is doing, or what kind of state it is in. For example, the additional information is text information such as dialogue, explanatory text, etc. that is generated based on the relationship between the object included in the imaging area and the stuffed animal 20, the combination of the object and the stuffed animal 20, and the like.

The additional information generation unit 120 may be configured to generate information from, for example, a text information storage unit that stores text information such as a predetermined explanatory text or lines for each type of object or stuffed animal in association with imaging area information, and/or an external server. It can include a text information acquisition unit that acquires text information. Based on the imaging area information, the additional information generating unit 120 determines the type and motion of the object included in the imaging area, the type of the stuffed toy 20, and/or if a stuffed toy different from the stuffed animal 20 is included in the imaging area, the corresponding Text information corresponding to the type of stuffed animal, etc. is obtained from the text information storage unit, or obtained from an external server, and the obtained text information is used, or processed text is obtained by processing the obtained text information based on the imaging area information. The information can be used to generate additional information.

Additionally, the additional information generation unit 120 may generate additional information by using a Conditional Variational Auto-encoder (CVAE). Furthermore, the additional information generation unit 120 may generate text information as additional information using neural image footnotation, which is a combination of a Convolutional Neural Network (CNN) that performs image recognition and a recurrent neural network.

Further, the additional information may be information indicating the position of the imaging area included in the imaging area information, that is, text information suitable for the region or place where the image was taken. Furthermore, the additional information includes objects that appear together with the stuffed animal 20 (persons, other stuffed animals that can communicate with the information terminal 10, stuffed animals that cannot communicate with the information terminal 10, products, etc.) and backgrounds (scenery of tourist spots, scenic spots, etc.). , movie screen, etc.), text information suitable for the object, background, etc. may be used. For example, if the imaging area information includes information indicating the location where the image was captured, the additional information may include text information indicating that the image has been reached (for example, "I've come to ○○!") ○ may be text information such as the name of a place or the name of a landmark), and if the imaging area information includes information indicating the name of a predetermined product in the imaging area, the additional information may be text related to the product. The information may be information (for example, text information such as "I got XXX!" (where XXX is the product name)).

Further, the additional information may be text information corresponding to the weather, temperature, and/or humidity of the imaging area. The additional information includes text information ( (first text information). For example, the additional information generation unit 120 may generate text information with a special expression on the assumption that as the number of times the stuffed animal 20 visits a location in a certain imaging area increases, the awareness of the location by the stuffed animal 20 improves ( In other words, he sees stuffed animal 20 as anthropomorphic.) Further, as the number of times that other stuffed animals are photographed together with the stuffed animal 20 increases, the friendliness of the stuffed animal 20 with respect to the other stuffed animal has improved, and the additional information generation unit generates text information with a special expression (second text information). 120 may be generated. Note that the additional information generation unit 120 generates the first text based on the past imaging area information stored in the imaging area information storage unit 108 and/or the past captured image stored in the image storage unit 114. information and second textual information can be generated.

Further, when the imaging area information indicates that the imaging area includes a plurality of stuffed animals, the additional information generation unit 120 can generate text information according to the combination of stuffed animals. In this case, the imaging area information acquisition unit 104 identifies the types of the plurality of stuffed animals included in the imaging area based on the image analysis result of the image analysis unit 106 and the stuffed animal information stored in the stuffed animal information storage unit 124. and identify the combination of stuffed animals. The additional information generation unit 120 then generates text information based on the specified combination of stuffed animals. Further, the additional information generation unit 120 determines that while the stuffed toy 20 is included in the imaging area, the imaging area information includes information indicating that there is another stuffed animal near the information terminal 10 that is not included in the imaging area. If so, special text information (for example, text information such as "I want to take a picture with this other stuffed animal next time") can also be generated.

Furthermore, each of the stuffed animal 20 and other stuffed animals may be associated with unique characteristics (such as gender and personality) (this unique characteristic is stored as stuffed animal information in the stuffed animal information storage section 124). ). The additional information generation unit 120 may acquire information indicating the unique characteristics of the stuffed animal 20 included in the imaging area information from the stuffed animal information storage unit 124, and generate text information based on the acquired information. For example, the additional information generating unit 120 generates text information by changing the ending of the text to be generated, depending on whether the stuffed animal 20 has a "docile" or "mischievous" personality. In addition, if the imaging area includes multiple stuffed animals, and/or if the imaging area and the vicinity of the information terminal 10 each contain stuffed animals, text information corresponding to the degree of intimacy between the stuffed animals is added to the additional information. The generation unit 120 may generate the information. The degree of intimacy between the stuffed animals is stored, for example, in the friend information storage unit 128 as friend-related information.

Further, the additional information generation unit 120 can also generate a plurality of pieces of text information based on information indicating the unique characteristics of the stuffed animal 20 included in the imaging area. Then, when the instruction receiving unit 112 receives a selection instruction from the user, the additional information generating unit 120 determines the text information selected by the user as additional information. Additionally, in this case, the additional information generation unit 120 acts on the stuffed toy information updating unit 126 to cause the stuffed toy information storage unit 124 to associate the characteristic corresponding to the text information selected by the user with the stuffed toy 20 as a new characteristic. The stored stuffed animal information may also be updated. For example, based on information indicating a unique characteristic of the stuffed animal 20 included in the imaging area, the additional information generation unit 120 generates one or more pieces of text information corresponding to other characteristics in addition to text information corresponding to the characteristic. generate. Then, if the text information selected by the user from the plurality of text information is text information corresponding to another characteristic different from the text information corresponding to the characteristic, the additional information generation unit 120 causes the stuffed toy information update unit 126 to The characteristics of the stuffed toy included in the stuffed toy information stored in the stuffed toy information storage section 124 are updated to other characteristics. Thereby, the characteristics of the stuffed toy 20 can be changed to those desired by the user.

(Supply section 122)
The supply unit 122 supplies the captured image and additional information corresponding to the captured image to a predetermined server (for example, a server of a social network service (SNS)). The supply unit 122 supplies the captured image captured by the imaging unit 100 and additional information to a predetermined server when the instruction receiving unit 112 receives an instruction to post to SNS from the user. As a result, a captured image in which the stuffed animal 20 is the main character is uploaded to a predetermined server along with additional information.

[Details of the configuration of the photographing system 5: Configuration of the stuffed animal 20]
(Component member 200)
The stuffed toy 20 includes at least one component 200. As an example, the stuffed toy 20 includes a head component 200a, a body component 200b connected to the head, an ear component 200c and a component 200d provided on the head, and a body component 200c and a component 200d provided on the body, as shown in FIG. The body includes arm component members 200e and 200f, and leg component members 200g and 200h, which are provided near the side opposite to the connection side of the body to the head. Note that each component of the stuffed animal 20 may have one or more drive parts inside. For example, a plurality of drive parts and each drive part are connected at predetermined intervals along the longitudinal direction of the component corresponding to the arm part and the component corresponding to the ear of the stuffed toy 20 having a predetermined length. It is also possible to provide a connecting member so that the arms and ears can be bent. Further, the shape of the stuffed toy 20 and the constituent members constituting the stuffed toy 20 are not limited to the example shown in FIG. 4 . As the shape of the stuffed toy 20, various animal shapes, various character shapes, etc. can be adopted. The shape and number of the constituent members constituting the stuffed toy 20 can also be determined as appropriate depending on the shape and/or function of the stuffed toy 20 as a whole. However, the stuffed animal 20 is configured without an imaging unit such as a camera.

One component and another component adjacent to the one component can be connected via a drive section. For example, in the example of FIG. 4, the component 200a and the component 200b are connected via the drive unit 208a, and the head component 200a is configured to move relative to the body component 200b. Further, the component 200b and the component 200e of the right arm are connected via the drive section 208b, the component 200b and the component 200f of the left arm are connected via the drive section 208c, and the component 200f is connected via the drive section 208d. 200a and the right ear component 200c are connected, the component 200a and the left ear component 200d are connected via the drive section 208e, and the component 200b and the right leg component 200g are connected via the drive section 208i. The component 200b and the left leg component 200h are connected via the drive unit 208j. The limbs and both ears of the stuffed animal 20 are also configured to move in the same manner as the head relative to the body.

Further, a driving unit 208f is connected to one eye of the stuffed animal 20, and a driving unit 208g is connected to the other eye. The drive unit 208f and/or the drive unit 208g are configured to open and close the eyes or blink. Furthermore, the drive unit 208h provided at the mouth portion of the stuffed toy 20 is configured to operate to change the shape of the mouth.

(Stuffed toy side transmitter/receiver 202)
The stuffed toy side transmitting/receiving unit 202 receives predetermined information such as imaging area information from the information terminal 10 and supplies the received predetermined information to a predetermined component of the stuffed toy 20 . Further, the stuffed toy side transmitting/receiving unit 202 supplies predetermined information from a predetermined component of the stuffed toy 20, such as information regarding the remaining battery level, to a predetermined component of the information terminal 10.

(Operation information storage unit 204)
The operation information storage unit 204 stores remaining amount information of the battery 220, imaging area information, and/or operation information. The motion information storage unit 204 may store this information in association with a stuffed toy ID that identifies the stuffed toy 20. The operation information is information that defines the operation of one or more drive units 208 and/or constituent members such as the speaker 214 of the stuffed toy 20, and is information such as scenario information and audio information of the operation. The motion information storage section 204 supplies predetermined motion information to the drive control section 206 in response to the action of the drive control section 206 . Note that the information terminal 10 may include the operation information storage section 204. In this case, the information terminal 10 supplies operation information to the drive control unit 206. Alternatively, the information terminal 10 may include a motion information generation unit that generates motion information based on the imaging area information. The motion information generation section supplies the generated motion information to the motion information storage section 204 (in this case, the motion information storage section 204 is included in the information terminal 10 or the stuffed toy 20).

(Drive control section 206, drive section 208)
The drive unit 208 operates the components. The drive unit 208 is composed of, for example, an RC servo motor, a DC motor, and/or a potentiometer. The drive control unit 206 then controls the operation of the drive unit 208 based on the imaging area information. For example, the drive control unit 206 operates the drive unit 208 using the operation information stored in the operation information storage unit 204 in association with the imaging area information received from the information terminal 10. Note that the drive control unit 206 controls the position of the imaging area included in the imaging area information, objects and other stuffed animals included in the imaging area together with the stuffed animal 20, the background of the imaging area, the weather and humidity at the time of imaging the imaging area, and the imaging area. Predetermined changes may be made to the motion information depending on the relationship between the stuffed animal 20 and other stuffed animals that are photographed together with the stuffed animal 20 (for example, degree of familiarity, etc.).

(sensor 210, microphone 212, speaker 214)
The sensor 210 detects the user's contact with the stuffed animal 20, the movement of the stuffed animal 20, and the like. For example, sensor 210 is an acceleration sensor, a capacitive touch sensor, or the like. Furthermore, the microphone 212 acquires sounds around the stuffed animal 20. Furthermore, the speaker 214 outputs various sounds from the stuffed animal 20. For example, the drive control unit 206 may control the operation of the drive unit 208 based on information such as information indicating that the user has touched the stuffed animal 20 detected by the sensor 210 and/or information such as voice detected by the microphone 212. good. In this case, the motion information storage unit 204 stores motion information in association with information indicating contact and information such as sound, and the drive control unit 206 stores motion information in association with information indicating contact and sound information. The driving unit 208 may be operated based on the above.

(Battery 220, remaining battery level confirmation unit 222, charge/discharge control unit 224)
The battery 220 supplies the drive unit 208 with at least power to operate the drive unit 208. The battery 220 supplies power to components that require power among the components that make up the stuffed animal 20. Then, the battery remaining amount confirmation unit 222 monitors the battery 220 and confirms the remaining amount of the battery 220. The battery remaining amount confirmation unit 222 supplies information indicating the remaining battery amount to the information terminal 10 and/or the drive control unit 206. Further, the charge/discharge control unit 224 controls charging and discharging of the battery 220.

When the drive control unit 206 receives information regarding the remaining battery level from the remaining battery level confirmation unit 222, it controls the operation of the drive unit 208 based on the remaining battery level. For example, if the remaining battery level is below a predetermined value and exceeds a predetermined threshold, the drive control unit 206 causes the stuffed animal 20 to perform an operation that gives the impression that it is sleepy or hungry. Control the drive unit 208 as the stuffed animal 20 does. For example, the drive control unit 206 operates the drive unit for the eyes of the stuffed toy 20 to make the stuffed toy 20 close its eyes, or operates the drive unit for the ears, depending on the remaining battery level. It is possible to perform the action of lowering the ears in stages.

Further, the drive control unit 206 receives information regarding the remaining battery level from the remaining battery level confirmation unit 222, and when the remaining battery capacity is below a predetermined threshold, sets the drive unit 208 to a predetermined state, In this state, the drive unit 208 is stopped. That is, if the remaining battery power is insufficient to operate the drive unit 208 sufficiently, the posture and expression of the stuffed animal 20 may not be suitable for sewing. Therefore, when the remaining battery level falls below a predetermined threshold, the drive control unit 206 controls the operation of the drive unit 208 to change the posture of the stuffed toy 20 so that an image that is not inappropriate for sewing can be captured. After the stuffed animal 20 is set in a posture and expression appropriate for sewing, the operation of the stuffed animal 20 (that is, the operation of the drive unit 208) is stopped. As a result, even if the remaining battery power is too low to operate the drive unit 208, the posture and expression of the stuffed toy 20 suitable for sewing can be maintained. Note that when the battery 220 is charged again and the remaining battery power exceeds a predetermined threshold or exceeds a predetermined value, the drive control unit 206 can restart the operation of the drive unit 208.

[Processing flow of photographing system 5]
FIG. 6 shows an example of the flow of processing in the imaging system according to this embodiment.

First, with the stuffed toy 20 in the imaging area of the imaging unit 100, the imaging control unit 102 sets the imaging unit 100 in a shooting preparation state, either in response to an instruction from the user accepted by the instruction receiving unit 112 or automatically. (Step 10. Hereinafter, step will be referred to as "S"). Then, the imaging area information acquisition unit 104 acquires imaging area information of the imaging area based on the image being captured by the imaging unit 100 or the captured image that has been captured (S12). The imaging area information acquisition unit 104 uses the GPS function, clock function, etc., image recognition of the imaging area, and/or image analysis to determine whether or not there is an object in the imaging area, and if an object is included, the type of the object (e.g. , type indicating whether it is a person or an article, etc.), the movement or state of the object, the background of the imaging area, the location of the imaging area, the date and time when the shooting preparation state started, and/or the temperature or weather of the imaging area, etc. information is acquired as imaging area information.

Then, the information terminal side transmitting/receiving unit 110 transmits the imaging area information acquired by the imaging area information acquiring unit 104 to the stuffed animal side transmitting/receiving unit 202 (S14). Note that the information terminal side transmitting/receiving unit 110 may transmit past imaging area information. When the stuffed toy side transmitting/receiving unit 202 receives the imaging area information, the stuffed toy side transmitting/receiving unit 202 supplies the imaging area information to the drive control unit 206 and causes the battery remaining amount checking unit 222 to check the remaining amount of the battery 220. Then, the battery remaining amount checking unit 222 checks the remaining amount of the battery 220 (S16). When the battery remaining amount confirmation unit 222 confirms that the remaining amount of the battery 220 exceeds a predetermined value (“exceeds the predetermined value” in S16), the drive control unit 206 controls the predetermined drive unit based on the imaging area information. 208 is controlled (S18). Specifically, the drive control section 206 acquires the motion information stored in the motion information storage section 204 in association with the imaging area information, and operates the drive section 208 based on the acquired motion information.

For example, in the motion information storage unit 204, a person is included in the imaging area, and the stuffed toy 20 is associated with imaging area information indicating that the person has performed a predetermined action. It is possible to store the operation information shown. As an example, if the received imaging area information includes information indicating that a person is included in the imaging area together with the stuffed animal 20 and that the person is raising his or her right hand, the drive control unit 206 may Based on the motion information stored in the motion information storage section 204 in association with the imaging area information, a drive section 208 connecting the body of the stuffed toy 20 and the right hand is operated to cause the stuffed toy 20 to perform a motion of raising its right hand.

Note that the information terminal 10 may have a motion information storage section 204 or a motion information generation section that generates motion information based on the imaging area information, and in this case, the motion information from the information terminal 10 may be transferred to the The drive control unit 206 can operate the drive unit 208 according to the received operation information. However, in this embodiment, an example in which the stuffed animal 20 includes the motion information storage section 204 will be described.

Further, when the remaining battery level confirmation unit 222 confirms that the remaining battery capacity exceeds a predetermined threshold value and is below a predetermined value (“exceeds a threshold value and below a predetermined value” in S16), the drive control unit 206 controls the drive unit 208 to execute a predetermined operation (S20). That is, the drive control unit 206 causes the stuffed animal 20 to perform an operation that allows the user to understand that the remaining battery power is decreasing. For example, when the remaining battery level exceeds a predetermined threshold, the remaining battery level confirmation unit 222 divides the range from the threshold to the predetermined value into multiple zones (predetermined value>threshold), and Check if it belongs to a zone. Then, the drive control unit 206 causes a predetermined drive unit 208 to perform a predetermined operation each time the remaining battery power decreases and the zone moves from a zone with a high remaining battery power to a zone with a low remaining battery power. As an example, the drive control unit 206 operates the drive units 208d and 208e of the ear component 200c and the component 200d connected to the head of the stuffed toy 20, and moves from a zone with a high battery level to a zone with a low battery level. Have the ears lower each time the child moves. Further, the drive control unit 206 may operate the drive unit 208f and the drive unit 208g of the eyes of the stuffed animal 20 so that the eyes gradually close each time the remaining battery power moves from a zone with a high level to a zone with a low battery level. . In this case, the drive control unit 206 operates, for example, a drive unit 208a provided between the head and the body to cause the stuffed animal 20 to behave as if it were sleeping (for example, to row a boat). It's okay.

Further, the drive control unit 206 may change the operating speed of the drive unit 208 depending on the remaining battery level. For example, the drive control unit 206 may increase the operating speed of the drive unit 208 as the remaining battery level increases (in proportion to the remaining battery level). Alternatively, the drive control unit 206 may increase the operating speed of the drive unit 208 as the remaining battery level decreases (in inverse proportion to the remaining battery level). Thereby, the behavior of the stuffed animal 20 can be changed depending on the remaining battery level.

Furthermore, when the remaining battery level confirmation unit 222 confirms that the remaining battery level is below a predetermined threshold (“below the threshold” in S16), the drive control unit 206 puts the drive unit 208 in a specific state and then The operation of the drive unit 208 is stopped (S22). That is, the drive control unit 206 stops the operation of the drive unit 208 after changing the attitude and expression of the stuffed toy 20 to a predetermined attitude and expression before the remaining battery level makes it impossible to operate the drive unit 208. And maintain this posture and expression. Even if the remaining battery power remains, if the remaining battery power is below a predetermined threshold, the drive control unit 206 stops the operation of the drive unit 208 until the remaining battery power is recovered by charging. Thereby, the stuffed animal 20 can be made to take a posture that is only taken when the battery runs out or an expression that is not shown. That is, by executing the above process when the remaining battery power is insufficient for the operation of the drive unit 208, it is possible to maintain the posture and expression of the stuffed animal 20 that the user thinks is cute even when taking a picture during sewing (that is, In order to prevent the operation of the stuffed animal 20 from stopping due to a posture or facial expression unsuitable for imaging, the operation of the drive unit can be stopped before the remaining battery level reaches a point where the drive unit cannot be driven. It should be noted that from the viewpoint of ensuring that enough power remains in the battery 220 to enable communication between the information terminal 10 and the stuffed animal 20, and the extent to which the driving unit 208 is operated to make the posture and expression of the stuffed animal 20 a predetermined posture and expression. The above-mentioned threshold value of the remaining battery power is determined from the viewpoint of keeping the power remaining.

Subsequently, when the instruction receiving unit 112 receives an imaging instruction from the user, the imaging control unit 102 causes the imaging unit 100 to perform imaging (S24). The captured image captured by the imaging unit 100 is supplied to the image storage unit 114 and/or the display unit 130.

Then, the image processing control unit 116 determines whether to perform image processing on the captured image captured by the imaging unit 100, based on the imaging area information and/or the information indicating the remaining battery power (S26). Specifically, the image processing control unit 116 refers to the imaging area information, and determines whether the operational information is not stored in the operational information storage unit 204 in association with the imaging area information or even if the operational information is stored. When the stuffed animal 20 is unable to complete the action depending on the action information (for example, when the imaging area information includes information indicating the action or posture of the person included in the imaging area, but the stuffed animal 20 is unable to follow the action or attitude) etc., it is determined that image processing is to be performed on the image (Yes in S26).

When the image processing control unit 116 determines to perform image processing on the image, the image processing unit 118 performs image processing on the captured image captured by the imaging unit 100 (S28). For example, in a case where the imaging area information includes information indicating the posture of a person included in the imaging area, and the motion information is content that instructs the drive unit to follow the posture, the structure of the stuffed toy 20 If the stuffed toy 20 cannot take the position (for example, if the person is sitting straight and the stuffed toy 20 cannot take the sitting position), the image processing unit 118 uses the captured image captured by the imaging unit 100. An image of the stuffed animal in a sitting position is synthesized at the position where the stuffed animal 20 is displayed (that is, the position of the stuffed animal 20 displayed on the display unit 130). In this case, an image of the stuffed animal 20 in a sitting position (an image for synthesis) is stored in the image storage unit 114, and the image processing unit 118 uses the image in the image storage unit 114 to perform image processing (for example, image synthesis). process). The captured image subjected to image processing is then displayed on the display unit 130. Note that a captured image that has been subjected to image processing can also be stored in the image storage unit 114.

Further, the image processing control unit 116 may refer to the imaging area information and determine whether or not to perform image processing depending on the situation of the imaging area. The situation of the imaging area is, for example, the date and time of the imaging area, the location, the weather, etc. For example, if the location of the imaging area is a predetermined location (for example, a tourist spot, recreational area, scenic spot, etc.), the image processing control unit 116 may execute image processing on part or all of the captured image. You may decide.

FIG. 7 shows an example of image processing by the image processing unit according to this embodiment.

For example, a case will be described in which the stuffed toy 20 is imaged with a five-storied pagoda in the ancient capital of Japan as a background. In this case, the imaging area information acquisition unit 104 acquires information indicating that the location of the imaging area is a predetermined location in Japan and that a traditional Japanese building is included in the background. Then, the image processing control unit 116 decides to perform image processing on a part of the captured image based on this information. For example, the image processing control unit 116 causes the image processing unit 118 to combine an image suitable for the location of the imaging area with the display position of the stuffed animal 20 included in the imaging area on the display unit 130. As an example, an image of the stuffed animal 20 wearing a kimono and sitting straight is synthesized. As a result, as shown in FIG. 7, a composite image 22 showing the stuffed animal 20 wearing a kimono and sitting upright is displayed on the display unit 130 with a five-storied pagoda or the like in the background. In this way, through the image processing by the image processing unit 118, a composite image of the stuffed toy 20 with its posture changed depending on the location of the imaging area, or a composite image of the stuffed toy 20 dressed up can be displayed on the display unit 130. .

Note that the image processing unit 118 may display the captured image of the stuffed animal 20 at the display position of the stuffed animal 20 on the display unit 130, and may also combine an image with a part of the captured image. For example, a captured image of the head of the stuffed toy 20 may be displayed, and a composition image may be combined with other parts other than the head. As a result, even if the imaging area information includes information indicating a posture or motion that the stuffed toy 20 cannot follow (in other words, information indicating a posture or motion that cannot be achieved even by operating each drive unit of the stuffed toy 20), (even if the user is using the camera), a composition image showing the posture or motion can be composited with the captured image.

Note that the image processing unit 118 processes the position of the imaging area included in the imaging area information, objects and other stuffed animals included in the imaging area together with the stuffed animal 20, the background of the imaging area, the weather, temperature, and humidity at the time of imaging the imaging area, A predetermined change may be made to the image to be synthesized depending on the relationship (for example, intimacy, etc.) between the stuffed animal 20 and other stuffed animals that are photographed together with the stuffed animal 20 in the imaging area.

The image processing control unit 116 can also refer to the confirmation result of the remaining battery capacity confirmation unit 222 and determine that image processing should be performed on the image if the remaining battery capacity is less than or equal to a predetermined threshold (Yes in S26). ). For example, when the remaining battery level is less than or equal to a predetermined threshold, the image processing control unit 116 sends the image processing unit 118 an image of the stuffed toy 20 sleeping at the display position of the stuffed toy 20 included in the imaging area on the display unit 130; An image in which the eyes of eye 20 are rolling, an image in which a predetermined figure or symbol is displayed around the stuffed toy 20 (for example, an image in which a figure such as an exclamation mark is displayed around the face of the stuffed toy 20), or a stuffed toy. An image, etc. in which 20 is hidden behind a predetermined object is synthesized.

In this way, when the information terminal 10 takes an image, it is possible to create a composite image indicating that the battery level of the stuffed animal 20 is low, or to make the stuffed animal 20 perform a predetermined action, so that the remaining battery level of the stuffed animal 20 can be displayed at the time of image capturing. It is possible to make the user aware of this. As a result, when actually capturing an image of an imaging area including the stuffed animal 20, it is possible to suppress the inability to capture an appropriate image due to the lack of remaining battery power of the stuffed animal 20.

Note that the image for synthesis used by the image processing unit 118 to synthesize images may be stored in the image storage unit 114, or may be an image for synthesis obtained from an external server. Furthermore, the composition image may be a composition image that can be obtained from a predetermined server that stores composition images specific to the location where the images are captured.

On the other hand, if the image processing control unit 116 determines not to perform image processing (No in S26), the captured image is displayed on the display unit 130. Note that the captured image can also be stored in the image storage unit 114.

[Modified example of processing flow of imaging system 5]
FIG. 8 shows an example of a modification of the processing flow in the imaging system according to the present embodiment. Moreover, FIG. 9 shows an example of creation of additional information according to this embodiment. In the example of FIG. 8, substantially the same processing as the example of FIG. 6 is executed, except that the step of S32 is executed between S24 and S30. Therefore, detailed explanation will be omitted except for the differences.

In the example of FIG. 8, additional information is generated for the captured image (S32). That is, first, based on the imaging area information (including information indicating the result of analysis of the captured image by the image analysis unit 106) acquired by the imaging area information acquisition unit 104, the stuffed toy 20, object, background, etc. included in the captured image are is specified. Then, the additional information generation unit 120 generates additional information suitable for the captured image based on the identification result.

As an example, a case where the imaging unit 100 captures an image of an imaging area as shown in FIG. 9 will be described. Note that the image may be either a captured image captured by the imaging unit 100 in response to an imaging instruction, or an image captured by the imaging unit 100 in a state of preparation for capturing. In this case, the additional information generation unit 120 generates additional information based on the imaging area information acquired by the imaging area information acquisition unit 104 regarding the image of the imaging area. For example, in FIG. 9, the imaging area includes the stuffed animal 20 and another stuffed animal 24 (a stuffed bird), ice cream is included in front of the stuffed animal 20 and the stuffed animal 24, and the size of the ice cream is the same as that of the stuffed animal 20 and the stuffed animal 24. Imaging area information indicating that the area is larger than the mouth of the stuffed animal 24 is generated.

In this case, the additional information generation unit 120 generates text information according to the situation of the imaging area. In the example of FIG. 9, the additional information generation unit 120 generates text information 26 as additional information such as "Ice cream looks delicious!" and "Is it too big for us?!". Note that the additional information generation unit 120 may generate audio information, symbol information, etc. as additional information depending on the situation of the imaging area. Then, the additional information generation unit 120 associates the generated additional information with the captured image. In this case, the image storage unit 114 may also store additional information generated by the additional information generation unit 120 in association with the stored captured image.

Then, the additional information generating section 120 displays the generated additional information together with the captured image on the display section 130 (S30). Further, in this case, the instruction receiving unit 112 can receive an instruction from a user to post the captured image and additional information on a predetermined SNS. When the instruction receiving unit 112 receives the instruction, the supply unit 122 posts the captured image and additional information to a predetermined server (posting process: S34). Note that the instruction receiving unit 112 may display a “posting button” at a predetermined position on the display unit 130, and execute the posting process when the user taps this posting button. Thereby, when a user captures an image including the stuffed toy 20, the user can easily and quickly post the captured image to SNS along with additional information according to the capturing situation.

[Effects of embodiment]
The photographing system 5 according to the present embodiment can change the pose and expression of the stuffed toy 20 according to the photographing situation, so it is possible to capture a captured image with high added value. That is, since the pose and expression of the stuffed toy 20 can be changed according to the surrounding situation of the stuffed toy 20, it is possible to increase the lovability of the stuffed toy 20 and/or to make the stuffed toy 20, which the user becomes attached to, become the main character. You can take images with the same composition.

Furthermore, when capturing an image, the imaging system 5 acquires imaging area information of the imaging area in the imaging preparation state, and operates each drive unit of the stuffed animal 20 based on this imaging area information to adjust the situation at the time of imaging. A captured image of the stuffed animal 20 that moves accordingly can be obtained. As a result, it is possible to provide a captured image for stuffing photography with higher added value than in the past, and also to provide a stuffed animal 20 with high pettiness. Furthermore, the photographing system 5 causes the stuffed animal 20 to perform a predetermined action and/or performs a further action after the predetermined action in response to a change in the remaining battery power of the stuffed animal 20 that is taken with the person when going out. Since it can be stopped, it is possible to capture an image appropriate for the remaining battery level.

Furthermore, even if the added value of the captured image itself is not high, the imaging system 5 can associate additional information with the captured image, so for example, when sharing the captured image on SNS, the captured image and the additional information can be can improve added value. Additionally, since additional information can be linked to the captured image, both types of information can be easily and conveniently uploaded to SNS.

[Other embodiments]
FIG. 10 shows an example of a processing flow of a photographing system according to another embodiment. Note that steps S40, S42, S44, and S46 in FIG. 10 are substantially the same as steps S10, S12, S24, and S32 in FIG. 6, respectively, so detailed explanation will be omitted except for the differences.

First, with the stuffed toy 20 in the imaging area of the imaging unit 100, the imaging control unit 102 puts the imaging unit 100 into a shooting preparation state (S40). Then, the imaging area information acquisition unit 104 acquires imaging area information of the imaging area (S42). Subsequently, when the instruction receiving unit 112 receives an imaging instruction from the user, the imaging control unit 102 causes the imaging unit 100 to perform imaging (S44). Furthermore, the additional information generation unit 120 generates additional information based on the imaging area information acquired by the imaging area information acquisition unit 104 (S46). The additional information generation unit 120 stores the captured image and additional information corresponding to the captured image in the image storage unit 114. Subsequently, when the instruction receiving unit 112 receives an instruction from the user to post the captured image and additional information to a predetermined server, the supply unit 122 sends the captured image and additional information corresponding to the captured image to the predetermined server. Send (S48). The predetermined server is, for example, an SNS server, and when the supply unit 122 transmits the captured image and additional information to the server, the captured image and additional information are posted on the SNS. Note that after the process of S46, the display unit 130 can display additional information together with the captured image.

[Shooting program]
Each component included in the photographing system 5 according to the present embodiment shown in FIGS. 1 to 10 causes a processing unit such as a central processing unit (CPU) to execute a program (that is, a photographing program). In other words, it can be realized through software processing. Further, it can also be realized by writing a program in advance to hardware as an electronic component such as an integrated circuit (IC). Note that software and hardware can also be used together.

The photographing program according to this embodiment can be pre-installed in, for example, an IC or a ROM. Furthermore, the photography program must be an installable or executable file, recorded on a computer-readable recording medium such as a magnetic recording medium, an optical recording medium, or a semiconductor recording medium, and provided as a computer program. You can also do it. The recording medium storing the program may be a non-transitory recording medium such as a CD-ROM or a DVD. Furthermore, the photographing program can be stored in advance in a computer connected to a communication network such as the Internet, so that it can be provided by downloading via the communication network.

The photographing program according to the present embodiment operates on the CPU and the like, and executes the photographing program using the imaging unit 100, the imaging control unit 102, the imaging area information acquisition unit 104, the image analysis unit 106, and the imaging area described in FIGS. 1 to 10. Information storage unit 108, information terminal side transmission/reception unit 110, instruction reception unit 112, image storage unit 114, image processing control unit 116, image processing unit 118, additional information generation unit 120, supply unit 122, stuffed toy information storage unit 124, stuffed toy It functions as an information update section 126, a friend information storage section 128, a display section 130, a stuffed toy side transmission/reception section 202, an operation information storage section 204, a drive control section 206, a remaining battery level confirmation section 222, and a charge/discharge control section 224.

Although the embodiments of the present invention have been described above, the embodiments described above do not limit the invention according to the claims. Furthermore, it should be noted that not all combinations of features described in the embodiments are essential for solving the problems of the invention. Further, the technical elements of the embodiments described above may be applied singly or may be divided into a plurality of parts such as program parts and hardware parts.

Note that the photographing system according to the present embodiment can also be referred to in the following additional notes that should not be confused with the claims.
(Additional note 1)
A photographing system comprising an information terminal and a stuffed animal that can operate based on predetermined information supplied from the information terminal,
The information terminal is
an imaging unit that images an imaging area that includes the stuffed animal;
an imaging area information acquisition unit that acquires imaging area information that is information regarding the imaging area;
An imaging system comprising: an additional information generating section that generates additional information corresponding to a captured image captured by the imaging section based on the imaging area information.

1 Object 5 Photographing system 10 Information terminal 20, 24 Stuffed animal 22 Composite image 26 Text information 100 Imaging unit 102 Imaging control unit 104 Imaging area information acquisition unit 106 Image analysis unit 108 Imaging area information storage unit 110 Information terminal side transmission/reception unit 112 Instruction reception Section 114 Image storage section 116 Image processing control section 118 Image processing section 120 Additional information generation section 122 Supply section 124 Stuffed toy information storage section 126 Stuffed toy information update section 128 Friend information storage section 130 Display section 200 Components 200a, 200b, 200c, 200d , 200e, 200f, 200g, 200h Components 202 Stuffed toy side transmission/reception section 204 Operation information storage section 206 Drive control section 208 Drive section 208a, 208b, 208c, 208d, 208e, 208f, 208g, 208h, 208i, 208j Drive section 210 Sensor 212 Microphone 214 Speaker 220 Battery 222 Remaining battery level confirmation section 224 Charge/discharge control section

Claims (13)

A photographing system comprising an information terminal having a storage section,
The information terminal is
an imaging unit that images an imaging area that includes a stuffed animal to which a stuffed animal ID has been assigned;
a display unit that displays the imaging area;
an imaging area information acquisition unit that acquires, by wireless communication, imaging area information that is information about the imaging area and includes the stuffed toy ID that is information about the stuffed toy and is stored in the storage unit;
A photographing system comprising: an image processing section that synthesizes predetermined images based on the imaging region information to generate a composite image at a display position of the display section of the stuffed toy included in the imaging region. The imaging system according to claim 1, wherein the image processing unit generates a composite image in which the state of the stuffed animal is changed based on the imaging area information. The photographing system according to claim 1 or 2, wherein the image processing section generates the composite image using a composition image to be composited with the stuffed animal included in the captured image captured by the imaging section. When the image capturing area includes the stuffed animal and another stuffed animal, the image processing unit determines the relationship between the stuffed animal and the other stuffed animal identified by the stuffed animal ID associated with each stuffed animal. The photographing system according to claim 1, wherein the composite image is generated based on the above. The photographing system according to claim 4, wherein the relationship is a degree of intimacy between the stuffed animal and the other stuffed animal. The imaging system according to claim 1, wherein the imaging area information includes stuffed toy information of the stuffed toy associated with the stuffed toy. The imaging area information is at least one selected from the group consisting of a position of the imaging area, a background of the imaging area, weather at the time of imaging the imaging area, temperature at the time of the imaging, and humidity at the time of the imaging. The photographing system according to claim 1, wherein the composite image is generated based on the composite image. The imaging system according to claim 1, wherein the imaging area information acquisition unit acquires the imaging area information in real time. The imaging system according to claim 1, wherein the imaging area information acquisition unit acquires the imaging area information by image analysis of the imaging area. A photographing method for photographing a stuffed toy using an information terminal having a storage section, the method comprising:
an imaging step of imaging an imaging area that includes a stuffed toy to which a stuffed toy ID has been assigned;
an imaging area information acquisition step of acquiring imaging area information that is information about the imaging area and includes the stuffed toy ID that is information about the stuffed toy and is stored in the storage section, by wireless communication;
An image processing step of synthesizing a predetermined image based on the imaging area information to generate a composite image at a display position of the display unit of the information terminal of the stuffed toy included in the imaging area. A photographing program for a photographing system comprising an information terminal having a storage section,
to the computer,
Imaging area information acquisition that is information about an imaging area that includes a stuffed toy to which a stuffed toy ID has been assigned, and that is information about the stuffed toy that includes the stuffed toy ID that is stored in the storage section. function and
and an image processing function for synthesizing a predetermined image based on the imaging area information to generate a composite image at a display position of the display unit of the information terminal of the stuffed toy included in the imaging area. A photographing system comprising a storage section,
an imaging unit that images an imaging area that includes a stuffed animal to which a stuffed animal ID has been assigned;
a display unit that displays the imaging area;
an imaging area information acquisition unit that acquires imaging area information, which is information regarding the imaging area and includes the stuffed toy ID stored in the storage unit, through wireless communication;
A photographing system comprising: an image processing unit that synthesizes a predetermined image based on the stuffed toy ID at a display position of the display unit of the stuffed toy included in the imaging area. A photographing system comprising a storage section,
an imaging unit that images an imaging area that includes a stuffed animal to which a stuffed animal ID has been assigned;
a display unit that displays the imaging area;
an imaging area information acquisition unit that acquires imaging area information, which is information regarding the imaging area and includes the stuffed toy ID stored in the storage unit, through wireless communication;
A photographing system comprising: an image processing section that synthesizes a predetermined image at a display position of the display section of the stuffed toy included in the imaging area based on stuffed toy information associated with the stuffed toy ID.

Images