JP2024074318A - Program, method, information processing device, and system - Google Patents

Abstract

To improve the user experience when taking stuffed animal photos.
[Solution] A program is provided that causes a computer equipped with a processor to execute the following steps: receiving identification information that identifies each of a number of stuffed animals (excluding those having a driving part for operating the components) that have approximately identical appearances; acquiring image data of the stuffed animals captured by a user; generating image data in which the appearance of the stuffed animals in the image data acquired after receiving the identification information is processed in accordance with the identification information; and presenting the image data to the user.
[Selected Figure] Figure 1

Description

This disclosure relates to a program, a method, an information processing device, and a system.

Recently, the so-called "nui-dori" practice of photographing stuffed animals in various locations and situations and uploading the photographs to social media has become popular. For example, Patent Literature 1 discloses a technology for photographing a stuffed animal and controlling the stuffed animal in response to the photographed image.

JP 2021-74361 A

However, the above technology requires the stuffed animal to have a drive unit, so there is room for improvement in terms of improving the user experience when taking pictures of stuffed animals using simple stuffed animals that do not have a drive unit.

Therefore, the objective of this disclosure is to provide technology that improves the user experience when taking pictures of stuffed animals.

According to the present disclosure, a program is provided that causes a computer having a processor to execute the steps of receiving identification information that identifies each of a plurality of stuffed animals (excluding those having a drive unit for operating components) that have substantially identical appearances, acquiring image data of the stuffed animals captured by a user, generating image data in which the state of the stuffed animal in the acquired image data after receiving the identification information is processed according to the identification information, and presenting the image data to the user.

The present disclosure allows users to develop a deeper attachment to stuffed animals and improves the user experience when taking pictures of stuffed animals.

Fig. 1A is a diagram for explaining an outline of the processing of the terminal device 10. Fig. 1B is a diagram showing an example of an image displayed on the terminal device 10. FIG. 2 is a block diagram showing the hardware configuration of the terminal device 10. FIG. 2 is a block diagram showing the functional configuration of a terminal device 10. FIG. 2 is a diagram showing the structure of a database stored in a storage unit 180. 5A is a front view of an example of a stuffed animal 50. FIG. 5B is a side view of an example of the stuffed animal 50. FIG. 2 is a flow diagram illustrating an example of a processing flow of the terminal device 10. FIG. 11 is a flow diagram illustrating an example of the process flow of the effect image generation process (S300). FIG. 11 is a flow diagram illustrating an example of the process flow of an event determination process (S330). Fig. 9A is a diagram showing an example of photographing a stuffed toy 50 and food. Fig. 9B is a diagram showing an example of an image of the stuffed toy 50 and food, which is displayed on the terminal device 10. Fig. 10A is a diagram showing an example of capturing an image of the stuffed toy 50 and a thermometer. Fig. 10B is a diagram showing an example of an image of the stuffed toy 50 and a thermometer displayed on the terminal device 10. Fig. 11A is a diagram showing an example of photographing a stuffed toy 50 and a building. Fig. 11B is a diagram showing an example of an image of the stuffed toy 50 and a building displayed on the terminal device 10. Fig. 12A is a front view of a stuffed animal 50A. Fig. 12B is a front view of another stuffed animal 50B. Fig. 13A is a diagram showing an example of photographing stuffed animals 50A and 50B. Fig. 13B is a diagram showing an example of an image of stuffed animals 50A and 50B that is displayed on terminal device 10. FIG. 11 is a block diagram showing a hardware configuration of the system 1 according to the second embodiment. FIG. 11 is a block diagram showing the functional configuration of a server 20 according to a second embodiment. FIG. 11 is a flow diagram illustrating an example of a processing flow of the system 1 in the second embodiment. FIG. 13 is a block diagram showing the functional configuration of a server 20 according to a third embodiment. FIG. 13 is a diagram showing a structure of a database stored in a storage unit 220 in the third embodiment. FIG. 13 is a flow diagram illustrating an example of the processing flow of the effect image generation process (S300) in the third embodiment.

Below, an embodiment of the present disclosure will be described with reference to the drawings. In the following description, the same parts are given the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated.

<1. First embodiment>
(1-1. Overview of services provided by terminal device 10)
A function provided by the terminal device 10 (hereinafter, also referred to as this function) will be described with reference to Fig. 1. As shown in Fig. 1A, a user U can use the terminal device 10 to capture an image (including still images and videos) of a stuffed animal 50. The stuffed animal 50 is provided with identification information for identifying an individual having approximately the same appearance, and the user inputs the identification information provided to the stuffed animal 50 into the terminal device 10 before capturing an image. Note that "approximately the same appearance" means that the stuffed animals are of the same type (for example, stuffed animals sold as the same product) and have approximately the same shape and size.

The terminal device 10 generates image data by processing the captured image in accordance with the identification information of the stuffed toy 50 in the image, and displays the image data on the display. Specifically, for example, as shown in FIG. 1B, an image is generated in which the stuffed toy 50 is happily greeting the user U with its hands raised, and the image is displayed on the display.

In this way, when the terminal device 10 captures an image of the stuffed toy 50, it is possible to generate an image that has been processed for each individual stuffed toy. As a result, even in a space where multiple stuffed toys with roughly identical appearances exist, they will behave differently on the display in response to their identification information, allowing the user to feel a deeper attachment to their stuffed toy, improving the user experience when capturing images of stuffed toys (hereinafter also referred to as "stuffed toy photography"). Each component will be described in detail below.

(1-2. Hardware Configuration of Terminal Device 10)
2 is a block diagram showing an example of a hardware configuration of the terminal device 10. The terminal device 10 is realized by, for example, a tablet terminal or a mobile terminal such as a smartphone. The terminal device 10 may also be realized by a stationary personal computer (PC) or a laptop PC.

The terminal device 10 includes a communication interface (IF) 12, an input device 13, an output device 14, a memory 15, storage 16, and a processor 19.

The communication IF 12 is an interface for inputting and outputting signals so that the terminal device 10 can communicate with external devices.

The input device 13 is a device for accepting input operations from a user (e.g., a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, etc.).

The output device 14 is a device (display, speaker, etc.) for presenting information to the user.

Memory 15 is used to temporarily store programs and data processed by the programs, and is a volatile memory such as a DRAM (Dynamic Random Access Memory).

Storage 16 is used to store data, and is, for example, a flash memory or a hard disk drive (HDD).

The processor 19 is hardware for executing a set of instructions written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, etc.

(1-3. Functional configuration of terminal device 10)
Fig. 3 is a block diagram showing an example of a functional configuration of the terminal device 10. As shown in Fig. 3, the terminal device 10 includes an input device 13, an output device 14, a communication unit 150, an imaging unit 160, an audio processing unit 170, a storage unit 180, and a control unit 200. The blocks included in the terminal device 10 in Fig. 3 are electrically connected to each other by, for example, a bus or the like.

The communication unit 150 performs processes such as modulation and demodulation for the terminal device 10 to communicate with other devices. The communication unit 150 performs transmission processing on the signal generated by the control unit 200 and transmits it to the outside (e.g., another terminal device 10). The communication unit 150 performs reception processing on the signal received from the outside and outputs it to the control unit 200.

The input device 13 is a device for inputting instructions or information by the user operating the terminal device 10. The input device 13 is realized, for example, by a touch-sensitive device 131 or the like that inputs instructions by touching the operation surface. The input device 13 may include a keyboard or a mouse. The input device 13 converts the instructions or information input by the user into an electrical signal and outputs the electrical signal to the control unit 200. The input device 13 may also include, for example, a receiving port that receives an electrical signal input from an external input device.

The output device 14 is a device for presenting information to a user who operates the terminal device 10. The output device 14 is realized, for example, by a display 141 or the like. The display 141 displays data according to the control of the control unit 200. The display 141 is realized, for example, by an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display or the like.

The imaging unit 160 is equipped with a camera, receives light using a light receiving element, and inputs the light as an imaging signal to capture an image of the surroundings of the terminal device 10.

The audio processing unit 170, for example, performs digital-to-analog conversion processing of an audio signal. The audio processing unit 170 converts a signal provided from the microphone 171 into a digital signal and provides the converted signal to the control unit 200. The audio processing unit 170 also provides an audio signal to the speaker 172. The audio processing unit 170 is realized, for example, by a processor for audio processing. The microphone 171 accepts audio input and provides an audio signal corresponding to the audio input to the audio processing unit 170. The speaker 172 converts the audio signal provided from the audio processing unit 170 into audio and outputs the audio to the outside of the terminal device 10.

The storage unit 180 is realized, for example, by the memory 15 and the storage 16, and stores data and programs used by the terminal device 10. As an example, the storage unit 180 stores a user database 181, a stuffed animal database 182, a personality database 183, an event production database 184, and an event correspondence database 185.

The user database 181 is a database for storing user information. Information about the user who uses the terminal device 10 is stored in the user database 181. As an example, the user database 181 may be configured so that a record is generated when a user performs user registration work using software that provides this function installed on the terminal device 10. The data structure of the user database 181 will be described in detail later.

The stuffed toy database 182 is a database for storing information about the stuffed toy 50. The stuffed toy database 182 stores information set for each individual stuffed toy 50. As an example, the stuffed toy database 182 may be configured so that records are generated when a user registers information about a stuffed toy 50 that the user owns using software that provides this function installed on the terminal device 10. The data structure of the stuffed toy database 182 will be described in detail later.

The personality database 183 is a database for storing information about personalities set for the stuffed animals 50. The personality database 183 stores information about the personalities set for each stuffed animal 50 owned by the user and the gestures associated with the personalities. As an example, the personality database 183 may be configured such that pre-set records are generated when software that provides this function is installed on the terminal device 10. The data structure of the personality database 183 will be described in detail later.

The event production database 184 is a database for storing information on event production. An event production is a production that is applied when a specific event (hereinafter also referred to as a condition event) occurs in the imaging data of the stuffed toy 50, and image data is generated by processing the imaging data corresponding to the production. As an example, the event production database 184 may be configured so that preset records are generated when software that provides this function is installed on the terminal device 10. The data structure of the event production database 184 will be described in detail later.

The event correspondence database 185 is a database for storing the correspondence between stuffed toys 50 and event effects. The event correspondence database 185 stores information about the event effects associated with each stuffed toy 50. As an example, the event correspondence database 185 may be configured so that records are generated when a user registers information about a stuffed toy that the user owns using software that provides this function installed on the terminal device 10. The data structure of the event correspondence database 185 will be described in detail later.

The control unit 200 is realized when the processor 19 reads a program stored in the storage unit 180 and executes instructions contained in the program. The control unit 200 controls the operation of the terminal device 10. By operating according to the program, the control unit 200 fulfills the functions of an operation reception unit 201, a transmission/reception unit 202, a display control unit 203, an identification information reception unit 204, an imaging data acquisition unit 205, an imaging data analysis unit 206, and an image data generation unit 207.

The operation reception unit 201 performs processing for receiving instructions or information input from the input device 13. Specifically, for example, the operation reception unit 201 receives information based on instructions input from the touch-sensitive device 131, etc.

The transmission/reception unit 202 performs processing for the terminal device 10 to transmit and receive data to and from external devices in accordance with a communication protocol.

The display control unit 203 controls the display of information to the user. Specifically, for example, the display control unit 203 causes the image data generated by the image data generation unit 207 to be displayed on the display 141.

The identification information receiving unit 204 receives identification information for identifying an individual stuffed toy 50 from the user. Specifically, for example, the user may input identification information by operating the touch-sensitive device 131 displayed on the display 141, and the identification information receiving unit 204 may receive the input identification information. The identification information may be notified at the time of purchase of the stuffed toy 50.

For example, the stuffed toy 50 may be provided with a tag with an identification number written thereon as identification information, and the user may input the identification number into the terminal device 10 (by a method other than imaging the tag). Alternatively, an IC (Integrated Circuit) tag or an RFID (radio frequency identifier) tag may be attached inside or outside the stuffed toy 50, and the identification information may be obtained based on information from the tag. Alternatively, a management tag separate from the stuffed toy 50 may be provided at the time of purchase, and the identification number may be written on the management tag. As will be described later, since a personality is set in accordance with the identification information of each stuffed toy 50, it is preferable that the main body of the stuffed toy 50 and the tag or tag with the identification information written thereon are integrated.

The imaging data acquisition unit 205 acquires imaging data of the stuffed toy 50 captured by the user. Specifically, for example, the imaging data acquisition unit 205 acquires imaging data of the stuffed toy 50 captured by a camera provided in the imaging unit 160. Alternatively, the imaging data acquisition unit 205 may acquire imaging data of the stuffed toy 50 received by the transmitting/receiving unit 202 via the communication unit 150. Alternatively, the imaging data acquisition unit 205 may acquire imaging data captured in advance and stored in the storage unit 180, triggered by a selection by the user.

The imaging data analysis unit 206 analyzes the imaging data acquired by the imaging data acquisition unit 205. Specifically, for example, the imaging data analysis unit 206 performs image recognition processing on the imaging data. Well-known techniques such as pattern recognition, differential image calculation, and template matching may be used for the image recognition processing. Furthermore, when executing these image recognition processes, the imaging data analysis unit 206 may appropriately utilize AI (artificial intelligence) techniques such as machine learning and deep learning. The imaging data analysis unit 206 performs image recognition processing on the imaging data to determine whether or not a specific event has occurred in the imaging data (i.e., whether or not an event condition has been satisfied).

The image data generating unit 207 generates image data in which the appearance of the stuffed toy 50 in the image data has been processed according to the identification information, based on the analysis result of the image data analyzing unit 206. When the image data analyzing unit 206 determines that the event condition is satisfied, the image data generating unit 207 generates an image in which an event effect corresponding to the event condition is added to the image data. The image data generating unit 207 also generates an image in which a gesture effect corresponding to the personality of the stuffed toy 50 is added to the image data.

The image data generating unit 207 may use so-called AR (Augmented Reality) technology to generate an image. That is, an image may be generated by superimposing newly generated virtual image information on real-world image information acquired by the imaging data acquiring unit 205. The image data generating unit 207 may generate an image using a well-known AR technology. Specifically, for example, the AR technology may be a vision-based type that uses technology related to image recognition or spatial recognition, or a markerless type that tracks and acquires feature points in imaging data and displays additional information. To achieve this, the image data generating unit 207 may use a well-known method such as PTAM (Parallel Tracking And Mapping) or SmartAR.

(1-4. Data Structure)
4 is a diagram showing an example of the data structure of the user database 181, stuffed toy database 182, personality database 183, event performance database 184, and event correspondence database 185 stored in the storage unit 180. Note that FIG. 4 is merely an example, and does not exclude data that is not shown.

As shown in FIG. 4, a record in the user database 181 includes the items "user ID," "user name," "age," "gender," and "registered image," etc.

The "User ID" item is information that serves as an identifier to identify each user, and is the primary key for uniquely identifying a record in the user database 181.

The "User name" item is information about the user's name. The user name may be the user's real name, or it may be information that does not identify the user, such as a nickname.

The "Age" item is information about the user's age. The "Gender" item is information about the user's gender. The "Registered Image" item is information about an image in which the user appears. The user can register one or more images as registered images.

The user may be able to register user information and add records to the user database 181 using software that provides this function installed on the terminal device 10.

A record in the stuffed animal database 182 includes the items "stuffed animal ID," "registered user," and "personality," etc.

The item "Plushie ID" is identification information for distinguishing an individual stuffed animal 50 from other individuals with approximately the same appearance, and is a primary key for uniquely identifying a record in the stuffed animal database 182.

The item "Registered User" is information for identifying a user who is registered in association with the stuffed toy 50, and the item "User ID" in the user database 181 is held as an external key. In this embodiment, one user is associated with one stuffed toy 50 and stored in the stuffed toy database 182.

The item "personality" is information for identifying the personality of the stuffed animal 50, and the item "personality ID" in the personality database 183 is held as an external key. In this way, information about the personality set for each individual stuffed animal 50 is stored in the stuffed animal database 182.

The user may use software that provides this function installed in the terminal device 10 to register information about the stuffed animal and add the record to the stuffed animal database 182. In this case, the user may be able to select the personality of the stuffed animal 50 that he or she owns from among options prepared in advance and set it to the personality that the user desires.

A record in the personality database 183 includes an item "personality ID," an item "personality content," an item "gesture performance," etc.

The item "Personality ID" is identification information for identifying the personality of the stuffed animal 50, and is the primary key for uniquely identifying a record in the personality database 183.

The "personality" item is information about the personality set for the stuffed animal 50. Specifically, personality information can be "innocent," "quiet," "brave," "calm," "timid," "cheerful," etc.

The item "gesture performance" refers to the performance of a gesture (behavior pattern) associated with the personality of the stuffed animal 50. The image data generation unit 207 generates image data to which a corresponding gesture performance has been added according to the personality of the stuffed animal 50 in the imaging data. For example, if the personality is "innocent," the image data generation unit 207 generates image data to which a movement expressing an innocent personality has been added to the appearance of the stuffed animal 50 in the imaging data. Also, if the personality is "quiet," the image data generation unit 207 generates image data to which a modest movement has been added to the appearance of the stuffed animal 50 in the imaging data.

The records in the event production database 184 include the items "event production ID", "condition event", and "event production", etc.

The item "Event performance ID" is identification information for identifying the event performance, and is the primary key for uniquely identifying a record in the event performance database 184.

The item "condition event" is information about an event that is a condition for applying an event effect to the image data capturing an image of the stuffed toy 50. Examples of the condition event include the following.
The image data capturing an image of the stuffed toy 50 includes a registered user of the stuffed toy 50 (hereinafter, referred to as condition event A).
A specific food appears in the image data of the stuffed toy 50 (hereinafter, referred to as condition event B).
An object indicating environmental information is captured in the image data of the stuffed toy 50 (hereinafter, referred to as condition event C).
A specific building or landscape is captured in the image data of the stuffed toy 50 (hereinafter, referred to as condition event D).

The "specific food" in condition event B may be a specific dish, ingredient (meat, vegetables, or fruit), sweets, etc. Furthermore, the "environmental information" in condition event C may be meteorological information such as weather, temperature, and humidity. Furthermore, the "building" in condition event D may be a building at a tourist spot (such as a temple). Furthermore, the "scenery" in condition event D may be a scene that can identify a tourist spot, etc.

The item "event production" is information about the content of the event production. Examples of the event production include the following.
When condition event A occurs, the robot behaves as if it is speaking to the registered user.
・When condition event B occurs, perform a happy behavior.
When the condition event C occurs, the state will be according to the environmental information.
When condition event D occurs, wear clothing that matches the building or scenery.

The records in the event correspondence database 185 include the items "Corresponding ID", "Plush toy", and "Event production", etc.

The item "Correspondence ID" is identification information for identifying the correspondence between the stuffed animal 50 and the event presentation, and is a primary key for uniquely identifying a record in the event correspondence database 185.

The item "Plush Toy" is identification information for identifying the stuffed toy 50 to which the event performance is associated, and the item "Plush Toy ID" in the stuffed toy database 182 is held as an external key.

The item "Event performance" is identification information for identifying the event performance associated with the stuffed animal 50, and the item "Event performance ID" in the event performance database 184 is held as an external key.

The specification may be such that the user can add a record to the event correspondence database 185 when registering information about a stuffed animal using software that provides this function installed in the terminal device 10. In addition, the specification may be such that the user can select an event effect to be applied to the stuffed animal 50 that he or she owns from among options prepared in advance, and set it so that the event effect that the user desires is applied.

In this embodiment, it is possible to associate stuffed animals with event effects in a many-to-many relationship. In other words, one stuffed animal 50 can be associated with multiple event effects. Also, different stuffed animals 50 can be associated with the same event effect.

(1-5. Stuffed toys 50)
The plush toy 50 will now be described in detail with reference to FIG.

As an example, the stuffed toy 50 is shaped to resemble a real or imaginary animal (including a person or an imaginary character). The stuffed toy 50 is preferably a simple stuffed toy. A simple stuffed toy is one that is made by sewing together pieces of cut cloth and stuffing the inside with contents such as cotton or pieces of plastic. In other words, the stuffed toy 50 preferably does not have a drive mechanism for operating the components (i.e., the head 51, the torso 52, the front legs 56, the lower legs 57, the tail 58, etc.).

In the example shown in Figures 5A and 5B, stuffed toy 50 has a head 51, a body 52, front legs 56, lower legs 57, and a tail 58. Head 51 is attached to the top surface of body 52. A pair of front legs 56 is attached to the side of body 52, and a pair of lower legs 57 is attached to the bottom surface of body 52. Tail 58 is attached to the back of body 52.

A pair of eyes 53 and a mouth 54 are formed on the front of the head 51. A pair of ears 55 are attached to the sides of the head 51. As a result, a face with a predetermined expression is formed on the front of the head 51. In this way, it is preferable that the stuffed animal 50 has elements that can express emotions through movement, such as the ears 55 and the tail 58, in addition to elements that form facial expressions, such as the eyes 53 and mouth 54.

The stuffed animal 50 shown in FIG. 5 is an example, and the shapes of each component (e.g., head 51, torso 52, front legs 56, lower legs 57, tail 58) can be changed as appropriate. The head 51 may have other parts such as a nose or antennae. The stuffed animal 50 is not limited to the standing position shown in FIG. 5A, but may be shaped in a sitting position or a lying position, or in a position for swimming or flying.

Each stuffed animal 50 is assigned identification information (for example, a stuffed animal ID) to identify the individual stuffed animal. The user may be notified of the identification information when purchasing the stuffed animal 50. As an example, the stuffed animal 50 may have a tag attached thereto, on which the identification information is written.

(1-6. Processing flow)
An example of the flow of processing by the terminal device 10 will be described below with reference to Figures 6 to 11. First, an overall view of the processing by the terminal device 10 will be described with reference to Figure 6.

In step S100, in the control unit 200 of the terminal device 10, the identification information receiving unit 204 receives the identification information of the stuffed toy 50. Specifically, for example, the user may operate the touch-sensitive device 131 of the terminal device 10 to input the identification information, and the identification information receiving unit 204 may receive the input identification information.

In step S200, the imaging data acquisition unit 205 acquires imaging data of the stuffed toy 50. The imaging data includes moving images and still images. Specifically, for example, the imaging data acquisition unit 205 acquires imaging data of the stuffed toy 50 captured by the imaging unit 160 in response to a user operation.

In step S300, a performance image generation process is executed. In the performance image generation process, image data is generated in which the state of the stuffed toy 50 in the imaging data acquired by the imaging data acquisition unit 205 is processed according to the identification information of the stuffed toy 50. The performance image generation process (S300) will be described in detail later.

In step S400, the display control unit 203 presents the image data generated in the performance image generation process (S300) to the user by displaying it on the display 141.

Next, the effect image generation process (S300) will be described with reference to Figures 7 to 13. As shown in Figure 7, in the effect image generation process (S300), steps S310 to S340 are executed.

In step S310, the imaging data analysis unit 206 analyzes the imaging data of the stuffed toy 50 acquired by the imaging data acquisition unit 205. As an example, the imaging data analysis unit 206 analyzes the imaging data by performing image recognition processing on the imaging data. By analyzing the imaging data of the stuffed toy 50, the imaging data analysis unit 206 identifies people, objects, buildings, scenery, etc. that appear together with the stuffed toy 50 in the imaging data.

In step S320, the image data generating unit 207 acquires an event associated with the stuffed toy 50 acquired by the imaging data acquiring unit 205. Specifically, for example, the image data generating unit 207 refers to the event corresponding database 185 and acquires one or more records that include the identification information accepted by the identification information accepting unit 204 in the item "stuffed toy".

The image data generation unit 207 references the event performance database 184 to acquire one or more records that include an event performance in the acquired record of the event correspondence database 185 in the item "event performance ID." The image data generation unit 207 acquires the item "condition event" in the acquired event performance database 184.

In step S330, an event determination process is executed. As an example, as shown in FIG. 8, in the event determination process (S330), steps S331 to S336 are executed. Note that FIG. 8 shows an example in which four condition events, condition event A to condition event D, are acquired in step S320, but this is not limiting. In other words, the number and contents of the condition events determined in the event determination process (S330) are changed as appropriate depending on the records stored in the event production database 184 and the event correspondence database 185.

In step S331, the image data generating unit 207 determines whether or not condition event A has occurred in the imaging data acquired by the imaging data acquiring unit 205, i.e., whether or not the registered user of the stuffed toy 50 is shown in the imaging data of the stuffed toy 50.

In specific processing, the image data generation unit 207 refers to the stuffed toy database 182 to obtain a record in which the identification information obtained by the identification information receiving unit 204 matches the item "Plush toy ID." In this embodiment, since the item "Plush toy ID" in the stuffed toy database 182 is the primary key, one record is identified and obtained.

The image data generation unit 207 acquires the item "Registered User" in the acquired record of the stuffed toy database 182. The image data generation unit 207 references the user database 181 and acquires a record whose acquired registered user matches the item "User ID". In this embodiment, since the item "User ID" in the user database 181 is the primary key and also an external key in the stuffed toy database 182, one record is identified and acquired. The image data generation unit 207 acquires the item "Registered Image" in the acquired record of the user database 181.

The image data generating unit 207 determines whether or not the registered user of the stuffed toy 50 is shown in the imaging data acquired by the imaging data acquiring unit 205 based on the acquired registered image and the analysis result of the imaging data analyzing unit 206. If it is determined that the registered user of the stuffed toy 50 is shown in the imaging data (YES in S331), step S336 is performed. On the other hand, if it is determined that the registered user of the stuffed toy 50 is not shown in the imaging data (NO in S331), step S332 is performed.

In step S332, the image data generating unit 207 determines whether or not condition event B has occurred in the imaging data acquired by the imaging data acquiring unit 205, i.e., whether or not a specific food is captured in the imaging data capturing the stuffed toy 50.

Specifically, the image data generating unit 207 determines whether or not a specific food is captured in the imaging data acquired by the imaging data acquiring unit 205 based on the analysis result of the imaging data analyzing unit 206. If it is determined that a specific food is captured in the imaging data (YES in S332), step S336 is performed. On the other hand, if it is determined that a specific food is not captured in the imaging data (NO in S332), step S333 is performed.

In step S333, the image data generating unit 207 determines whether or not condition event C has occurred in the imaging data acquired by the imaging data acquiring unit 205, i.e., whether or not an object indicating environmental information is captured in the imaging data capturing the stuffed toy 50.

Specifically, the image data generating unit 207 determines whether or not an object indicating environmental information is captured in the imaging data acquired by the imaging data acquiring unit 205 based on the analysis result of the imaging data analyzing unit 206. If it is determined that an object indicating environmental information is captured in the imaging data (YES in S333), step S336 is performed. On the other hand, if it is determined that an object indicating environmental information is not captured in the imaging data (NO in S333), step S334 is performed.

In step S334, the image data generating unit 207 determines whether or not condition event D has occurred in the imaging data acquired by the imaging data acquiring unit 205, i.e., whether or not a specified building or landscape is captured in the imaging data capturing the stuffed toy 50.

Specifically, the image data generating unit 207 determines whether or not a specific building or landscape is captured in the imaging data acquired by the imaging data acquiring unit 205 based on the analysis result of the imaging data analyzing unit 206. If it is determined that the specific building or landscape is captured in the imaging data (YES in S334), step S336 is performed. On the other hand, if it is determined that the specific building or landscape is not captured in the imaging data (NO in S334), step S335 is performed.

In step S335, the image data generation unit 207 does not apply the event effect because the condition event stored in the event effect database 184 (condition event A to condition event D in the above example) has not occurred in the imaging data acquired by the imaging data acquisition unit 205, and ends the event determination process (S330).

In step S336, the image data generating unit 207 generates image data to which the event effects have been applied. Specifically, based on the results of steps S331 to S334, the image data generating unit 207 generates image data in which the event effects corresponding to the condition event determined to have occurred among condition events A to D have been added to the imaging data acquired by the imaging data acquiring unit 205.

For example, if it is determined in step S331 that condition event A has occurred (i.e., if it is determined that the image data capturing the stuffed toy 50 shows the registered user of the stuffed toy 50), the image data generating unit 207 generates image data that changes the appearance of the stuffed toy 50 based on the fact that it is captured together with the registered user.

For example, in the example shown in FIG. 1A, imaging data is acquired that shows both the stuffed toy 50 and the user U. Here, if the user U is a registered user of the stuffed toy 50, the image data generation unit 207 determines that condition event A has occurred (S331), and generates image data in which the state of the stuffed toy 50 has been changed. Specifically, for example, as shown in FIG. 1B, an image may be generated in which the stuffed toy 50 is greeting the user U with its front legs 56 raised. In addition, the facial expression of the stuffed toy 50 may also be processed to generate image data in which the stuffed toy 50 appears happy to have the registered user nearby.

Also, for example, if it is determined in step S332 that condition event B has occurred (i.e., if it is determined that a specific food is shown in the image data capturing the stuffed toy 50), the image data generating unit 207 generates image data that changes the appearance of the stuffed toy 50 based on the fact that a specific food is shown.

For example, in the example shown in FIG. 9A, imaging data is acquired that shows both the stuffed animal 50 and ice cream P. Here, if the specific food in condition event B is ice cream, the image data generation unit 207 determines that condition event B has occurred (S332), and generates image data in which the appearance of the stuffed animal 50 has been changed. Specifically, for example, as shown in FIG. 9B, an image may be generated in which the stuffed animal 50 appears happy by moving its tail 58. In addition, the facial expression of the stuffed animal 50 may also be processed to generate image data in which the stuffed animal appears happy to have ice cream, its favorite food, nearby.

Also, for example, if it is determined in step S333 that condition event C has occurred (i.e., if it is determined that an object indicating environmental information is captured in the image data of the stuffed toy 50), the image data generating unit 207 generates image data that changes the state of the stuffed toy 50 based on the environmental information.

For example, in the example shown in FIG. 10A, imaging data is acquired that shows both the stuffed toy 50 and a thermometer Q. Here, if the object showing the environmental information in condition event C (temperature in this example) is a thermometer, the image data generating unit 207 determines that condition event C has occurred (S333), and generates image data in which the state of the stuffed toy 50 has been changed. Specifically, for example, as shown in FIG. 10B, an image may be generated in which the stuffed toy 50 appears to be suffering from summer fatigue due to the extremely high temperature, which is the environmental information. In addition, the facial expression of the stuffed toy 50 may also be processed to generate image data showing a painful facial expression.

Also, for example, if it is determined in step S334 that condition event D has occurred (i.e., if it is determined that a specific building or landscape is shown in the image data capturing the stuffed toy 50), the image data generating unit 207 generates image data that changes the appearance of the stuffed toy 50 based on the building or landscape.

For example, in the example shown in FIG. 11A, imaging data is acquired that shows both the stuffed toy 50 and temple R. Here, if the building representing condition event D is temple R, the image data generation unit 207 determines that condition event D has occurred (S334), and generates image data in which the appearance of the stuffed toy 50 has been changed. Specifically, for example, as shown in FIG. 11B, an image may be generated in which the stuffed toy 50 is wearing a kimono to match temple R. In addition, the facial expression of the stuffed toy 50 may also be processed to generate image data in which the stuffed toy 50 appears happy to be wearing a kimono.

When the event determination process (S330) shown in FIG. 8 is completed as described above, step S340 in FIG. 7 is executed. In step S340, the image data generation unit 207 generates image data to which a gesture effect has been added. If the image data generation unit 207 has generated image data to which an event effect has been applied in the event determination process (S330), the image data generation unit 207 generates image data to which a gesture effect has been added to the image data. If the image data generation unit 207 has not generated image data to which an event effect has been applied in the event determination process (S330), the image data generation unit 207 generates image data to which a gesture effect has been added to the imaging data acquired by the imaging data acquisition unit 205.

In specific processing, the image data generation unit 207 refers to the stuffed toy database 182 to obtain a record in which the identification information obtained by the identification information receiving unit 204 matches the item "Plush toy ID." In this embodiment, since the item "Plush toy ID" in the stuffed toy database 182 is the primary key, one record is identified and obtained.

The image data generation unit 207 acquires the "personality" item in the acquired record of the stuffed animal database 182. The image data generation unit 207 references the personality database 183 and acquires a record in which the acquired personality matches the "personality ID" item. In this embodiment, the "personality ID" item in the personality database 183 is the primary key, so one record is identified and acquired. The image data generation unit 207 acquires the "gesture performance" item in the acquired record of the personality database 183.

The image data generating unit 207 generates an image of the gesture of the stuffed animal 50 based on the content of the acquired item "gesture effect". The image data generating unit 207 adds an image of the generated gesture to the imaging data acquired by the imaging data acquiring unit 205 or image data to which the event effect has been applied. Note that in this embodiment, when generating the gesture effect, the image data generating unit 207 generates an image to which a gesture effect has been added based on the stuffed animal 50 in the imaging data acquired by the imaging data acquiring unit 205. By adopting such specifications, it is possible to express the individual differences of the stuffed animal 50.

With reference to Figure 12, individual differences in stuffed toy 50 will be described. Compared to stuffed toy 50A shown in Figure 12A, stuffed toy 50B shown in Figure 12B has slight differences in the shape of eyes 53 and ears 55. Stuffed toy 50B also has stains 61 and tears 62 due to deterioration over time. As such, stuffed toy are often made by hand, and even stuffed toy of the same type do not have exactly the same appearance, and there are differences in the shape to begin with, and individual differences may be noticeable due to deterioration over time, etc.

In the example shown in FIG. 13A, the terminal device 10 captures image data showing both stuffed animal 50A and stuffed animal 50B. In this case, the image data generating unit 207 of the terminal device 10 generates an image in which stuffed animal 50A is talking to stuffed animal 50B. In this case, for example, the condition event and event production may be such that when multiple stuffed animals of the same type (stuffed animals with roughly the same appearance) are shown, they perform an action to communicate with each other.

As shown in FIG. 13A, when multiple stuffed toys of the same type are captured by the terminal device 10, the user may be prompted to specify identification information for each of the stuffed toys. In this case, in step S310 of the performance image generation process (S300), the image data analysis unit 206 analyzes the image data to determine whether or not there are multiple stuffed toys of the same type in the image data. If it is determined that there are multiple stuffed toys of the same type, the system may be configured to accept from the user the specification of identification numbers corresponding to each of the multiple stuffed toys in the image.

In this manner, in this embodiment, a personality is set for each individual stuffed animal 50, and the image data generating unit 207 generates image data showing different aspects in accordance with the personality, based on each individual stuffed animal 50 in the image capture data. With this specification, the user can recognize the individuality of the stuffed animal he or she owns from the individual differences of each stuffed animal 50, and can feel a deeper attachment to the stuffed animal.

(1-7. Summary)
As described above, in this embodiment, the terminal device 10 executes the steps of accepting identification information for identifying an individual stuffed toy 50 (S100), acquiring image data of the stuffed toy captured by the user (S200), generating image data in which the state of the stuffed toy in the image data is processed according to the identification information (S300), and presenting the image data to the user (S400). With this configuration, even in a space where multiple stuffed toys with approximately the same appearance exist, they behave differently on the display according to the identification information, so that the user can feel a deeper attachment to the stuffed toy that he or she owns, and the user experience when taking pictures of stuffed toys can be improved.

In addition, in the step of generating image data (S300), the image data generating unit 207 generates image data showing different aspects for each individual stuffed animal 50. As an example, in the step of generating image data (S300), image data showing aspects that correspond to the personality set for each individual stuffed animal is generated. With this specification, the user can recognize the individuality of the stuffed animal 50 that he or she owns, and can feel a deeper attachment to the stuffed animal, improving the user experience when taking pictures of stuffed animals.

In addition, in the step of generating an image (S300), the image data generating unit 207 generates image data in which the state of the stuffed toy 50 is changed based on a combination of the identification information of the stuffed toy 50 and information about the image included in the imaging data. Specifically, the image data generating unit 207 may generate image data in which the state of the stuffed toy is changed based on a combination of the identification information of the stuffed toy 50 and information about a person who appears with the stuffed toy 50 in the image of the imaging data.

The image data generating unit 207 may generate image data in which the state of the stuffed toy 50 is changed based on a combination of the identification information of the stuffed toy 50 and information on an object that appears together with the stuffed toy 50 in the image of the imaging data. The image data generating unit 207 may generate image data in which the state of the stuffed toy 50 is changed based on a combination of the identification information of the stuffed toy 50 and the environmental information when an object that indicates environmental information in the location where the stuffed toy 50 is placed is included in the image of the imaging data.

In this way, image data can be generated from imaging data acquired in various situations, with the appearance of the stuffed toy 50 processed to suit each situation, and the image data can be presented to the user, improving the user experience and motivating the user to take stuffed toy photos in various places and situations.

<2. Second embodiment>
A system 1 according to a second embodiment of the present disclosure will be described below with reference to Figures 14 to 16. The following description will focus on differences from the above embodiment.

(2-1. Hardware configuration of system 1)
FIG. 14 is a block diagram showing an example of a hardware configuration of the system 1. The system 1 includes a plurality of terminal devices 10 and a server 20. The terminal devices 10 and the server 20 are communicatively connected via, for example, a network 30. The network 30 is realized by, for example, the Internet and/or a communication network provided by a telecommunications carrier. Note that, while FIG. 14 shows an example in which the system 1 includes two terminal devices 10, the number of terminal devices 10 included in the system 1 is not limited to two. In other words, the number of terminal devices 10 may be less than two, or may be three or more.

In this embodiment, a collection of multiple devices may be considered as one server. The method of allocating multiple functions required to realize the server 20 of this embodiment to one or more pieces of hardware can be determined appropriately in consideration of the processing capacity of each piece of hardware and/or the specifications required for the server 20.

The terminal device 10 includes a communication IF 12, an input device 13, an output device 14, a memory 15, a storage 16, and a processor 19. These configurations are similar to those in the above embodiment, so the description will not be repeated.

The server 20 includes a communication IF 22, an input/output IF 23, a memory 25, a storage 26, and a processor 29.

The communication IF 22 is an interface for inputting and outputting signals so that the server 20 can communicate with an external device (e.g., the terminal device 10).

The input/output IF 23 functions as an interface between an input device for accepting input operations from the user and an output device for presenting information to the user.

Memory 25 is for temporarily storing programs and data processed by the programs, and is, for example, a volatile memory such as a DRAM.

Storage 26 is for storing data, and is, for example, a flash memory or a HDD.

The processor 29 is hardware for executing the instruction set described in the program, and is composed of an arithmetic unit, registers, peripheral circuits, etc.

(2-2. Functional configuration of server 20)
Fig. 15 is a diagram showing the functional configuration of the server 20. As shown in Fig. 15, the server 20 fulfills the functions of a communication unit 210, a storage unit 220, and a control unit 230.

The communication unit 210 performs processing for the server 20 to communicate with external devices.

The storage unit 220 is realized by, for example, the memory 25 and storage 26, and stores data and programs used by the server 20. Similar to the storage unit 180 of the terminal device 10 in the first embodiment, the storage unit 220 stores a user database 221, a stuffed animal database 222, a personality database 223, an event production database 224, and an event correspondence database 225. These databases can be configured in the same way as in the first embodiment, so the description will not be repeated.

The control unit 230 is realized by the processor 29 reading a program stored in the storage unit 220 and executing instructions contained in the program. The control unit 230 performs functions shown as a transmission/reception module 231, an imaging data analysis module 232, and an image data generation module 233 by operating according to the program.

The transmission/reception module 231 controls the process in which the server 20 transmits and receives signals to and from external devices according to a communication protocol.

The imaging data analysis module 232 analyzes the imaging data acquired by the imaging data acquisition unit 205, similar to the imaging data analysis unit 206 in the first embodiment.

The image data generation module 233, like the image data generation unit 207 in the first embodiment, generates image data in which processing has been applied to the state of the stuffed toy 50 in the image data corresponding to the identification information, based on the analysis results of the image data analysis unit 206. In this way, in the second embodiment, this function is realized by the server 20 executing some of the functions provided in the terminal device 10 in the first embodiment.

(2-3. Processing flow)
The flow of processing in the second embodiment will be described with reference to Fig. 16. Note that processing similar to that in the first embodiment will not be described repeatedly.

In step S100, the identification information receiving unit 204 of the terminal device 10 receives the identification information of the stuffed toy 50. In step S200, the image data acquiring unit 205 acquires the image data of the stuffed toy 50.

In step S230, the transmission/reception unit 202 of the terminal device 10 transmits to the server 20 the identification information of the stuffed toy 50 accepted by the identification information acceptance unit 204 and the image data of the stuffed toy 50 acquired by the image data acquisition unit 205. In step S260, the transmission/reception module 231 of the server 20 receives the identification information and image data of the stuffed toy 50.

In step S300, the imaging data analysis module 232 and the image data generation module 233 execute a performance image generation process. In the performance image generation process (S300), similar to the first embodiment, image data is generated in which the state of the stuffed toy 50 in the imaging data acquired by the imaging data acquisition unit 205 is processed according to the identification information of the stuffed toy 50.

In step S330, the transmission/reception module 231 of the server 20 transmits the image generated by the image data generation module 233 to the terminal device 10. In step S360, the transmission/reception unit 202 of the terminal device 10 receives the image generated by the image data generation module 233.

In step S400, the display control unit 203 of the terminal device 10 displays the received image data on the display 141, thereby presenting it to the user.

As described above, in the second embodiment, the system 1 includes the terminal device 10 and the server 20. The server 20 generates image data based on the identification information and imaging data of the stuffed toy 50 received from the terminal device 10, and transmits the image data to the terminal device 10. The terminal device 10 displays the received image data and presents it to the user. Even with this specification, the same effects as those of the above embodiment can be achieved.

(2-4. Modified Examples)
As a modified example of the second embodiment, a specification may be adopted in which communication is performed between a plurality of terminal devices 10, and the image data generation module 233 generates an image to which an event effect is added based on the history of the communication. For example, different individual stuffed toys 50 are registered in the stuffed toy database 182 in the storage unit 180 of the plurality of terminal devices 10. Each time the plurality of terminal devices 10 communicate with each other, predetermined data related to the stuffed toy 50 registered in the storage unit 180 is transmitted and received.

More specifically, for example, in the case where a stuffed toy 50A is associated with and registered on terminal device 10A, and a stuffed toy 50B is associated with and registered on terminal device 10B, terminal device 10 and terminal device 10B may communicate with each other to associate stuffed toy 50A with stuffed toy 50B by communicating predetermined data related to stuffed toy 50A and stuffed toy 50B, and the history of the communication in which the association was made may be stored in storage unit 220 of server 20. Then, in the item "condition event" of event production database 224, a condition event based on the history of the communication between terminal device 10A and terminal device 10B may be set.

As an example, when the stuffed toy 50A and the stuffed toy 50B are within a predetermined distance, the terminal device 10A and the terminal device 10A may communicate with each other (hereinafter, referred to as near-field communication) to associate them, and the history of the near-field communication may be stored in the storage unit 220 of the server 20. In this case, the image data generation module 233 may generate image data that changes the appearance of at least one of the stuffed toy 50A or the stuffed toy 50B (for example, to show an appearance of increased intimacy) when the number of near-field communications exceeds a predetermined number as a condition event. In addition, when the number of near-field records exceeds a predetermined number, when the terminal device 10A is used to photograph the unassociated stuffed toy 50B, the facial expression of the stuffed toy 50B may be changed (the stuffed toy 50 may recognize the user of the terminal device 10A as an acquaintance and adopt a familiar facial expression, etc.).

The proximity communication between the terminal devices 10 in the above example may be realized by a wireless LAN via the network 30, or by infrared communication. In the above example, multiple terminal devices 10 communicate with each other, but the stuffed toy 50 may have a communication IF 12, memory 15, and processor 19, and communicate with each other. In this case, each time multiple stuffed toy 50 perform proximity communication, the history of the proximity communication may be transmitted from the stuffed toy 50 to the terminal device 10 associated with the stuffed toy 50, and may be stored in the memory unit 180 of the terminal device 10. Alternatively, the stuffed toy 50 may have a memory unit, and the history of the proximity communication may be stored in the memory unit.

<3. Third embodiment>
Hereinafter, the system 1 according to the third embodiment of the present disclosure will be described with reference to Figures 17 to 19. The third embodiment differs from the above-described embodiments in that the history of image data of the stuffed toy captured by the user is stored in the storage unit 220 of the server 20 and processed. The following description will focus on the differences from the above-described embodiments.

(3-1. Functional configuration of server 20)
As shown in FIG. 17, the storage unit 220 of the server 20 further includes a standard image database 226 and a history image database 227 in addition to the databases described in the above embodiment.

The standard image database 226 is a database for storing information on standard images. A standard image is image information that serves as a standard for the appearance of stuffed animals of the same type. The standard image database 226 stores a standard image for each type of stuffed animal. As an example, the standard image database 226 may be configured so that a corresponding record is generated when a new type of stuffed animal is provided (e.g., sold). Details of the data structure of the standard image database 226 will be described later.

The historical image database 227 is a database for storing information on historical images. A historical image is an image that a user has captured (or selected) on the terminal device 10, and is historical information of the image that has been transmitted to the server 20. As an example, the historical image database 227 may be configured such that, at the time that imaging data is received from the terminal device 10, a record corresponding to the imaging data is generated. Details of the data structure of the historical image database 227 will be described later.

(3-2. Data Structure)
Fig. 18 is a diagram showing an example of the stuffed toy database 222, the standard image database 226, and the history image database 227 stored in the storage unit 220. Note that Fig. 18 is merely an example, and does not exclude data that is not shown. The storage unit 220 also includes other databases such as a user database 221, but as these are similar to the above embodiment, the description will not be repeated.

As shown in FIG. 18, the records in the stuffed animal database 222 include the same items as in the above embodiment, such as "stuffed animal ID," "registered user," and "personality," as well as items such as "standard image ID" and "characteristics."

The item "Standard Image ID" is information serving as an identifier that identifies the standard image corresponding to the individual stuffed animal in the record, and the item "Standard Image ID" in the standard image database 226 is held as an external key.

The "Feature Content" item is information about features in the image data of the individual stuffed animal in the record that are recognized as differences from the standard image. The "Feature Content" item may be configured to register information about features that are recognized as differences between the standard data and the standard image when the degree of deviation between the image data of the stuffed animal and the standard image exceeds a predetermined threshold.

A record in the standard image database 226 includes the items "standard image ID," "type name," and "image content," etc.

The item "Standard Image ID" is information that serves as an identifier to identify each standard image, and is a primary key for uniquely identifying a record in the standard image database 226.

The "Type Name" item is information about the name of the type of stuffed animal that corresponds to the standard image. The type name may be, for example, the name of the stuffed animal character, with additional information added, such as information about when sales began (e.g., "Released in 2022") or information about the concept of the type (e.g., "Summer design version").

The "Image Content" item is information about the content of the image data in the standard image.

A record in the historical image database 227 includes an item "historical image ID," an item "stuffed animal ID," an item "image content," an item "registration date and time," an item "difference content," etc.

The item "History image ID" is information that serves as an identifier to identify each historical image, and is a primary key for uniquely identifying a record in the historical image database 227.

The item "Plushie ID" is information that serves as an identifier for identifying the plush toy that corresponds to the history image, and the item "Plushie ID" in the plush toy database 222 is held as an external key.

The "Image Content" item is information about the content of the image data in the history image.

The "Registration Date and Time" item is information about the date and time when the record for the history image was created.

The "Difference Content" item is information about the difference in image content between the individual stuffed animal identified by the stuffed animal ID of the record and the history image previously acquired and registered.

(3-3. Processing flow)
Referring to FIG. 19, the effect image generation process (S300) in the third embodiment will be described with respect to differences from the above-described embodiments.

In step S310, the imaging data analysis module 232 analyzes the imaging data of the stuffed toy 50 received by the transmission/reception module 231, and then step S312 is executed.

In step S312, the imaging data analysis module 232 registers the analyzed imaging data. Specifically, the imaging data analysis module 232 adds a record to the historical image database 227 of the storage unit 220, and stores the information of the analyzed imaging data as a historical image. Here, the imaging data analysis module 232 stores the identification information of the stuffed animal 50 received from the terminal device 10 together with the imaging data in the item "Plush Animal ID".

In step S314, the imaging data analysis module 232 analyzes the difference between the currently registered image history of the imaging data and the previously registered image history. Specifically, the imaging data analysis module 232 compares the "image content" item in the previously registered record with the "image content" item in the currently registered record for the stuffed animal ID of the record registered in the history image database 227 to analyze the difference, and stores information about the analyzed difference in the "difference content" item in the currently registered record.

Note that if there was no previously registered record for the stuffed animal ID of the currently registered record (i.e., the first registration), the image (hereinafter also referred to as the captured image) stored in the "Image Content" field of the currently registered record may be compared with a standard image corresponding to the stuffed animal ID to analyze the differences. Also, before analyzing the differences in step S314, the captured image may be compared with the standard image to determine whether the stuffed animal in the currently acquired captured image data is the same type as the stuffed animal corresponding to the standard image, and an error notification may be issued if they are not the same type of stuffed animal.

In step S316, the imaging data analysis module 232 compares the captured image with the standard image. Specifically, the imaging data analysis module 232 compares the image stored in the "image content" item in the record registered in the history image database 227 in step S312 with the standard image corresponding to the "stuffed toy ID" item in the registered record (more specifically, the standard image stored in the "image content" item in the standard image database 226), and analyzes the degree of deviation between the two. Here, the imaging data analysis module 232 analyzes the deviation between the captured image and the standard image while taking into account the difference between the previous registration and the current registration analyzed in step S314, thereby making it possible to reliably analyze the degree of deviation while identifying the individual stuffed toy 50.

In this way, the captured image is compared with the standard image, and if the degree of discrepancy between the two exceeds a predetermined threshold, the image data analysis module 232 registers information about the difference between the captured image and the standard image in the "characteristics" item of the stuffed animal database 222. Then, in subsequent processes, the stuffed animal whose "characteristics" item has been registered can be identified as an individual without using the identification number (i.e., the stuffed animal ID) received from the user.

Specifically, in step S310, the imaging data analysis module 232 may be configured to obtain a stuffed animal ID corresponding to the record in the stuffed animal database 222 when a feature registered in the stuffed animal database 222 is detected, and perform subsequent processing. With this configuration, when a stuffed animal is owned for a long period of time and imaging data is obtained, and the feature deviates from the standard data due to aging or the like, the individual stuffed animal can be recognized without using identification information. In this case, a message such as "The intimacy level has improved, so there is no need to enter the identification number" may be notified to the user, and the input of the identification number may be omitted. Note that instead of (or in addition to) when the degree of deviation between the captured image and the standard image exceeds a predetermined threshold, when the amount of information in the history image of a specific stuffed animal exceeds a predetermined threshold, information about the difference between the captured image and the standard image may be registered in the "feature content" item in the stuffed animal database 222, and the individual may be identified without an identification number.

In this manner, in the third embodiment, the imaging data analysis module 232 of the server 20 stores the imaging data of the stuffed animal received by the transmission/reception module 231 in the history image database 227 as history information. The imaging data analysis module 232 may identify the individual stuffed animal in the imaging data based on the history information without using identification information. With this configuration, the user can feel more attached to the stuffed animal that he or she has owned for a long time.

<4. Other embodiments>
Although the embodiment and the modified examples of the present invention have been described above, application of the present disclosure is not limited to the above-mentioned contents.

In the above embodiment, one user is associated with one stuffed animal in the stuffed animal database 182, but this is not limited to the example, and multiple users may be associated with one stuffed animal.

In the above embodiment, a plush toy ID is assigned as identification information for identifying an individual plush toy 50, but the present invention is not limited to this example. For example, an identification number or barcode information (including two-dimensional barcodes such as QR Code (registered trademark)) may be used as the identification information. Alternatively, information that can identify an individual, such as a fingerprint of a thing, that can be obtained by analyzing image data obtained by photographing the plush toy 50, may be obtained as the identification information of the plush toy 50.

The conditional event and the content of the effect stored in the event effect database 184 are not limited to the above embodiment. For example, the imaging data acquisition unit 205 may recognize the face of a person captured in the imaging data to identify the person, and store the history of the person appearing in the image together with the stuffed animal 50 (hereinafter referred to as the meeting history) in the storage unit 180. The image data generation unit 207 may be configured to change the appearance of the person appearing together with the stuffed animal 50 to that of the stuffed animal 50 when the person is the first person to appear together with the stuffed animal 50 (for example, to generate an image with a facial expression and a movement of the person appearing concerned because it is the first time they have met). The image data generation unit 207 may be configured to change the appearance of the person appearing together with the stuffed animal 50 to that of the stuffed animal 50 when the number of times the person has appeared together with the stuffed animal 50 exceeds a predetermined number (for example, to generate an image with a facial expression and a movement of the person appearing relaxed because they have met a predetermined number of times).

In addition, when the imaging data acquired by the imaging data acquisition unit 205 is video data, image data may be generated in which the appearance of the stuffed toy 50 is changed when the person appearing together with the stuffed toy 50 in the imaging data changes as a condition event. In this case, for example, the image data generation unit 207 may generate an image to which a performance based on the meeting history stored in the storage unit 180 is added. In addition, the image data generation unit 207 may generate image data in which the stuffed toy 50 reacts with a randomly selected action when the person appearing together with the stuffed toy 50 in the imaging data changes.

In addition, in the above embodiment, the image data generating unit 207 generates image data that changes the state of the stuffed toy 50 based on image information included in the imaging data acquired by the imaging data acquiring unit 205, but is not limited to this. As an example, the image data generating unit 207 may generate image data that changes the state of the stuffed toy 50 based on other information included in the imaging data.

For example, when the imaging data acquired by the imaging data acquisition unit 205 is video data, the image data generation unit 207 may generate an image in which the state of the stuffed animal is changed based on the audio information included in the video data. As an example, when the audio information included in the imaging data is an up-tempo song, the imaging data acquisition unit 205 may generate an image in which the active movements of the stuffed animal 50 are added to match the music. Also, when the audio information included in the imaging data is a slow-tempo song, the imaging data acquisition unit 205 may generate an image in which the calm movements of the stuffed animal 50 are added to match the music.

The plush toy 50 may also be designed to respond to calls from people nearby as audio information. Specifically, the image data generating unit 207 may be designed to generate an image that changes the behavior of the plush toy 50 based on calls from people contained in the video data acquired by the imaging data acquiring unit 205. In this case, an image may be generated in which the plush toy 50 responds to specific words (for example, the name of the plush toy 50 that has been set in advance, or things that the plush toy 50 likes or dislikes). Also, an image may be generated in which the plush toy 50 responds in a different manner to calls from specific users.

The image data generating unit 207 may generate image data that changes the state of the stuffed toy 50 based on information that can be obtained from information other than the imaging data obtained by the imaging data obtaining unit 205. For example, the terminal device 10 may be equipped with a position information sensor. The position information sensor is a sensor that detects the position of the terminal device 10, and may be, for example, a GPS (Global Positioning System) module. The GPS module is realized as a receiving device used in a satellite positioning system. The satellite positioning system receives signals from at least three or four satellites, and detects the current position of the terminal device 10 in which the GPS module is mounted based on the received signals. The image data generating unit 207 may be configured to generate image data that adds a performance according to the position of the terminal device 10 obtained by the position information sensor.

The location information sensor may be provided in the stuffed toy 50. In this case, the stuffed toy 50 may include a communication IF 12, a memory 15, a processor 19, etc., and may be configured to transmit the current location of the stuffed toy 50 obtained by the location information sensor to the terminal device 10.

The image data generating unit 207 may also generate image data in which the state of the stuffed toy 50 is changed based on environmental information that can be acquired from sources other than the imaging data acquired by the imaging data acquiring unit 205. In this case, the terminal device 10 may acquire meteorological information for the location where the stuffed toy 50 is placed as the environmental information. That is, in the above embodiment, the environmental information is acquired from the image included in the imaging data acquired by the imaging data acquiring unit 205, but this is not limited to this example, and meteorological information may be acquired via a network or the like, and image data in which the state of the stuffed toy 50 is changed may be generated based on the meteorological information.

The image data generating unit 207 may generate image data in which the state of the stuffed toy 50 is changed based on date information as information other than the image included in the imaging data acquired by the imaging data acquiring unit 205. For example, the date on which the user purchased the stuffed toy 50 (hereinafter also referred to as the purchase date) and the like are stored in the stuffed toy database 182 and the like. The image data generating unit 207 may generate image data to which a special effect is added on a day when a predetermined number of days (for example, 100 days) have passed since the purchase date. As an example, image data to which an effect to celebrate the passing of an anniversary is added on a day when an anniversary such as one year, two years, or three years has passed since the purchase date may be generated. With such specifications, the user can feel a deeper attachment to the stuffed toy 50 as he continues to own it.

The image data generating unit 207 may also be configured to add new audio information when generating image data. In other words, in an event presentation when a condition event is satisfied, predetermined audio information may be added in conjunction with the generation of an image.

In the above embodiment, in the effect condition determination process (S320), multiple determination processes (S321 to S324) to determine whether or not a condition event has occurred are executed in series, but this is not limiting. For example, multiple determination processes to determine whether or not a condition event has occurred may be executed in parallel, and an effect may be applied according to the combination of condition events that have occurred.

In the above embodiment, the terminal device 10 has been described as a terminal realized by a smartphone or the like, but the present invention is not limited to this example. The terminal device 10 may be realized by installing software on a home PC or the like, and may be configured to accept operations of a mouse or the like.

In addition, the sharing of specific information via a communication line is mainly performed via a WAN such as the Internet, but between information processing devices, the sharing may be performed only via short-range wireless communication such as Bluetooth (registered trademark) and infrared communication without using a WAN.

In addition, in the above embodiment, an example of a form in which each function is provided by the terminal device 10 or the server 20 is described, but this is not limited to this form, and some or all of the functions may be provided by the terminal device 10, the server 20, or both the terminal device 10 and the server 20 in a form different from the above embodiment.

Furthermore, the present invention may be realized as a program that causes an information processing device to execute the functions of the terminal device 10 or server 20 described above, or as a non-transitory computer-readable recording medium that stores the program.

<Additional Notes>
The matters described in the above embodiments will be supplemented below.
(Appendix 1)
A computer having a processor,
A program that executes the steps of: accepting identification information for identifying each of a number of stuffed animals (excluding those having a driving mechanism for operating components) having substantially identical appearances (S100); acquiring image data of the stuffed animals captured by a user (S200); generating image data by processing the appearance of the stuffed animals in the image data acquired after accepting the identification information in accordance with the identification information (S300); and presenting the image data to the user (S400).
(Appendix 2)
The program according to claim 1, wherein the generating step generates image data showing different aspects for each individual stuffed animal.
(Appendix 3)
3. The program according to claim 1, wherein the generating step generates image data showing a behavior in accordance with a personality set for each individual.
(Appendix 4)
The program according to claim 2, wherein in the generating step, image data in which the behavior of the stuffed animal is changed is generated based on a combination of the identification information and information contained in the imaging data.
(Appendix 5)
The program according to claim 4, wherein in the generating step, image data in which the behavior of the stuffed animal is changed is generated based on a combination of the identification information and information regarding the image contained in the imaging data.
(Appendix 6)
The program according to claim 5, wherein in the generating step, image data in which the behavior of the stuffed animal is changed is generated based on a combination of the identification information and information regarding a person appearing with the stuffed animal in the image.
(Appendix 7)
The program described in Appendix 5, in which the generating step generates image data in which the appearance of the stuffed animal is changed based on a combination of the identification information and information regarding an object that appears together with the stuffed animal in the image.
(Appendix 8)
The program according to claim 4, wherein the acquiring step acquires video data of the stuffed animal.
(Appendix 9)
The program according to claim 8, wherein in the generating step, image data in which the behavior of the stuffed animal is changed is generated based on audio information contained in the video data.
(Appendix 10)
The program described in Appendix 1 further includes a step of acquiring environmental information of the location where the stuffed animal is placed, and in the generating step, image data that changes the appearance of the stuffed animal is generated based on a combination of the identification information and the acquired environmental information.
(Appendix 11)
The program according to claim 10, wherein in the step of acquiring environmental information, positional information of a location where the stuffed toy is placed is acquired as the environmental information.
(Appendix 12)
The program according to claim 10, wherein in the step of acquiring environmental information, meteorological information for a location where the stuffed animal is placed is acquired as the environmental information.
(Appendix 13)
2. The program of claim 1, further causing the computer to execute a step of communicating predetermined data regarding different stuffed toys.
(Appendix 14)
The program according to claim 13, further comprising a step of communicating, as the specified data, a history of association with a specified stuffed animal.
(Appendix 15)
The program according to claim 14, wherein in the generating step, when a history of association with a specific stuffed animal exceeds a specific condition, image data is generated in which the behavior of the stuffed animal is changed.
(Appendix 16)
14. The program according to claim 13, wherein the computer is a terminal device that can be operated by a user.
(Appendix 17)
The program of claim 13, further comprising causing a processor provided within the stuffed animal to execute a communication step.
(Appendix 18)
A program as described in appendix 1 to appendix 17, further causing the processor to execute the steps of storing historical information of the image data of the stuffed animal in a memory unit provided in the computer, and identifying individual stuffed animals in the image data based on the historical information without using identification information.

Although several embodiments of the present disclosure have been described above, these embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are considered to be within the scope of the invention and its equivalents as set forth in the claims, as well as within the scope and spirit of the invention.

1: System, 10: Terminal device, 13: Input device, 14: Output device, 15: Memory, 16: Storage, 19: Processor, 20: Server, 25: Memory, 26: Storage, 29: Processor, 30: Network, 51: Head, 52: Torso, 53: Eyes, 54: Mouth, 55: Ears, 56: Forelimbs, 57: Lower limbs, 58: Tail, 131: Touch-sensitive device, 141: Display, 150: Communication unit, 160: Imaging unit, 170: Audio processing unit, 171: Microphone, 172: Speaker, 180: Memory unit, 181: User database, 182: Database, 183: Personality database, 184: Event production database, 185: event-compatible database, 200: control unit, 201: operation reception unit, 202: transmission/reception unit, 203: display control unit, 204: identification information reception unit, 205: imaging data acquisition unit, 206: imaging data analysis unit, 207: image data generation unit, 210: communication unit, 220: memory unit, 221: user database, 222: database, 223: personality database, 224: event performance database, 225: event-compatible database, 226: standard image database, 227: history image database, 230: control unit, 231: transmission/reception module, 232: imaging data analysis module, 233: image data generation module.

Claims (21)

A computer having a processor,
A step of receiving identification information for identifying each of a plurality of stuffed toys having substantially the same appearance (excluding those having a drive mechanism for operating components);
Acquiring image data of the stuffed toy taken by a user;
A program that executes the steps of: generating image data by processing the appearance of the stuffed toy in the imaging data acquired after receiving the identification information in accordance with the identification information; and presenting the image data to the user. The program according to claim 1, wherein the generating step generates image data showing different aspects for each individual stuffed animal. The program according to claim 1 or 2, wherein the generating step generates image data showing a behavior according to a personality set for each individual. The program according to claim 2, wherein in the generating step, image data is generated that changes the state of the stuffed animal based on a combination of the identification information and information included in the imaging data. The program according to claim 4, wherein in the generating step, image data is generated that changes the state of the stuffed animal based on a combination of the identification information and information about the image included in the imaging data. The program according to claim 5, wherein in the generating step, image data is generated in which the state of the stuffed toy is changed based on a combination of the identification information and information about a person appearing with the stuffed toy in the image. The program according to claim 5, wherein in the generating step, image data is generated that changes the state of the stuffed animal based on a combination of the identification information and information about an object that appears together with the stuffed animal in the image. The program according to claim 4, wherein the acquiring step acquires video data of the stuffed toy. The program according to claim 8, wherein in the generating step, image data is generated that changes the state of the stuffed toy based on audio information included in the video data. The method further includes a step of acquiring environmental information about a location where the stuffed toy is placed,
The program according to claim 1 , wherein in the generating step, image data in which a state of the stuffed toy is changed is generated based on a combination of the identification information and the acquired environmental information. The program according to claim 10, wherein in the step of acquiring the environmental information, positional information of the location where the stuffed toy is placed is acquired as the environmental information. The program according to claim 10, wherein in the step of acquiring the environmental information, weather information for the location where the stuffed toy is placed is acquired as the environmental information. The program of claim 1, further causing the computer to execute a step of communicating predetermined data regarding different stuffed toys. The program according to claim 13, which executes a step of communicating a history of association with a specified stuffed animal as the specified data. The program according to claim 14, wherein in the generating step, when the history of association with a specific stuffed animal exceeds a specific condition, image data is generated that changes the state of the stuffed animal. The program according to claim 13, wherein the computer is a terminal device that can be operated by a user. The program according to claim 13, wherein the program causes a processor provided in the stuffed toy to execute the communicating step. The processor further comprises:
storing history information of the image data of the stuffed toy in a storage unit of the computer;
2. The program according to claim 1, further comprising: a step of identifying an individual stuffed toy in the image data based on the history information without using the identification information. A computer having a processor,
A step of receiving identification information for identifying each of a plurality of stuffed toys having substantially the same appearance (excluding those having a drive mechanism for operating components);
Acquiring image data of the stuffed toy taken by a user;
A method for executing a step of generating image data by processing the appearance of the stuffed toy in the imaging data acquired after receiving the identification information in accordance with the identification information, and a step of presenting the image data to the user. An information processing device including a processor,
The processor,
A step of receiving identification information for identifying each of a plurality of stuffed toys having substantially the same appearance (excluding those having a drive mechanism for operating components);
Acquiring image data of the stuffed toy taken by a user;
An information processing device that executes a step of generating image data by performing processing corresponding to the identification information on the state of the stuffed toy in the imaging data acquired after receiving the identification information; and a step of presenting the image data to the user. A system comprising a computer including a processor,
The processor,
A step of receiving identification information for identifying each of a plurality of stuffed toys having substantially the same appearance (excluding those having a drive mechanism for operating components);
Acquiring image data of the stuffed toy taken by a user;
The system executes a step of generating image data by processing the appearance of the stuffed animal in the imaging data acquired after receiving the identification information in accordance with the identification information, and a step of presenting the image data to the user.