TW201915814A - Expression recording system recording the predetermined expression of an infant seated in the stroller when the stroller is brought outdoors - Google Patents

Abstract

This invention relates to an expression recording system (1), which has a camera (3) mounted on a stroller (2) and a terminal device (4) held by a user of the stroller (2). The camera (3) may capture a camera image of an occupant of the stroller (2), and the terminal device (4) may communicate with the camera (3). When the terminal device (4) is input with the camera image captured by the camera (3), a predetermined expression of the occupant of the stroller (2) is detected from the camera image. When the predetermined expression is detected, a surrounding capturing request for capturing the camera image around the stroller (2) is sent to the camera (3). Accordingly, the predetermined expression of an infant seated in the stroller (2) can be recorded when the stroller (2) is brought outdoors.

Description

 Expression recording system  

The present invention relates to an expression recording system for recording a predetermined expression of an occupant of a baby carriage.

In the past, infants and toddlers used a stroller when they went out. The conventional stroller made a variety of ingenuity in order to make the infant sitting in the seat seat as comfortable as possible. For example, the seat portion in which the infant is seated is formed by a member having excellent cushioning properties, and the ride comfort is improved (see Patent Document 1).

In addition, in the past, a baby carriage that can enjoy the contents of video or music while riding a baby carriage is proposed in view of the fact that the baby carriage is a vehicle that the infant wants to actively ride (see Patent Document 2).

In the above-described conventional stroller, since a comfortable ride can be obtained, or contents such as images or music can be enjoyed, the baby in the stroller can enjoy the baby stroller and increase the chance of showing a smile. However, a system for storing smiles of infants and toddlers riding in the stroller in the record has not been proposed so far, and there is still room for development.

 [Previous Technical Literature]    [Patent Literature]  

Patent Document 1: Japanese Patent Laid-Open Publication No. 2004-216998

Patent Document 2: Japanese Patent Laid-Open Publication No. 2008-308053

The present invention has been accomplished in the context described above. It is an object of the present invention to provide an expression recording system that can record a predetermined expression of an infant seated in the stroller in the out of the stroller.

An aspect of the present invention is an expression recording system comprising: a camera mounted on a stroller to capture a camera image of an occupant of the stroller; and a terminal device by the stroller The user device can communicate with the camera; and the terminal device includes: a data input unit that inputs a camera image captured by the camera; and an expression detection unit that is determined from the camera image to the occupant of the baby carriage The expression is detected; and the surrounding shooting requesting unit sends a request for shooting around the camera image of the surrounding area of the stroller when the predetermined expression is detected.

Another aspect of the present invention is a baby carriage having a camera capable of capturing a camera image of an occupant, the camera being capable of communicating with a terminal device held by a user of the baby carriage, and the terminal device is disposed in the baby carriage When the occupant's established expression is detected from the camera image taken by the camera, the surrounding shooting request is sent to the camera, and the camera takes a camera image around the stroller according to the surrounding shooting requirements.

Another aspect of the present invention is a program that is executed by a terminal device held by a user of a stroller, and the terminal device can communicate with a camera mounted on the stroller, and the camera can photograph the occupant of the stroller. The camera image, the program causes the terminal device to perform the following processing: if the camera image captured by the camera is input, the predetermined expression of the occupant of the baby carriage is photographed from the camera image; and when the predetermined expression is detected , the camera sends a request for shooting around the image of the camera around the stroller.

Another aspect of the present invention is an expression recording system comprising: a camera mounted on a moving body, capable of capturing a camera image to an occupant of the moving body; and a terminal device by the user The terminal device is provided with: a data input unit that inputs a camera image captured by the camera; and an expression detection unit that detects the camera image of the intended expression of the occupant of the mobile body And the surrounding shooting requesting unit, when the detected expression is detected, sends a request for shooting around the camera image of the surrounding body of the moving body.

As explained below, the present invention has other aspects. Therefore, the disclosure of the present invention is intended to provide a part of the invention, and is not intended to limit the scope of the invention as claimed.

1‧‧‧Expression Recording System (Smile Recording System)

2‧‧‧ baby carriage

3‧‧‧ camera

4‧‧‧ Terminal devices

5‧‧‧arm

6‧‧‧ Seating Department

10‧‧‧Touch panel

11‧‧‧ Speaker

12‧‧‧ Storage Department

13‧‧‧Communication Department

14‧‧‧1st Control Department

140‧‧‧Data Input Department

141‧‧‧Expression Detection Department

142‧‧‧ Surrounding Shooting Requirements Department

143‧‧‧Display Processing Department

144‧‧‧Continue to shoot the requirements department

145‧‧‧Image Selection Department

15‧‧‧2nd Control Department

150‧‧‧Emotional Analysis Department

151‧‧‧Play Processing Department

152‧‧‧Location Acquisition Department

153‧‧ Record Processing Department

154‧‧‧Notice Processing Department

155‧‧‧ Directions to the Information Acquisition Department

156‧‧ Sight line direction detection processing unit

Fig. 1 is an explanatory diagram of an expression recording system (smile recording system) according to an embodiment of the present invention.

Figure 2 is a block diagram of a terminal device in accordance with an embodiment of the present invention.

Fig. 3 is an explanatory view showing the same screen display in the embodiment of the present invention.

Fig. 4 is an explanatory view showing a smile detection position display according to an embodiment of the present invention.

Fig. 5 is a flow chart showing the same screen display processing in the embodiment of the present invention.

Fig. 6 is a flow chart showing a smile image selection process in the embodiment of the present invention.

Fig. 7 is a flow chart showing the video and music playing process in the embodiment of the present invention.

Fig. 8 is a flowchart showing a smile detection position recording process and a proximity notification process according to an embodiment of the present invention.

Fig. 9 is a flow chart showing the line-of-sight direction detecting process in the embodiment of the present invention.

The detailed description of the invention is described below. However, the following detailed description and the accompanying drawings are not intended to limit the invention.

The expression recording system of the present invention is provided with a camera mounted on a stroller to capture a camera image of an occupant of the stroller, and a terminal device held by a user of the stroller for performing with the camera And the terminal device includes: a data input unit that inputs a camera image captured by the camera; an expression detection unit that detects a predetermined expression of the occupant of the baby carriage from the camera image; and a surrounding imaging request unit, When the detected expression is detected, the camera is asked to shoot around the camera image of the surrounding area of the stroller.

According to this configuration, it is possible to take a camera image to an occupant (for example, an infant or the like) while using the baby carriage. Moreover, for example, if the occupant of the stroller reveals a predetermined expression when passing through a certain place, the camera image around the stroller at the place will be photographed. Thereby, a camera image of a predetermined expression of the occupant of the baby carriage and a camera image surrounding the baby carriage including the cause of the occupant's intended expression (the occupant's favorite object, etc.) can be obtained.

Further, in the expression recording system of the present invention, the terminal device may further include a display processing unit that surrounds the camera image of the occupant when the predetermined expression is detected and when the predetermined expression is detected. The camera image is displayed on the same screen.

According to this configuration, it is possible to easily grasp the predetermined expression of the occupant of the baby carriage (for example, an infant or the like) on the same screen, and the corresponding factor of the occupant exposing the predetermined expression (the object that the occupant likes, etc.) .

Further, in the expression recording system of the present invention, the terminal device may further include: a continuous shooting requesting unit that transmits a continuous shooting of the camera image of the occupant who continues to the baby carriage while the predetermined expression is detected. And an image selection unit that selects a camera image having a predetermined expression level or more from a camera image of the occupant that continues to be captured.

With this configuration, while the occupant of the stroller (for example, an infant or the like) is exposed to a predetermined expression, the camera image (the camera image of the predetermined expression) is continuously continuously photographed to the occupant, and the predetermined expression is automatically selected therefrom. A higher degree camera image. Thereby, a camera image with a characteristic expression can be obtained.

Further, in the expression recording system of the present invention, the terminal device may further include: an emotion analysis unit that analyzes emotions of the occupant of the baby carriage from the camera image; and a playback processing unit that obtains the result based on the analysis result The occupant's emotions of the stroller play images or music.

With this configuration, the occupant's emotion is analyzed from the camera image of the occupant (for example, infant, etc.) of the baby carriage, so that the image or music corresponding to the emotion is automatically played. In this way, images or music that match the mood of the occupant can be played out of the stroller.

Further, in the expression recording system of the present invention, the terminal device may further include: a position information acquisition unit that acquires position information of the baby carriage from the camera; and a recording processing unit that detects the position of the baby carriage when the predetermined expression is detected The notification processing unit records the position of the expression detection unit; and the notification processing unit notifies the user of the baby carriage if the baby carriage approaches the expression detection position.

With this configuration, the position (expression detection position) at which the occupant of the stroller (e.g., infant, etc.) is exposed to the predetermined expression is recorded, and will be notified if the user approaches the location next time. Thereby, the user of the stroller can grasp the location where the occupant of the stroller reveals the intended expression (the place where the occupant likes it), and can know that the location is close to the location when the stroller is out.

Further, in the expression recording system of the present invention, the terminal device may further include: a direction direction information acquisition unit that acquires direction information of the baby carriage from the camera; and a line of sight direction detection processing unit that is detected to be determined The orientation of the stroller in the expression is detected as the direction of the occupant's line of sight.

According to this configuration, when the occupant of the stroller (for example, an infant or the like) is exposed with a predetermined expression, the occupant's line of sight direction (observation direction) can be known. Thereby, the object that the occupant likes can be specified.

The stroller of the present invention is provided with a camera that can capture a camera image of an occupant, and the camera can communicate with a terminal device held by a user of the stroller, and the camera device of the terminal device is taken from the camera by the occupant of the stroller. When a predetermined expression is detected, the surrounding shooting request is sent to the camera, and the camera takes a camera image around the stroller according to the surrounding shooting requirements.

In the same manner as the above-described system, the baby carriage can obtain the camera image of the errand of the occupant of the baby carriage, and the cause of the occupant's intended expression (the occupant's favorite object, etc.). Camera image around the stroller.

The program of the present invention is executed by a terminal device held by a user of the baby carriage, and the terminal device can communicate with a camera mounted on the stroller, and the camera can take a camera image of the occupant of the baby carriage. And the program causes the terminal device to perform the following processing: if the camera image captured by the camera is input, the predetermined expression of the occupant of the baby carriage is detected from the camera image; and when the predetermined expression is detected, the camera is sent Shooting requirements for shooting around the camera image around the stroller.

According to the program, a camera image of a predetermined expression of the occupant of the stroller and an infant including the occupant's intended expression (the occupant's favorite object, etc.) can be obtained in the same manner as the above-described system. Camera image around the car.

According to the present invention, the intended expression of the infant seated in the stroller can be recorded outside the stroller.

 (embodiment)  

The expression recording system according to the embodiment of the present invention will be described below using the drawings. In the present embodiment, a case where an expression recording system such as a baby carriage for infants is used is exemplified. The expression recording system is provided with a function of recording a predetermined expression of an infant who is riding on the baby carriage while using the baby carriage. Hereinafter, although an example of a predetermined expression is described as a case of "smiley face", other expressions such as "cry face", "angry face" or "funny face" can be similarly implemented.

The configuration of the expression recording system (smile face recording system) according to the embodiment of the present invention will be described with reference to the drawings. Fig. 1 is an explanatory view showing a schematic configuration of an expression recording system of the embodiment. As shown in FIG. 1, the expression recording system 1 includes a camera 3 attached to the stroller 2, and a terminal device 4 held by a user of the stroller 2. Further, the occupant of the stroller 2 is, for example, an infant, and the user of the stroller 2 is, for example, a guardian of an infant.

First, the configuration of the camera 3 will be described with reference to Fig. 1 . The camera 3 is attached to the stroller 2 in such a manner as to capture a camera image of the occupant of the stroller 2. The camera image can be either a still image or a moving image. For example, the camera 3 is attached to the arm 5 of the stroller 2 or the like in a state in which the photographing direction is directed toward the occupant of the stroller 2 (that is, in a state in which the arm 5 is directed inside). The arm 5 is configured, for example, in a circular arc shape or a bow shape, and is disposed so as to traverse the seat portion 6 of the stroller 2 (just before the occupant of the seat portion 6). Further, the camera 3 may be housed in the arm 5 or detachably attached to the arm 5.

Further, the camera 3 is configured to be capable of photographing the surroundings of the stroller 2. For example, the camera 3 is configured to be capable of photographing the periphery of the stroller 2 at a wide angle using a wide-angle lens. Alternatively, the camera 3 is configured to photograph the entire circumference of the stroller 2 using a 360-degree lens. Further, the camera 3 may be provided with a left-right rotation function or a vertical rotation function. In this case, the camera 3 is configured to image the periphery (or the entire circumference) of the stroller 2 by rotating the camera lens in the left-right direction or the up-and-down direction.

Further, the camera 3 is provided with a GPS that acquires position information (for example, longitude and latitude information) of the position of the camera 3 (the position of the baby carriage 2) by performing communication with a GPS (Global Position System) satellite. Features. Further, the camera 3 is provided with a gyro function for obtaining direction information (for example, orientation information) in which the direction of the camera 3 (the direction in which the baby carriage 2 is facing) is displayed. Further, the camera 3 is provided with a function of communicating with the terminal device 4 by wireless or wired. Therefore, the camera 3 can transmit the location information or the direction information to the terminal device 4 in addition to the captured camera image. Further, the camera 3 can receive a request signal such as a peripheral imaging request or a continuous imaging request, which will be described later, from the terminal device 4. Furthermore, the battery of the camera 3 can be provided either to the camera 3 itself or to the stroller 2.

Next, the configuration of the terminal device 4 will be described with reference to Fig. 2 . 2 is a block diagram for explaining the configuration of the terminal device 4. The terminal device 4 is, for example, a portable terminal device 4 such as a smart phone. As shown in FIG. 2 , the terminal device 4 includes a touch panel 10 , a speaker 11 , a storage unit 12 , a communication unit 13 , a first control unit 14 , and a second control unit 15 . Further, the first control unit 14 and the second control unit 15 may be constituted by one control unit.

The touch panel 10 also has a function of an input unit and a display unit. Therefore, the user of the terminal device 4 (user of the baby carriage 2) can input various information from the touch panel 10. Moreover, the touch panel 10 displays various information so that the user of the terminal device 4 (the user of the baby carriage 2) can confirm it. The speaker 11 is provided with a function of outputting an audio to a user of the terminal device 4 (a user of the baby carriage 2).

The storage unit 12 is constituted by a memory or the like, and can store various materials. For example, the storage unit 12 stores the data of the camera image captured by the camera 3. The storage unit 12 can also store information such as images or music. Further, a program for realizing various functions of the terminal device 4 (including an expression recording function) is stored in the storage unit 12. This can be achieved by executing various functions of the program terminal device 4.

The communication unit 13 has a function of communicating with an external device by wireless or wired. The external device also includes the aforementioned camera 3. Therefore, the communication unit 13 is provided with a function of communicating with the camera 3 by wireless or wired. The terminal device 4 can receive the above-mentioned position information or direction information from the camera 3 in addition to the captured camera image data. Further, the terminal device 4 can transmit a request signal for a peripheral imaging request or a continuous imaging request, which will be described later, to the camera 3. Furthermore, the communication method can be determined by a known method.

The first control unit 14 is a control unit for performing main control of the expression recording function, and includes a data input unit 140, an expression detecting unit 141, a peripheral imaging requesting unit 142, a display processing unit 143, a continuous imaging requesting unit 144, and Image selection unit 145.

The data input unit 140 has a function of inputting an input interface for various data input in order to realize the expression recording function. For example, a camera image taken by the camera 3 (for example, a camera image of an occupant of the stroller 2) is input to the material input unit 140. The expression detecting unit 141 has a function of detecting a predetermined expression of the occupant of the baby carriage 2 from the camera image input to the material input unit 140. For example, the expression detecting unit 141 can detect the smiling face of the occupant of the baby carriage 2 by performing image processing for smiling face detection on the camera image. Furthermore, the method of smile detection can be carried out by a known method. Similarly, for the detection of other established expressions (such as crying face detection, angry face detection, funny face detection, etc.), a well-known method can also be used.

When the expression detecting unit 141 detects the smiling face of the occupant of the baby carriage 2 from the camera image, the surrounding image capturing request unit 142 transmits a function to the camera 3 to photograph the surrounding image of the camera image around the baby carriage 2 . The surrounding shooting request is transmitted from the terminal device 4 toward the camera 3 via the communication unit 13. Upon receiving the surrounding shooting request, the camera 3 takes a camera image around the stroller 2 and returns the camera image (the camera image around the stroller 2) toward the terminal device 4.

The display processing unit 143 has a function of displaying the camera image (the camera image around the baby carriage 2) on the same screen as the camera image of the occupant when the smile is detected. Fig. 3 is an explanatory view showing an example of the same screen display. As shown in FIG. 3, the display processing unit 143 displays the camera image of the occupant when the smile is detected and the camera image around the baby carriage 2 on the same screen. Furthermore, in the example of FIG. 3, the camera image of the occupant when the smile is detected and the camera image around the baby carriage 2 are displayed up and down, but as long as they are on the same screen, Arrange other methods such as left and right. Further, the display processing unit 143 may be provided with a function of connecting a continued camera image and playing (displaying) it as an animation. In this case, the animation generated by the camera image of the occupant when the smile is detected and the animation generated by the camera image around the baby carriage 2 can be displayed on the same screen.

The continuation shooting requesting unit 144 transmits the function of continuing the shooting request for the camera image of the occupant of the baby carriage 2 to the camera 3 while the expression detecting unit 141 detects the smiling face of the occupant of the baby carriage 2 from the camera image. . The continued shooting request is transmitted from the terminal device 4 to the camera 3 via the communication unit 13. When the camera 3 receives the request to continue shooting, the camera 3 continues to take a camera image of the occupant of the stroller 2. The plurality of camera images thus captured (the camera image of the smiling face of the occupant who continues to be photographed) are returned from the camera 3 toward the direction terminal device 4.

The image selection unit 145 has a function of selecting a camera image having a smile degree equal to or greater than a predetermined value from among a plurality of camera images (a camera image of a smile of the occupant who continues to photograph). For example, the image selecting unit 145 detects a smiling face from a plurality of camera images, and calculates a smiling degree for each of the detected smiling faces. Then, the image selection unit 145 selects one of the camera images having the highest smile degree from the camera image whose smile degree is equal to or greater than the predetermined value. Furthermore, as long as the smile degree is a camera image of a predetermined value or more, a plurality of camera images may be selected. Further, as for the calculation of the smile degree, a known method can be used. Similarly, calculations regarding the degree of other established expressions (such as crying, angry face, funny face, etc.) can also be made using well-known methods.

The second control unit 15 is a control unit for performing sub-control of the expression recording function, and includes an emotion analysis unit 150, a playback processing unit 151, a position acquisition unit 152, a recording processing unit 153, a notification processing unit 154, and a direction in which it is directed. The information acquisition unit 155 and the line-of-sight direction detection processing unit 156.

The emotion analysis unit 150 has a function of analyzing the emotion of the occupant of the baby carriage 2 from the camera image captured by the camera 3 (the camera image of the occupant of the baby carriage 2). For example, the emotion analysis unit 150 may analyze the emotions of the occupant of the baby carriage 2 from the camera image (the camera image of the occupant of the baby carriage 2) as "hi", "angry", "sorrow", "music". Which one of them. Furthermore, the method of emotional analysis can be performed by a known method.

The playback processing unit 151 has a function of playing back video or music based on the analysis result of the emotion analysis unit 150 (the emotion of the occupant of the baby carriage 2 obtained as a result of the analysis). For example, if the emotion of the occupant of the baby carriage 2 obtained by the analysis result is "hi" or "music", the playback processing unit 151 plays an image or music with a cheerful atmosphere, and the occupant of the baby carriage 2 obtained by the analysis result. The emotion is "anger" or "sorrow", and it plays a heavy image or music.

The position acquisition unit 152 has a function of acquiring position information of the baby carriage 2 . For example, the location acquisition unit 152 has a GPS function of acquiring current location information (for example, longitude and latitude information) of the terminal device 4. The location acquisition unit 152 acquires the location information of the terminal device 4 as the location information of the baby carriage 2. Further, as described above, since the camera 3 has a GPS function for obtaining position information (for example, longitude and latitude information) indicating the current position of the camera 3, the position obtaining unit 152 can also acquire the position information of the camera 3 from the camera 3 as the position information. Location information of the stroller 2 (location information of the stroller 2 of the camera 3 is installed).

The recording processing unit 153 has a function of recording the position (for example, latitude and longitude) of the stroller 2 when the expression detecting unit 141 detects the smiling face of the occupant of the stroller 2 from the camera image as the smiling position. The information of the smile detection position is recorded in the storage unit 12. Further, in the storage unit 12, the smile detection position of the other user (the position where the smile of the occupant of the other baby carriage 2 is detected) may be stored.

The notification processing unit 154 has a function of notifying the user of the baby carriage 2 when the baby carriage 2 approaches the smile detection position. The notification processing unit 154 notifies the user of the baby carriage 2 when the current position of the baby carriage 2 (obtained by the position acquisition unit 152 from the camera 3) approaches the smile detection position (stored in the storage unit 12). For example, if a user enters a circular area having a predetermined radius centered on the smile detection position, the user of the baby carriage 2 is notified. The notification of the user of the stroller 2 can be performed by a known method such as sound, light, or vibration. Further, the notification processing unit 154 may have a function of notifying the user of the baby carriage 2 of the result of the analysis by the emotion analysis unit 150 (the emotion of the occupant of the baby carriage 2 obtained as a result of the analysis). For example, the notification processing unit 154 may notify the nearest smile detection position when the emotion of the occupant of the baby carriage 2 obtained by the analysis result is "anger" or "sad". The notification of the user of the baby carriage 2 can be performed, for example, using the touch panel 10 (notification by screen display) or the speaker 11 (notification by audio).

The direction direction information acquisition unit 155 has a function of detecting the direction in which the baby carriage 2 is directed. As described above, the camera 3 has a gyro function for obtaining information (for example, orientation information) in which the camera 3 is now oriented, and the direction information obtaining unit 155 acquires the direction information of the camera 3 from the camera 3 as the direction information. The direction of the stroller 2 (the direction in which the stroller 2 of the camera 3 is mounted).

The line-of-sight direction detection processing unit 156 has a direction in which the baby carriage 2 faces when the smile of the occupant of the baby carriage 2 is detected from the camera image by the expression detecting unit 141, and serves as the line of sight of the occupant of the baby carriage 2 ( For example, the function of detecting the east, west, north, and the like. Furthermore, the method of detecting the line of sight direction can be carried out by a known method. For example, it is also possible to focus on the part of the eye in the camera image of the occupant of the stroller 2, perform image analysis, etc., to calculate the direction of the occupant's line of sight, and to direction the stroller 2 at that point in time (traveling) The direction is taken into consideration, and the direction of the line of sight of the stroller 2 (for example, east, west, north, and the like) is detected. The information of the detected line of sight direction is stored in the storage unit 12.

Furthermore, the display processing unit 143 can also display the smile detection position on the map. Fig. 4 is an explanatory diagram showing an example of a smile detection position display. In the example of Fig. 4, the smile detection position is displayed on the map as a "smile face mark". Further, in Fig. 4, the position of the stroller 2 is now indicated by a circular mark, and the direction (direction of travel) of the stroller 2 is indicated by a triangular sign. In the example of Fig. 4, the direction of the stroller 2 is on the map to the right.

Regarding the expression recording system 1 configured as above, the operation will be described below with reference to the flowcharts of FIGS. 5 to 9.

Fig. 5 is a flow chart showing the same screen display processing in the expression recording system 1 of the embodiment. In the terminal device 4, the camera image (moving image) of the occupant of the stroller 2 photographed by the camera 3 is often displayed in an instant view. When the terminal device 4 performs the same screen display processing, as shown in FIG. 5, first, the camera image is input from the camera 3 to the terminal device 4 (S10), and the camera image from the input is executed to the baby carriage. The smile of the occupant of 2 is processed (S11).

Then, when the smile of the occupant of the stroller 2 is detected from the camera image (S12), the surrounding photographing request is transmitted from the terminal device 4 to the camera 3 (S13), and the photograph is taken according to the surrounding photographing request. The camera image around the stroller 2 is taken by the camera 3. When the camera image around the baby carriage 2 thus captured is input to the terminal device 4 (S14), the camera image of the occupant of the baby carriage 2 (the camera image of the smiling face) and the smiling face when the smiling face is detected The camera image around the stroller 2 when detected is displayed on the same screen (S15).

Fig. 6 is a flow chart showing the smile image selection processing of the expression recording system 1 of the embodiment. As shown in FIG. 6, when the terminal device 4 performs the smile image selection processing, first, the camera image is input from the camera 3 to the terminal device 4 (S20), and the camera image is input from the baby to the baby. The smile of the occupant of the car 2 is processed (S21).

Then, when the smile of the occupant of the stroller 2 is detected from the camera image (S22), the contingency request is repeated from the terminal device 4 to the camera 3 (S23), and the occupant of the baby carriage 2 is repeated. Shooting of the camera image (camera image of a smiley face). Further, if the smiling face of the occupant of the stroller 2 is not detected from the camera image (S22), the selection of one of the camera images (the camera image of the smiling face) from the captured camera image is set to a predetermined value or more and the smiling face is continued. The largest camera image (S24). Furthermore, as long as the smile degree is a camera image of a predetermined value or more, a plurality of camera images may be selected.

Fig. 7 is a flow chart showing the image and music playback processing of the expression recording system 1 of the embodiment. As shown in FIG. 7, when the video and music playback processing is performed by the terminal device 4, if the camera image is input from the camera 3 to the terminal device 4 (S30), the occupant's emotion of the baby carriage 2 (for example, "Hi" ", "angry", "sorrow", "music") are analyzed from the camera image (S31). Then, an image or music (S32) corresponding to the mood of the occupant of the stroller 2 is played. For example, when the emotion of the occupant of the baby carriage 2 is analyzed as "hi" or "music", a cheerful image or music is played. On the other hand, when the emotion of the occupant of the stroller 2 is analyzed as "anger" or "sad", the image or music with a heavy atmosphere is played.

Fig. 8 is a flowchart showing the smile detection position recording processing and the approach notification processing of the expression recording system 1 of the embodiment. As shown in FIG. 8, when the terminal device 4 performs the smile detection position recording processing and the proximity notification processing, first, when the camera image is input from the camera 3, the position information of the camera 3 is acquired from the camera 3 (infant Location information of car 2) (S40). Then, if the smiling face of the occupant of the baby carriage 2 is detected from the input camera image (S41), the position of the baby carriage 2 at that time is recorded as the smile detection position in the storage unit 12 (S42).

Thereafter, (for example, when the baby carriage 2 goes out next time, etc.), when the camera image is input from the camera 3, the position information of the camera 3 (position information of the stroller 2) is acquired (S43), and the baby carriage is The position of 2 is compared with the recorded smile detection position, and if it is determined that the baby carriage 2 is close to the smile detection position (for example, within a predetermined radius of the smile detection position) (S44), the user of the baby carriage 2 is notified of the content (S45). ).

Fig. 9 is a flow chart showing the line-of-sight direction detecting process of the expression recording system 1 of the embodiment. As shown in FIG. 9, when the terminal device 4 performs the line-of-sight direction detecting process, first, when the camera image is input from the camera 3, the direction information of the baby carriage 2 is acquired from the camera 3 (S50). Then, if the smiling face of the occupant of the stroller 2 is detected from the input camera image (S51), the direction of the baby carriage 2 at that time is taken as the line of sight direction of the occupant of the stroller 2 (S52). The detected direction is recorded in the storage unit 12 (S53).

According to the expression recording system 1 of the present embodiment, the smiling face of the infant who is riding on the stroller 2 can be recorded outside the stroller 2.

That is, in the present embodiment, a camera image can be taken for an occupant (for example, an infant or the like) outside the stroller 2. Further, for example, if the occupant of the stroller 2 reveals a smiling face through a certain place, a camera image is taken around the stroller 2 at the place. Thereby, the camera image of the smiling face of the occupant of the baby carriage 2 and the camera image of the surroundings of the baby carriage 2 including the cause of the smile of the occupant (the object that the occupant likes, etc.) are obtained.

Further, in the present embodiment, the smile of the occupant of the baby carriage 2 (for example, an infant or the like) and the factor of the occupant's smile (the object of the occupant's favorite object) can be easily grasped on the same screen. Correspondence.

Further, in the present embodiment, while the occupant (for example, an infant or the like) of the stroller 2 is exposed to the smiling face, the camera image (the camera image of the smiling face) is continuously continuously photographed to the occupant, and the camera image can be automatically automatically taken therefrom. Choose a camera image with a higher smile (more smile). Thereby, a camera image of a preferred smile can be obtained.

Further, in the present embodiment, the emotion of the occupant (e.g., infant, etc.) of the stroller 2 can be analyzed from the camera image of the occupant, and the image or music corresponding to the emotion is automatically played. Thereby, an image or music that matches the mood of the occupant can be played out of the stroller 2.

Further, in the present embodiment, the position where the occupant (for example, an infant or the like) of the stroller 2 is exposed (smiling face detection position) is recorded, and the user is notified when the location is approached next time. Thereby, the user of the stroller 2 can grasp the location where the occupant of the stroller 2 reveals a smile (the place where the occupant likes it), and can know the content when the baby stroller 2 is out of the place.

Further, in the present embodiment, when the occupant (for example, an infant or the like) of the stroller 2 is exposed, the occupant's line of sight direction (observation direction) can be known. Thereby, the object that the occupant likes can be specified.

The embodiments of the present invention have been described above by way of examples, and the scope of the present invention is not limited thereto, and may be changed or modified depending on the purpose within the scope of the claims.

For example, in the above-described embodiment, an example in which the camera 3 is attached to the stroller 2 has been described, but the scope of the present invention is not limited thereto. The camera 3 can also be mounted, for example, in a child car seat provided in a seat of a moving body such as a car. Furthermore, in the case where the child car seat does not have a member equivalent to the arm 5 of the stroller 2, the camera 3 can be placed at an appropriate position outside the child car seat (for example, the top wall of the car, the back of the front seat) , the inner surface of the pillar, the upper surface of the console panel, etc.).

Moreover, the number of cameras 3 is not limited to one. In particular, when the camera 3 is installed in a car, in addition to a camera (in-vehicle camera) for taking a camera image to an occupant's expression (smile), a camera that captures a camera image around the vehicle may be used ( Camera outside the car). Further, each of the in-vehicle camera or the outside camera may use a plurality of cameras 3, respectively.

Thereby, a camera image can be taken for an occupant (for example, an infant or the like) sitting in a child car seat in the out of the car. Moreover, for example, if an occupant reveals a smile when passing a certain place, the camera images around the vehicle at the place are all photographed. Thereby, the camera image of the smiling face of the occupant and the camera image around the vehicle including the cause of the occupant's smiling face (the object that the occupant likes, etc.) are obtained.

While the preferred embodiments of the present invention have been described in the foregoing, it is understood that the invention may be variously modified, and the present invention is intended to be included in the scope of the appended claims. The true theme and all the changes within the scope.

 (industrial availability)  

As described above, the expression recording system of the present invention has an effect of recording a smiling face of an infant seated in the baby carriage outside the stroller, and can be applied to a baby carriage for infants and the like, and is industrially available. Utilization.

Claims (9)

 An expression recording system comprising: a camera mounted on a stroller for capturing a camera image of an occupant of the stroller; and a terminal device held by a user of the stroller And communicating with the camera; the terminal device includes: a data input unit that inputs the camera image captured by the camera; and an expression detection unit that reads the camera image from the occupant of the baby carriage The predetermined expression is detected; and the surrounding imaging requesting unit is detected at the predetermined expression, and the imaging request for the surrounding camera image of the surrounding of the baby carriage is transmitted to the camera.    The expression recording system of claim 1, wherein the terminal device includes a display processing unit that detects a camera image of the occupant when the predetermined expression is detected and when the predetermined expression is detected The camera images around the above are displayed on the same screen.    The expression recording system of claim 1 or 2, wherein the terminal device includes: a continuous shooting requesting unit that transmits a camera image to the occupant of the baby carriage while the camera is detected while the predetermined expression is being detected And an image selection unit that selects a camera image having a predetermined expression level or more from a camera image of the occupant that is continuously photographed.    The expression recording system according to any one of claims 1 to 3, wherein the terminal device includes: an emotion analysis unit that analyzes emotions of the occupant of the baby carriage from the camera image; and a playback processing unit And playing an image or music corresponding to the emotion of the occupant of the baby carriage according to the obtained analysis result.    The expression recording system according to any one of claims 1 to 4, wherein the terminal device includes: a position information acquisition unit that acquires position information of the stroller; and a recording processing unit that detects the predetermined expression The position of the baby carriage is recorded as an expression detection position; and the notification processing unit notifies the user of the baby carriage when the baby carriage approaches the expression detection position.    The expression recording system according to any one of claims 1 to 5, wherein the terminal device includes: a direction direction information acquisition unit that acquires direction information of the baby carriage from the camera; and a line of sight direction detection processing unit The direction of the stroller in which the predetermined expression is detected is detected as the line of sight of the occupant.    A baby carriage having a camera capable of capturing a camera image of an occupant, wherein the camera is communicable with a terminal device held by a user of the baby carriage, and the terminal device detects the baby When the occupant of the vehicle has the predetermined expression from the camera image captured by the camera, the camera sends a surrounding shooting request to the camera, and the camera captures a camera image around the baby carriage according to the surrounding shooting request.    A program that is executed by a terminal device held by a user of a baby carriage, wherein the terminal device can communicate with a camera mounted on the baby carriage, and the camera can capture an occupant of the baby carriage a camera image, the program causing the terminal device to perform a process of detecting an established expression of the occupant of the baby carriage from the camera image if the camera image captured by the camera is input; and When the predetermined expression is detected, a request for imaging around the camera image of the surrounding baby carriage is transmitted to the camera.    An expression recording system comprising: a camera mounted on a moving body to capture a camera image of an occupant of the moving body; and a terminal device held by a user and capable of The terminal device includes: a data input unit that inputs the camera image captured by the camera; and an expression detecting unit that detects an intended expression of the occupant of the mobile body from the camera image And a surrounding imaging requesting unit that transmits a peripheral imaging request for the surrounding camera image of the moving body to the camera when the predetermined expression is detected.