WO2019058496A1 - Système d'enregistrement d'expression - Google Patents

Système d'enregistrement d'expression Download PDF

Info

Publication number
WO2019058496A1
WO2019058496A1 PCT/JP2017/034248 JP2017034248W WO2019058496A1 WO 2019058496 A1 WO2019058496 A1 WO 2019058496A1 JP 2017034248 W JP2017034248 W JP 2017034248W WO 2019058496 A1 WO2019058496 A1 WO 2019058496A1
Authority
WO
WIPO (PCT)
Prior art keywords
stroller
camera
camera image
terminal device
passenger
Prior art date
Application number
PCT/JP2017/034248
Other languages
English (en)
Japanese (ja)
Inventor
卓也 武本
維摩 眞貝
俊輔 横尾
泰漢 星野
昌宏 暮橋
Original Assignee
株式会社電通
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社電通 filed Critical 株式会社電通
Priority to PCT/JP2017/034248 priority Critical patent/WO2019058496A1/fr
Priority to CN201780094857.6A priority patent/CN111133752B/zh
Publication of WO2019058496A1 publication Critical patent/WO2019058496A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62B—HAND-PROPELLED VEHICLES, e.g. HAND CARTS OR PERAMBULATORS; SLEDGES
    • B62B9/00—Accessories or details specially adapted for children's carriages or perambulators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to an expression recording system for recording a specific expression of a passenger of a stroller.
  • a stroller has been used conventionally when taking an infant with you.
  • various devices have been made so that an infant seated on a seat can spend comfortably.
  • improvement in riding comfort is achieved by forming a seat on which an infant is seated by a member having excellent cushioning properties (see Patent Document 1).
  • An object of the present invention is to provide a facial expression recording system capable of recording a specific facial expression of an infant riding on the stroller while going out in the stroller.
  • One aspect of the present invention is a facial expression recording system, the facial expression recording system being attached to a stroller, being able to capture a camera image of a passenger of the stroller, carried by a user of the stroller, and communicating with the camera And a data input unit to which a camera image taken by a camera is input; an expression detection unit for detecting a specific expression of a passenger of a stroller from the camera image; And an ambient imaging request unit for sending an ambient imaging request for imaging a camera image around the stroller to the camera when the facial expression of is detected.
  • FIG. 1 Another aspect of the present invention is a stroller, the stroller comprising a camera capable of capturing a camera image of a passenger, the camera being capable of communicating with a terminal device carried by a user of the stroller
  • the terminal device sends an ambient imaging request to the camera when a specific expression of the passenger of the stroller is detected from the camera image captured by the camera, and the camera detects the stroller based on the ambient imaging request. Take a camera image around you.
  • Another aspect of the present invention is a program, which is a program executed by a terminal carried by a stroller user, the terminal being capable of communicating with a camera attached to the stroller
  • the camera is capable of capturing a camera image of a passenger of the stroller
  • the program when the camera image captured by the camera is input to the terminal device, determines from the camera image a specific expression of the passenger of the stroller.
  • a process of detecting and a process of sending an ambient shooting request for shooting a camera image around a stroller to a camera when a specific expression is detected are executed.
  • Another aspect of the present invention is a facial expression recording system, the facial expression recording system being attached to a mobile body, being capable of capturing a camera image of a passenger of the mobile body, carried by a user, and communicating with the camera And a data input unit to which a camera image taken by a camera is input, and a facial expression detection unit for detecting a specific facial expression of a passenger of a moving object from the camera image; And an ambient imaging request unit for sending an ambient imaging request for imaging a camera image around the moving object to the camera when a specific facial expression is detected.
  • FIG. 1 is an explanatory view of a facial expression recording system (smile recording system) according to an embodiment of the present invention.
  • FIG. 2 is a block diagram of a terminal according to an embodiment of the present invention.
  • FIG. 3 is an explanatory view of the same screen display in the embodiment of the present invention.
  • FIG. 4 is an explanatory view of smile detection position display in the embodiment of the present invention.
  • FIG. 5 is a flowchart of the same screen display processing in the embodiment of the present invention.
  • FIG. 6 is a flowchart of smile image selection processing according to the embodiment of this invention.
  • FIG. 7 is a flowchart of video / music reproduction processing according to the embodiment of the present invention.
  • FIG. 8 is a flowchart of smile detection position recording processing / approach notification processing according to the embodiment of this invention.
  • FIG. 9 is a flowchart of gaze direction detection processing in the embodiment of the present invention.
  • the facial expression recording system includes a camera attached to a stroller and capable of capturing a camera image of a passenger of the stroller, and a terminal device carried by a user of the stroller and capable of communicating with the camera.
  • an ambient imaging request unit for sending an ambient imaging request for imaging a camera image around the stroller.
  • a camera image of a passenger for example, a baby etc.
  • a camera image around the stroller at that point is taken.
  • a camera image of the surroundings of the stroller including a factor (such as a favorite object of the passenger) that the passenger has turned into a specific expression is obtained.
  • the terminal device displays on the same screen the camera image of the passenger when the specific facial expression is detected and the surrounding camera image when the specific facial expression is detected. You may provide the display process part to display.
  • the terminal device transmits the continuous imaging request to continuously capture the camera image of the passenger of the stroller to the camera while the specific facial expression is detected.
  • the image processing apparatus may further include: a unit, and an image selection unit configured to select a camera image of which the degree of a specific facial expression is equal to or more than a predetermined value from among camera images of a passenger taken continuously.
  • the camera image of the passenger (the camera image of the specific expression) is continuously taken, and from among them, the specific A camera image with a high degree of expression is automatically selected. This makes it possible to obtain a camera image of a characteristic expression.
  • the terminal device analyzes the emotion of the passenger of the stroller from the camera image, and the video or music according to the emotion of the passenger of the stroller obtained as the analysis result. And a reproduction processing unit that reproduces the information.
  • the emotion of the passenger of the stroller (for example, an infant or the like) is analyzed from the camera image of the passenger and video and music corresponding to the emotion are automatically reproduced. Thereby, it is possible to produce a video and music according to the emotions of the rider while going out in the stroller.
  • the terminal device records, as a facial expression detection position, a position information acquisition unit that acquires positional information of the stroller from the camera and a position of the stroller when a specific facial expression is detected.
  • the processing unit may include a notification processing unit that notifies a user of the stroller when the stroller approaches the facial expression detection position.
  • the position (expression detection position) at which the rider (for example, a baby or the like) of the stroller becomes a specific expression is recorded, and the user is notified when the position is next approached.
  • This allows the stroller user to know the point at which the rider of the stroller makes a specific expression (the favorite spot of the rider), and when the user approaches that point while going out with the stroller You can know
  • the terminal device uses the direction information acquisition unit for acquiring the direction information of the stroller from the camera and the direction of the stroller when the specific facial expression is detected as the line of sight of the rider. And a gaze direction detection processing unit for detecting.
  • the stroller according to the present invention is a stroller provided with a camera capable of capturing a camera image of a passenger, wherein the camera is capable of communicating with a terminal device carried by the user of the stroller, and the terminal device is captured by the camera
  • a specific expression of the stroller occupant is detected from the camera image
  • an ambient imaging request is sent to the camera, and the camera captures a camera image around the stroller based on the ambient imaging request.
  • this stroller also includes a camera image of a specific expression of the passenger of the stroller and a factor (specific object of the passenger's favorite object, etc.) of the specific expression of the passenger. Camera images around the stroller can be obtained.
  • the program of the present invention is a program executed by a terminal device carried by the user of the stroller, the terminal device being capable of communicating with a camera attached to the stroller, the camera being a camera of a passenger of the stroller An image can be taken, and when the camera image taken by the camera is input to the terminal device, the program detects the specific expression of the passenger of the stroller from the camera image and detects the specific expression. And a process of sending an ambient shooting request for shooting a camera image around the stroller to the camera.
  • a camera image of a specific expression of the passenger of the stroller and a factor (specific object of the passenger's favorite object, etc.) of the specific expression of the passenger are included. Camera images around the stroller can be obtained.
  • a facial expression recording system according to an embodiment of the present invention will be described using the drawings.
  • This facial expression recording system has a function of recording a specific facial expression of an infant riding on the stroller while going out in the stroller.
  • "smile” is illustrated and explained as an example of a specific facial expression below, it can implement similarly about other facial expressions, such as a "cry face", an anger face, and a funny face.
  • FIG. 1 is an explanatory view showing a schematic configuration of the facial expression recording system according to the present embodiment.
  • the facial expression recording system 1 includes a camera 3 attached to the stroller 2 and a terminal device 4 carried by a user of the stroller 2.
  • the passenger of the stroller 2 is, for example, an infant
  • the user of the stroller 2 is, for example, a guardian of the infant.
  • the camera 3 is attached to the stroller 2 so as to be able to capture a camera image of a passenger of the stroller 2.
  • the camera image may be a still image or a moving image.
  • the camera 3 is attached to the arm 5 or the like of the stroller 2 in a state where the photographing direction is directed to the rider of the stroller 2 (that is, the state of being directed to the inside of the arm 5).
  • the arm 5 is configured, for example, in an arc shape or an arch shape, and is disposed to cross the front of the seat 6 of the stroller 2 (the front of the passenger seated on the seat 6).
  • the camera 3 may be incorporated in the arm 5 or may be detachably attached to the arm 5.
  • the camera 3 is configured to be able to photograph around the stroller 2.
  • the camera 3 is configured to be able to capture a wide area around the stroller 2 using a wide angle lens.
  • the camera 3 is configured to be able to capture the entire circumference of the stroller 2 using a 360 degree lens.
  • the camera 3 may also have a pan function and a tilt function. In that case, the camera 3 is configured to be able to capture the periphery (or the entire periphery) of the stroller 2 by rotating the camera lens in the pan direction or the tilt direction.
  • the camera 3 has a GPS function of acquiring position information (for example, longitude and latitude information) indicating the current position of the camera 3 (position of the stroller 2) by communicating with GPS satellites.
  • the camera 3 is equipped with the gyro function which acquires direction information (for example, direction information) which shows the direction (direction of the stroller 2) of the camera 3 at present.
  • the camera 3 also has a function of communicating with the terminal device 4 wirelessly or by wire. Therefore, the camera 3 can transmit the position information and the direction information to the terminal device 4 in addition to the data of the captured camera image. Further, the camera 3 can receive from the terminal device 4 request signals such as an ambient imaging request and a continuous imaging request, which will be described later.
  • the battery of the camera 3 may be provided in the camera 3 itself or in the stroller 2.
  • FIG. 2 is a block diagram for explaining the configuration of the terminal device 4.
  • the terminal device 4 is, for example, a portable terminal device 4 such as a smartphone.
  • the terminal device 4 includes a touch panel 10, a speaker 11, a storage unit 12, a communication unit 13, a first control unit 14, and a second control unit 15.
  • the first control unit 14 and the second control unit 15 may be configured by one control unit.
  • the touch panel 10 has the functions of an input unit and a display unit. Therefore, the user of the terminal device 4 (the user of the stroller 2) can input various information from the touch panel 10. Further, various information is displayed on the touch panel 10 so that the user of the terminal device 4 (the user of the stroller 2) can confirm.
  • the speaker 11 has a function of outputting a voice to a user of the terminal device 4 (a user of the stroller 2).
  • the storage unit 12 is configured by a memory or the like, and can store various data. For example, data of a camera image captured by the camera 3 is stored in the storage unit 12.
  • the storage unit 12 may store data such as video and music.
  • the storage unit 12 also stores programs for realizing various functions (including an expression recording function) of the terminal device 4. It can be said that various functions of the terminal device 4 are realized by executing this program.
  • the communication unit 13 has a function of communicating with an external device wirelessly or by wire.
  • the external device also includes the camera 3 described above. Therefore, the communication unit 13 has a function of wirelessly or wiredly communicating with the camera 3, and the terminal device 4 receives from the camera 3 the position information and the direction information described above in addition to the data of the photographed camera image. can do.
  • the terminal device 4 can transmit, to the camera 3, request signals such as an ambient imaging request and a continuous imaging request, which will be described later.
  • a communication system can utilize a well-known system.
  • the first control unit 14 is a control unit for performing main control related to the facial expression recording function, and the data input unit 140, the facial expression detection unit 141, the surrounding photographing request unit 142, the display processing unit 143, the continuous photographing request unit 144, and the image A selection unit 145 is provided.
  • the data input unit 140 has a function as an input interface to which various data are input in order to realize the facial expression recording function.
  • a camera image for example, a camera image of a passenger of the stroller 2 captured by the camera 3 is input to the data input unit 140.
  • the facial expression detection unit 141 has a function of detecting a specific facial expression of a rider of the stroller 2 from the camera image input to the data input unit 140.
  • the facial expression detection unit 141 can detect the smile of the rider of the stroller 2 by performing image processing for smile detection on the camera image.
  • the method of a smile detection can utilize a well-known method.
  • known methods can be used for detection of other specific expressions (for example, cry face detection, angry face detection, face change detection, etc.).
  • the ambient shooting request unit 142 has a function of sending a ambient shooting request for shooting a camera image around the stroller 2 to the camera 3 when the facial expression detection unit 141 detects the smile of the passenger of the stroller 2 from the camera image. Is equipped.
  • the ambient imaging request is transmitted from the terminal device 4 to the camera 3 via the communication unit 13.
  • the camera 3 captures a camera image around the stroller 2 and returns the camera image (a camera image around the stroller 2) to the terminal device 4.
  • the display processing unit 143 has a function of displaying the camera image (camera image around the stroller 2) on the same screen along with the camera image of the passenger when the smile is detected.
  • FIG. 3 is an explanatory view showing an example of the same screen display.
  • the display processing unit 143 displays the camera image of the passenger when the smile is detected and the camera image around the stroller 2 at that time on the same screen.
  • the camera image of the passenger when the smile is detected and the camera images of the surroundings of the stroller 2 at that time are displayed side by side, but if they are displayed on the same screen , Other arrangement may be used, such as arranging side by side.
  • the display processing unit 143 may also have a function of connecting consecutive camera images and reproducing (displaying) them as a moving image. In that case, the moving image generated from the camera image of the passenger when the smile is detected and the moving image generated from the camera image around the stroller 2 at that time can be displayed side by side on the same screen.
  • the continuous shooting request unit 144 continuously shoots the camera image of the passenger of the stroller 2 with respect to the camera 3 while the smile of the passenger of the stroller 2 is detected from the camera image by the facial expression detection unit 141 It has a function to send a shooting request.
  • the continuous imaging request is transmitted from the terminal device 4 to the camera 3 via the communication unit 13.
  • the camera 3 keeps shooting the camera image of the passenger of the stroller 2.
  • a plurality of camera images (camera images of the smiles of the passenger taken continuously) photographed in this manner are returned from the camera 3 to the terminal device 4.
  • the image selection unit 145 has a function of selecting a camera image with a smile degree equal to or more than a predetermined value from among the plurality of camera images (camera images of the smiles of the passenger taken continuously). For example, the image selection unit 145 detects a smile from each of the plurality of camera images, and calculates the degree of smile for each detected smile. Then, the image selection unit 145 selects one camera image having the largest smile degree from among camera images having a smile degree equal to or more than a predetermined value. If the degree of smile is a camera image having a predetermined value or more, a plurality of camera images may be selected. In addition, a known method can be used to calculate the degree of smile. Similarly, well-known methods can be used to calculate the degree of another specific expression (for example, the degree of crying, the degree of angry face, the degree of oddity, etc.).
  • the second control unit 15 is a control unit for performing sub-control related to the facial expression recording function, and the emotion analysis unit 150, the reproduction processing unit 151, the position acquisition unit 152, the recording processing unit 153, the notification processing unit 154, and the orientation information acquisition
  • the unit 155 includes a gaze direction detection processing unit 156.
  • the emotion analysis unit 150 has a function of analyzing the emotion of the passenger of the stroller 2 from the camera image (camera image of the passenger of the stroller 2) taken by the camera 3. For example, the emotion analysis unit 150 analyzes, from the camera image (the camera image of the passenger of the stroller 2), whether the emotion of the passenger of the stroller 2 is “joy”, “anger”, “ ⁇ ”, “easy”. can do.
  • the method of emotion analysis can utilize a well-known method.
  • the reproduction processing unit 151 has a function of reproducing video or music in accordance with the analysis result in the emotion analysis unit 150 (the emotion of the rider of the stroller 2 obtained as the analysis result). For example, if the emotion of the rider of the stroller 2 obtained as the analysis result is “Kee” or “Raku”, the reproduction processing unit 151 reproduces a bright atmosphere image or music, and the stroller obtained as the analysis result If the emotions of the two passengers are "angry” or "smiling", the video or music in a dark atmosphere is reproduced.
  • the position acquisition unit 152 has a function of acquiring position information of the stroller 2.
  • the position acquisition unit 152 has a GPS function of acquiring current position information (for example, longitude and latitude information) of the terminal device 4.
  • the position acquisition unit 152 acquires the position information of the terminal device 4 as the position information of the stroller 2.
  • the position acquisition unit 152 detects the position of the camera 3.
  • Information may be acquired from the camera 3 as position information of the stroller 2 (position information of the stroller 2 to which the camera 3 is attached).
  • the recording processing unit 153 has a function of recording the position (for example, latitude and longitude) of the stroller 2 when the smile of the rider of the stroller 2 is detected from the camera image by the facial expression detection unit 141 as a smile detection position.
  • the information on the smile detection position is recorded in the storage unit 12.
  • the storage unit 12 may store a smile detection position of another user (a position at which a smile of a passenger of another stroller 2 is detected).
  • the notification processing unit 154 has a function of notifying the user of the stroller 2 when the stroller 2 approaches the smile detection position.
  • the notification processing unit 154 notifies the user of the stroller 2 when the current position of the stroller 2 (obtained from the camera 3 by the position acquisition unit 152) approaches the smile detection position (stored in the storage unit 12). I do. For example, when the user enters a circular area of a predetermined radius centered on the smile detection position, the user of the stroller 2 is notified.
  • the notification to the user of the stroller 2 can be performed by a known method such as sound, light or vibration.
  • the notification processing unit 154 has a function of notifying the user of the stroller 2 according to the analysis result in the emotion analysis unit 150 (the emotion of the passenger of the stroller 2 obtained as the analysis result). It is also good.
  • the notification processing unit 154 may notify the nearest smile detection position, when the emotion of the rider of the stroller 2 obtained as the analysis result is “angry” or “smiling”.
  • the notification to the user of the stroller 2 can be performed using, for example, the touch panel 10 (notification by screen display) or the speaker 11 (notification by sound).
  • the direction information acquisition unit 155 has a function of detecting the direction of the stroller 2. As described above, the camera 3 has a gyro function of acquiring information (for example, orientation information) indicating the current orientation of the camera 3, and the orientation information acquisition unit 155 determines the orientation information of the camera 3 as the stroller 2. Of the camera 3 (the direction of the stroller 2 to which the camera 3 is attached).
  • information for example, orientation information
  • the gaze direction detection processing unit 156 determines the direction of the stroller 2 when the smile of the rider of the stroller 2 is detected from the camera image by the facial expression detection unit 141 as the gaze direction of the rider of the stroller 2 (for example Orientation)).
  • the method of gaze direction detection can utilize a well-known method. For example, the eye direction of the rider is calculated by paying attention to the eye part of the camera image of the rider of the stroller 2 and image analysis is performed, and the direction (traveling direction) of the stroller 2 at that time is taken into consideration. It may be inserted to detect the gaze direction (for example, the azimuth of north, south, east, and the like) of the stroller 2 riding. Information on the detected gaze direction is stored in the storage unit 12.
  • the display processing unit 143 may display the smile detection position on the map.
  • FIG. 4 is an explanatory view showing an example of smile detection position display.
  • the smile detection position is displayed on the map by the “smile mark”.
  • the present position of the stroller 2 is displayed by a circle, and the direction (traveling direction) of the stroller 2 is displayed by a triangle.
  • the direction of the stroller 2 is rightward on the map.
  • FIG. 5 is a flowchart of the same screen display processing in the facial expression recording system 1 of the present embodiment.
  • the camera image (moving image) of the rider of the stroller 2 photographed by the camera 3 is always displayed in live view.
  • a camera image is input from the camera 3 to the terminal device 4 (S 10), and the stroller 2 is boarded from the input camera image
  • a process of detecting the smile of the person is executed (S11).
  • the terminal device 4 sends an ambient imaging request to the camera 3 (S13), and imaging is performed based on the ambient imaging request.
  • a camera image around the stroller 2 is taken by the camera 3.
  • the camera image around the stroller 2 taken in this way is input to the terminal device 4 (S14), the camera image (camera image of the smile) and the camera image of the passenger of the stroller 2 when a smile is detected
  • a camera image around the stroller 2 when a smile is detected is displayed on the same screen (S15).
  • FIG. 6 is a flowchart of smile image selection processing in the facial expression recording system 1 of the present embodiment.
  • smile image selection processing is performed by the terminal device 4, first, a camera image is input from the camera 3 to the terminal device 4 (S20), and the stroller 2 gets on the basis of the input camera image A process of detecting the smile of the person is executed (S21).
  • the terminal device 4 sends a continuous shooting request to the camera 3 (S23), and the camera image of the passenger of the stroller 2 (smile) The camera image of) is repeated.
  • the degree of smile is equal to or greater than a predetermined degree and the degree of smile from among the continuously captured camera images (camera images of smile).
  • One largest camera image is selected (S24). If the degree of smile is a camera image having a predetermined value or more, a plurality of camera images may be selected.
  • FIG. 7 is a flowchart of the video and music reproduction process in the facial expression recording system 1 of the present embodiment.
  • video and music reproduction processing is performed by the terminal device 4, when a camera image is input from the camera 3 to the terminal device 4 (S 30), the camera image of the passenger of the stroller 2
  • the emotions of e.g., "Kee”, “Angage”, “Samurai”, “Raku"
  • S31 the camera image of the passenger of the stroller 2
  • S31 The emotions of (e.g., "Kee”, “Angage”, “Samurai”, “Raku) are analyzed (S31).
  • a video or music corresponding to the emotion of the rider of the stroller 2 is reproduced (S32).
  • the emotions of the rider of the stroller 2 are analyzed as “joy” or “easy”, video and music with a bright atmosphere are reproduced.
  • the emotion of the rider of the stroller 2 is analyzed to be “angry” or "tear”, a video or music
  • FIG. 8 is a flowchart of smile detection position recording processing / approach notification processing in the facial expression recording system 1 according to the present embodiment.
  • smile detection position recording processing / approach notification processing is performed in the terminal device 4, first, when a camera image is input from the camera 3, position information of the camera 3 from the camera 3 (Position information of the stroller 2) is acquired (S40). Then, when the smile of the rider of the stroller 2 is detected from the input camera image (S41). The position of the stroller 2 at that time is recorded in the storage unit 12 as a smile detection position (S42).
  • FIG. 9 is a flowchart of gaze direction detection processing in the facial expression recording system 1 of the present embodiment.
  • the gaze direction detection process is performed by the terminal device 4, first, when a camera image is input from the camera 3, the direction information of the stroller 2 is acquired from the camera 3 (S50) ). Then, when the smile of the rider of the stroller 2 is detected from the input camera image (S51). The direction of the stroller 2 at that time is detected as the gaze direction of the rider of the stroller 2 (S52), and the detected gaze direction is recorded in the storage unit 12 (S53).
  • the present embodiment it is possible to capture a camera image of a passenger (for example, a baby etc.) while going out in the stroller 2. Then, for example, when the passenger of the stroller 2 smiles when passing through a certain point, a camera image around the stroller 2 at that point is photographed. As a result, together with the camera image of the smile of the rider of the stroller 2, it is possible to obtain a camera image of the surroundings of the stroller 2 including factors that make the rider smile (such as a favorite object of the rider). .
  • the correspondence between the smile of the passenger (for example, an infant etc.) of the stroller 2 and the factor (the favorite object of the passenger, etc.) that makes the rider smile It can be easily grasped.
  • the camera image (camera image of the smile) of the rider is continuously photographed and smiles are selected from among them.
  • a high degree (good smile) camera image is automatically selected. This makes it possible to obtain a camera image of a good smile.
  • the emotion of the rider is analyzed from the camera image of the rider (for example, an infant or the like) of the stroller 2, and video and music corresponding to the emotion are automatically reproduced. Thereby, it is possible to produce video and music according to the emotion of the rider while going out in the stroller 2.
  • the position (smile detection position) at which the rider (for example, an infant or the like) of the stroller 2 turns into a smile is recorded, and the user is notified when approaching that point next time.
  • the user of the stroller 2 can grasp the point at which the rider of the stroller 2 smiles (the favorite spot of the rider), and when the user approaches the spot while going out at the stroller 2 You can know that.
  • the rider for example, an infant or the like
  • the gaze direction the direction viewed
  • the camera 3 may be attached to a child seat installed in a seat of a mobile such as a passenger car.
  • the camera 3 is placed at an appropriate position outside the child seat (for example, the ceiling, the back of the front seat, the inner surface of the pillar, the console panel Can be installed on top of the
  • the number of cameras 3 is not limited to one.
  • a camera for outside the car
  • a camera for outside the car
  • a plurality of cameras 3 may be used for each of the in-vehicle camera and the out-of-vehicle camera.
  • a camera image of a passenger for example, an infant or the like
  • a passenger who is placed on a child seat while going out in a passenger car. Then, for example, when a passenger turns into a smile when passing a certain point, a camera image around the vehicle at that point is photographed.
  • a camera image of the surroundings of the vehicle including a camera image of the rider's smile and a factor (such as a favorite object of the rider) that makes the rider smile.
  • the facial expression recording system has the effect of being able to record the smiles of the infants who are riding in the stroller while going out with the stroller, and is usefully applied to a stroller or the like on which the infants ride. It is.
  • Facial expression recording system (smile recording system) Reference Signs List 2 stroller 3 camera 4 terminal device 5 arm 6 sheet 10 touch panel 11 speaker 12 storage unit 13 communication unit 14 first control unit 140 data input unit 141 facial expression detection unit 142 surrounding photographing request unit 143 display processing unit 144 continuous photographing request unit 145 image Selection unit 15 Second control unit 150 Emotion analysis unit 151 Reproduction processing unit 152 Position acquisition unit 153 Recording processing unit 154 Notification processing unit 155 Direction information acquisition unit 156 Eye direction detection processing unit

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un système d'enregistrement d'expression qui comprend : une caméra (3) montée sur un landau (2) ; et un dispositif terminal (4) porté par un utilisateur du landau (2). La caméra (3) est capable de photographier une image de caméra d'un occupant du landau (2), et le dispositif terminal (4) peut communiquer avec la caméra (3). Lorsque l'image de caméra photographiée par la caméra (3) est entrée, le dispositif terminal (4) détecte, à partir de l'image de caméra, une expression spécifique de l'occupant du landau (2), et lorsque l'expression spécifique a été détectée, le dispositif terminal (4) transmet, à la caméra (3), une demande de photographie environnante pour photographier une image de caméra de l'environnement du landau (2). Par conséquent, il est possible d'enregistrer l'expression spécifique d'un bébé se trouvant dans le landau (2) lors d'une sortie avec le landau (2).
PCT/JP2017/034248 2017-09-22 2017-09-22 Système d'enregistrement d'expression WO2019058496A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2017/034248 WO2019058496A1 (fr) 2017-09-22 2017-09-22 Système d'enregistrement d'expression
CN201780094857.6A CN111133752B (zh) 2017-09-22 2017-09-22 表情记录系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/034248 WO2019058496A1 (fr) 2017-09-22 2017-09-22 Système d'enregistrement d'expression

Publications (1)

Publication Number Publication Date
WO2019058496A1 true WO2019058496A1 (fr) 2019-03-28

Family

ID=65809576

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/034248 WO2019058496A1 (fr) 2017-09-22 2017-09-22 Système d'enregistrement d'expression

Country Status (2)

Country Link
CN (1) CN111133752B (fr)
WO (1) WO2019058496A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220135105A1 (en) * 2020-11-03 2022-05-05 Apryl Bell Stroller for Increasing Child Comfort

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114594698B (zh) * 2020-11-02 2024-01-02 宁波星巡智能科技有限公司 基于压力检测的智能儿童餐椅及其控制方法
CN113104093A (zh) * 2021-04-14 2021-07-13 潍坊科技学院 婴儿车智能控制系统
US20220408063A1 (en) * 2021-06-18 2022-12-22 Ernesto Williams Stroller Camera Assembly

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003092747A (ja) * 2001-09-18 2003-03-28 Fuji Photo Film Co Ltd 監視装置
JP2010028341A (ja) * 2008-07-17 2010-02-04 Nikon Corp 電子スチルカメラ
JP2011217202A (ja) * 2010-03-31 2011-10-27 Saxa Inc 画像取得装置
JP2012124767A (ja) * 2010-12-09 2012-06-28 Canon Inc 撮像機器
WO2014199786A1 (fr) * 2013-06-11 2014-12-18 シャープ株式会社 Système d'imagerie
JP2015067254A (ja) * 2013-10-01 2015-04-13 パナソニックＩｐマネジメント株式会社 車載機器と、それを搭載した自動車

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101270998A (zh) * 2007-03-20 2008-09-24 联发科技（合肥）有限公司 根据路段提示兴趣点的电子装置及其方法
US8154615B2 (en) * 2009-06-30 2012-04-10 Eastman Kodak Company Method and apparatus for image display control according to viewer factors and responses
CN102123194B (zh) * 2010-10-15 2013-12-18 张哲颖 利用增强实景技术优化移动导航和人机交互功能的方法
WO2012154944A2 (fr) * 2011-05-10 2012-11-15 Stc.Unm Procédés de traitement de troubles associés à l'autophagie et compositions pharmaceutiques, produits de diagnostic, techniques de dépistage et trousses s'y rapportant
WO2013173640A1 (fr) * 2012-05-18 2013-11-21 Martin Rawls-Meehan Système et procédé pour un lit muni d'un mécanisme d'arrêt de sécurité
CN103900591B (zh) * 2012-12-25 2017-11-07 上海博泰悦臻电子设备制造有限公司 沿导航路线周边精确检索兴趣点的导航方法和装置
US8755824B1 (en) * 2013-06-28 2014-06-17 Google Inc. Clustering geofence-based alerts for mobile devices
CN103358996B (zh) * 2013-08-13 2015-04-29 吉林大学 汽车a柱透视化车载显示装置
CN105203117B (zh) * 2014-06-12 2018-05-04 昆达电脑科技(昆山)有限公司 位置判断系统
WO2016029939A1 (fr) * 2014-08-27 2016-03-03 Metaio Gmbh Procédé et système pour déterminer au moins une caractéristique d'image dans au moins une image
KR20180057366A (ko) * 2016-11-22 2018-05-30 엘지전자 주식회사 이동 단말기 및 그 제어방법

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003092747A (ja) * 2001-09-18 2003-03-28 Fuji Photo Film Co Ltd 監視装置
JP2010028341A (ja) * 2008-07-17 2010-02-04 Nikon Corp 電子スチルカメラ
JP2011217202A (ja) * 2010-03-31 2011-10-27 Saxa Inc 画像取得装置
JP2012124767A (ja) * 2010-12-09 2012-06-28 Canon Inc 撮像機器
WO2014199786A1 (fr) * 2013-06-11 2014-12-18 シャープ株式会社 Système d'imagerie
JP2015067254A (ja) * 2013-10-01 2015-04-13 パナソニックＩｐマネジメント株式会社 車載機器と、それを搭載した自動車

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220135105A1 (en) * 2020-11-03 2022-05-05 Apryl Bell Stroller for Increasing Child Comfort

Also Published As

Publication number Publication date
CN111133752A (zh) 2020-05-08
CN111133752B (zh) 2021-12-21

Similar Documents

Publication Publication Date Title
WO2019058496A1 (fr) Système d'enregistrement d'expression
CN108028957B (zh) 信息处理装置、信息处理方法和机器可读介质
JP5414907B2 (ja) Ａｖシステム
JP2016128320A (ja) 車両とのモバイルデバイスワイヤレスカメラ統合
US11410634B2 (en) Information processing apparatus, information processing method, display system, and mobile object
KR102155001B1 (ko) 헤드 마운트 디스플레이 장치 및 그 동작방법
JP2008147865A (ja) 画像表示システム、表示装置、表示方法
US10912916B2 (en) Electronic display adjustments to mitigate motion sickness
JP6077214B2 (ja) 画像処理装置、画像処理方法、プログラム、及び画像処理システム
JP2020095406A (ja) 車載装置、プログラム、及び車両
JP2015128915A (ja) 後席乗員モニタシステム及び後席乗員モニタ方法
JP6679368B2 (ja) 表情記録システム
JP2010093515A (ja) モバイル機器データの複数モニタ選択転送システム
JP7568022B2 (ja) 画像処理装置及び画像処理方法
TWI787205B (zh) 表情記錄系統、嬰兒車、及表情記錄程式
JP2009083791A (ja) 画像表示方法、車載用画像表示システム及び画像処理装置
JP2021103449A (ja) 情報記録再生装置、情報記録再生プログラムおよび情報記録再生システム
EP3476673B1 (fr) Dispositif et procédé d'affichage d'image dans un système optique d'oculaire pour un affichage près de l' il dans un véhicule
EP3073448A1 (fr) Appareil de contrôle de véhicule et procédé de contrôle de véhicule
US11930335B2 (en) Control device, control method, and control program
JP2020144332A (ja) 仮想現実システムおよび仮想現実方法
EP4307722A1 (fr) Véhicule routier et procédé et système de commande d'un dispositif de sortie acoustique dans un véhicule routier
US11921915B2 (en) Head-mounted display system and manned device
US20240087339A1 (en) Information processing device, information processing system, and information processing method
US20240239265A1 (en) Rear display enhancements

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17925652

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17925652

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP