JP4742283B2 - Method and screening system for adding scent presentation information - Google Patents

Description

  The present invention relates to a video content with scent presentation information and a video content with scent presentation information that improve the sense of reality by adding scent to video content having a story property composed of a set of short cut videos such as movies. It relates to the screening system.

  There are many odors in real life spaces, and it is known to have various psychological and physiological effects. In the creation of video content, if the olfactory stimulus can be presented so as to reproduce the odor in the space represented by the video, the range of expression can be expanded and the sense of reality can be expected to improve.

  Therefore, the present inventors have been researching and developing scented video content. Challenges include (1) the development of an odor generating device, and (2) the development of a content that can present an odor suitable for video presentation and its screening system.

  With regard to (1), as described later, the conventional odor generating device surrounds the vicinity of the human olfactory device by providing a hood around the human face, and conveys the odor into the hood with a pipe or the like. Or, most of them use head-mounted olfactory display nozzles.

  However, such an odor presenting device or a wearable odor presenting device that restricts the movement of a person has a high resistance and is not widely used.

  Therefore, scented video media has not been studied in earnest, and there is actually no commercialized scented video media.

  With regard to (1), a desirable odor generating device is capable of presenting the odor intended by the content creator at a predetermined timing and with a predetermined density from a remote location to a location where the viewer is sitting.

  In response to this problem, the present inventors recently used a device that measures the position of the nose in real time and an air cannon that emits the odor as a lump of gas to present the odor toward the user's nose. An odor generating device was invented (see Patent Document 1).

  The apparatus can select an arbitrary odor within a range of about several meters to 10 meters and present the odor at a short time interval of about 1 second to several seconds. Since any odor can be presented to the user at high speed by a non-wearing means, it is sufficiently practical if applied to a small movie theater or home theater.

  Among the problems of realizing the above-mentioned scented video content, the prospect of (1) is being obtained, so the importance of another problem (2) is increasing.

  The most important issue for adapting odors to images is the control of odor timing. For video content such as a movie, in which a lot of cut videos of several seconds to several tens of seconds are collected to form a story, the evaluation of the video is determined depending on whether or not an important cut is appropriately smelled.

  As will be described in detail later, if the scent fits into the video, a high realistic effect can be obtained, and the understanding of the story will be deepened. There is.

  In the following, the conventional problems of the conventional odor generating device with restrictions on the viewer and the scented video content presentation system will be specifically described.

  Patent Document 2 discloses a chair for viewing a movie or the like incorporating an aroma generator. The chair is provided with a hood, and it is shown that the presence of odor is enhanced in the hood according to the video.

  However, with respect to the method of presenting scents to video content, examples of presenting the scent of the sea, the scent of the forest, etc. in units of a long time of several tens of minutes are shown, but the scent presentation that is the subject of the present invention is shown. There is no mention of timing control. In a system that requires a long time to switch odors, it is difficult to apply to story video content.

  Patent Documents 3 and 4 disclose a system for adding odor to video content, or a method for adding odor in association with scenes and blocks of the video as a storage medium.

  However, the definition of scenes and blocks is sensuous and unclear, and there is no specific example of when the odor can be generated for the scenes and blocks at what timing. .

  Patent Document 5 discloses a system that realizes relaxation therapy by adjusting the presentation method of sound, video, and smell for each individual. It is characterized in that a database of sounds, images, and odors that have been verified in advance as being suitable for relaxation is created separately, and these sensory stimuli are presented in combination based on individual diagnosis results.

  Since the object of the invention is prevention and treatment of illness caused by stress, there is no mention of technology for improving the realism and understanding of video content. In particular, there is no description about odor timing control.

As described above, the conventional odor generator has difficulty in switching odors in a short time of several seconds to several tens of seconds. Therefore, the scent is finely controlled according to the scene and cut to improve the realism of the video content. In the first place, there is no concept of deepening understanding of content.
JP 2004-81851 A Japanese Utility Model Publication No. 5-34961 JP 2002-223409 A JP 7-55742 A JP-A-10-118185 Human Interface Symposium 2004 Lecture No. 1441 (announced October 6, 2004) Proceedings PP. 249-254

  The first problem of the present invention is to realize video content with scent presentation information for adding scent to video content with storylines composed of a collection of short cut videos such as movies.

  The second problem is to realize a screening system that allows the presentation of scent of scented video content to be felt naturally and to be viewed with high presence.

Method of adding scent presentation information according to claim 1 according to the present invention, in a method of adding the odor presentation information in the video content to be captured by the camera, when the video content production, and characters by using the distance measuring means The distance between the odor generating subject or the distance between the camera and the odor generating subject is measured, and the scent presentation information is added to a cut in which the distance measured by the distance measuring unit satisfies a predetermined value or less. And

According to a second aspect of the present invention, in the method for adding odor presentation information according to the first aspect, a psychological reaction value of an observer observing the video content is obtained, and the distance measured by the distance measuring means is predetermined. It is characterized in that scent presentation information is added to a cut that is less than or equal to a value and the psychological response value exceeds a reference value.

According to a third aspect of the present invention, in the method for adding odor presenting information according to the second aspect, the psychological reaction value is a pupil, a line of sight, a facial motion, or a heart rate of an observer who observes the video content. It is a function value with at least one as a parameter.

According to a fourth aspect of the present invention, in the method for adding scent presentation information according to the second aspect, the psychological reaction value includes a pupil of a viewer who observes the video content, a line of sight, a facial motion, a heart rate, It is a function value with at least one of the questionnaire results as a parameter.

According to a fifth aspect of the present invention, in the method for adding odor presentation information according to any one of the first to fourth aspects, the distance between the measured odor generating subject and a character or a camera for each cut video is used as a parameter. The detected odor density is set, a difference in odor density for each cut is detected, and scent presentation information is added to the cut whose difference has increased by a predetermined level or more.

According to a sixth aspect of the present invention, in the screening system for displaying the video content to which the scent presentation information is added by the method according to any one of the first to fifth aspects, the odor added in advance to the video content. A means for detecting presentation information , a means for obtaining a psychological reaction value of an observer observing the content, and a cut to which the odor presentation information is added, and the psychological reaction value exceeds a reference value And means for driving the odor generating unit to generate an odor during reproduction of the cut.

Invention of claim 7, in screening system for screening a video content the odor presentation information is added by the method according to any one of claims 1 to 5, wherein the odor which is previously added to the video content A means for detecting presentation information , a means for obtaining a psychological response value of an observer observing the video content, and a cut to which the odor presentation information is added, and in the cut immediately before the cut, the cut And a means for driving the odor generating unit to generate an odor during reproduction of the cut when the psychological reaction value exceeds the reference value.

According to the first aspect of the present invention, since the images are continuous in the cut video, in the case of the video content having the story property, the position of the photographing camera and the subject generating the odor are included in the cut video. The distance or the distance between the character that the viewer empathizes with and the subject that generates the odor hardly changes greatly.

Focusing on this, when the scent suitable for the cut video is presented using the high-speed scent presentation means with the cut video as a unit, the viewer feels that the video is natural (the scent presentation feels consistent), A feeling improves. In addition, the understanding of the story is deepened .

  The odor intensity felt by the viewer is an important parameter based on the viewer's viewpoint position and the distance to the odor generating substance. As a result of the experiment, the viewpoint position of the person who appreciates the story-oriented video content is mostly the position of the shooting camera or the position of the character who has moved in.

  Therefore, using the position of the shooting camera and the distance between the subject that generates the odor or the distance between the character and the subject that generates the odor as parameters, the odor is added to the cut video that is within the distance where the distance usually feels strong. When presented, the smell is felt fresh, and a little fragrance has a high olfactory stimulation effect.

Among many cut video, by the means, to narrow the cut for adding odor, Ru quite effective der to improve and comprehension realism.

According to the invention described in claims 2 to 4 , when the psychological reaction of the video viewer is analyzed and the scent is presented when the psychological analysis result indicates an increase in realism, the psychological effect received from the video is The psychological effects received from the scent act synergistically and are more effective for improving the sense of reality and understanding the content.

In addition, since it is possible to detect a cut video that the video viewer has not shown interest in, it is possible to prevent a mismatch in smell presentation. According to the fifth aspect of the present invention, the odor intensity at the cut shooting location is measured for each cut video, and the odor presentation information is added only to the place where the odor intensity suddenly increases. Presentation is possible.

According to the sixth and seventh aspects of the present invention, the video content production side presents the scent by taking the logical product of the cut video that the video content production side intends to add to the scent and the cut video that the viewer side feels a sense of realism. Thus, there will be fewer mismatches in the scent presentation, and the screening system will be highly satisfying for each viewer.

  When a predetermined scent is selected or blended based on the scent presentation information and the scent is presented using an air cannon, the scent presentation can be appropriately performed on cut images that change one after another. Since it can be switched from several seconds to several tens of seconds, it is compatible with the change of the cut video.

  In the conventional odor presenting means, when an odor is generated, an extra odor remains, and the removal of this odor is troublesome, but in the air gun method, the gas containing the odor is a small mass, so suck the odor Once left, it will not remain.

Example 1
FIG. 1 is a diagram for explaining the preparation of the present invention in the process of creating a movie, and FIG. 2 is a first embodiment of the present invention related to the means 1 to means 4 for indicating scent presentation information to video content. A configuration for addition and a flow of processing are shown.

  A story image such as a movie is composed of a plurality of scenes, and each scene is composed of a set of short cut images.

  In the present invention, a scene is a series of meaningful videos that a video producer wants to express in the story, and a cut video is a video of a time zone in which a camera is directed toward a subject and continuously shot. Means. Camera movements (panning, zooming, etc.) are also included in one cut. Usually, cuts that require odor addition often move the subject while the camera is stationary. This will be described later based on the experimental results.

  In FIG. 1, 1 is a photographing camera, 2 is a character, and 3 is an odor generating subject. In the movie, the shooting camera 1 shoots the appearance of the character 2 acting according to a story and a script. At this time, in order to create one scene, the cut video is shot from various angles and distances and stored in the video recording device 4.

  FIG. 3 is an example in which a store clerk character 2b takes a perfume bottle 3a to a customer, and the customer 2a takes a picture of a scene of picking up 3a and smelling it.

  In the first cut, the camera 1b shoots from a distance so that the overall movement of the clerk 2b and the customer 2a can be seen. Let D1 be the distance from the camera to the perfume bottle 3a, which is the subject generating the odor.

  Here, how to perceive odor generating substances and human odors will be briefly described. In general, the odor from the odor generating substance diffuses naturally in the air in the absence of wind. As indicated by Lin in FIG. 3, the concentration decreases exponentially as the distance increases. As the distance gets closer, it becomes higher exponentially.

  On the other hand, human olfactory characteristics (smelling intensity) are proportional to the logarithm of the ratio of the stimulus concentration to the reference odor concentration. In other words, the well-known Weber-Fechner's law holds for odor sensitivity. While the odor concentration increases exponentially as the distance approaches, the olfactory characteristics are proportional to the logarithm, so generally speaking, when a person approaches an odor substance, the odor is felt strongly in proportion to the distance.

  In FIG. 3, since the camera 1b is far away (D1 is large) in the first cut, the odor density is low at the location of the camera. 6b is an odor concentration sensor. When this video is played back later, the viewer's psychological viewpoint is often in the position 1b (receives the feeling of watching at the position 1b). Since 1b is far from the odor generating substance 3a, the viewer rarely feels odor from the image. Therefore, this cut is a cut that does not need to be smelled.

  In the next cut video, a scene in which the camera 1a approaches the customer 2a and the customer 2a smells 3a is photographed. Since the distance D2 between the camera 1a and the perfume bottle 3a is short, the odor concentration measured by the odor concentration sensor 6a is high. When the video is reproduced, if the viewer's psychological viewpoint is 1a, the distance to the perfume bottle is short, and it is easy to feel the smell from the video. Therefore, this cut is a candidate for odor.

  Next, the customer 2a picks up the perfume bottle 3a and smells it. At this time, if the camera is shooting from 1a, the distance between the camera and the perfume bottle does not change greatly, but the distance between the customer 2a and the perfume bottle 3a is abruptly reduced. When the viewer reproduces the video and the emotion moves into the customer 2a and the viewer's psychological viewpoint shifts from 1a to 2a, the viewer feels a strong smell from the video. Therefore, this cut is a strong candidate for smelling.

  In this way, when a cut video is taken in FIG. 1, the distance measuring means 5 measures the distance between the camera 1 and the odor generating subject 3 and the distance between the character 2 and the odor generating subject 3. And recorded in the photographing situation recording device 11.

  Note that the distance can be measured by various methods such as a method of measuring a reflection time by irradiating ultrasonic waves and a method of measuring using image processing.

  At the camera position or the position of the character, the odor concentration emitted from the odor generating subject 3 is measured by the odor concentration measuring device 6 and recorded in the photographing situation recording device 11.

  In 11, an assistant or assistant director can input the environment (weather, temperature, humidity) of the place, the odor type of the used odor generating subject 3, and its state. For example, in the scene where the character opens the perfume bottle and smells it, it is possible to input for each cut video what kind of perfume or the perfume bottle cover is open.

  The type and state of the odor generating subject and the odor concentration information measured by the odor concentration measuring device 6 are stored in the photographing recording apparatus 11 as a set.

  At the shooting site, the cut video and the shooting status storage accumulated as described above are brought into the editing room, and edited by the video editing processing device 7 according to the scene and story, the video content 10 is created.

  Next, with reference to FIG. 2, a method of attaching scent presentation information to a cut video using the video content and the shooting state record will be described.

  In the figure, reference numeral 12 denotes processing means for abstracting cut video from video content. In FIG. 1, the video content is created by connecting cut videos, but instead of simply connecting them, the cut video shot in the field is cut short or rearranged so that they are connected. In order to search for cuts that present odors from the finished video content, a process of extracting cut video is performed again.

  The duration of one cut video varies depending on the movie, but there are many relatively short ones within a few seconds to a minute. Also, the subject rarely changes greatly in size in the cut. In particular, in a cut in which a person who appreciates the completed video desires to add odor, the distance between the photographing camera and the odor generating subject tends not to change greatly.

  In FIG. 2, reference numeral 13 denotes a means for calculating the distance Dis1 between the photographing camera and the scented subject. It is possible to retrieve the data of the photographing situation recording device 11 and fetch Dis1. Alternatively, it is possible to estimate Dis1 from the size of a person on the screen by performing image processing on the cut video.

  Reference numeral 14 denotes a means for calculating the distance Dis2 between the character and the scented subject. It is possible to retrieve the data of the photographing status recording device 11 and load Dis2. Alternatively, Dis2 can be estimated by performing image processing on the cut video as described above.

  Reference numeral 19 denotes a means for reading information Sta indicating from 11 the state of the scented subject. A specific example of Sta is whether there is a situation where an odor is produced, what kind of odor is, what is the odor density, and the like.

  Reference numeral 16 denotes processing means for determining whether or not to add odor presenting information to the cut based on the value of the function F having Dis1, Dis2, and Sta as parameters.

  The determination process will be described. For each odor generating subject, the odor density and the intensity of the scent to be sensed can be stored in a database in advance using the state of the subject and the distance from the subject as parameters.

  For example, in the case of a perfume bottle, when the lid is opened, a distance of 1 m or less is defined as an odor detection area, that is, a range in which the presence of odor is felt, and the odor concentration is associated with α gram per cubic centimeter. Similarly, the distance of 50 cm or less is an odor discriminating region, that is, a range in which the type of odor can be discriminated, and the odor concentration is associated with β gram per cubic centimeter. Several steps of odor intensity information are set as the distance becomes shorter.

  In addition to perfume, odor concentration such as flowers, food, and filth can be set using the distance Dis and state Sta as parameters. The state can be set as a parameter for those in which odor generation is visually felt, such as “heated”, “mist or steam is generated”, in addition to “the lid is open”.

  Therefore, in 16 of FIG. 2, in the state where Sta is “the lid of the perfume bottle is open”, if Dis1 is 1 m or less, perfume scent information is added, and if Dis1 is 50 cm or less, it is said to be a rose perfume. Specific odor information can be added.

  Further, as the viewer's viewpoint, it is possible to set whether to give priority to the distance of Dis1 or Dis2 depending on whether the camera position is set at the shooting site or in the scene where emotions are easily transferred.

  The thick solid line in the figure is the basic processing flow. In 16, if the predetermined condition is satisfied, odor presentation information is added to the cut video in 17. The scent presentation information includes an odor substance selection command and an odor concentration control command.

  In the selection of the odor substance, an odor substance that generates an odor close to the odor of the odor generating subject at the time of photographing is selected. The odor concentration control command is issued based on the 16 determination results.

  In this way, the scent presentation information is added if necessary when the cut video is switched. Here, what is important is that it is not always necessary to reproduce the odor at the shooting site as it is.

  Human olfaction has fatigue characteristics that make it difficult to smell when the same smell is smelled for a long time. When a scene that smells scent is long, even if scents are added to all the cut images that make up the scene, there is little realism effect. Rather, it may cause a sense of resistance to odors and reduce the evaluation of video content.

  Therefore, in 17, the difference between cuts of the odor concentration determined for each cut is calculated, and processing is performed to add scent presentation information when the difference value is at a level at which a general viewer feels odor. Can do. Here, it is possible to determine whether or not the general audience is at a level at which the smell is felt by applying Weber-Fechner's law.

  For example, in the case of the perfume bottle shown in FIG. 1, the odor concentration in the cut in which the customer has the perfume bottle is abruptly higher than that in the previous cut. By comparing with a predetermined odor functionality database for each odor generating subject, it is determined that the level is higher than the level at which a general person feels odor, and 17 operates to add scent presentation information.

  On the other hand, in the next cut that performs various operations after the customer picks up the perfume bottle, the odor concentration does not increase significantly compared to the cut when the customer picks up the perfume bottle. Thus, when there is a small difference in odor concentration between the cuts, even if the odor continues at the site where the image was taken, since olfactory fatigue occurs in a predetermined time, 17 presents the odor for a long time. It is better to control so that it does not.

  As a result of the experiment, the scent presentation may be within 30 seconds. Smelling in a short time and in a point is highly appreciated because it smells fresher.

  In the present invention, as described later, a device that emits scent at a high speed can be used as the scent generating device.Therefore, the scent presentation information is attached at the time of cut switching. When the delay time until arrival is taken into consideration, the scent presentation information may be added at the time when the time is subtracted.

  Next, the flow of the one-dot chain line in FIG. 2 will be described. In addition to the method using the above-described 16 determination processing formulas F (Dis1, Dis2, and Sta), the selection of the cut video to which the scent presentation information is added is performed by analyzing the psychology of the person viewing the video content, and the psychological analysis result is A method of selecting a cut that satisfies a predetermined condition can be used.

  In the figure, video content 10 is presented on a large monitor 20, and is viewed by an observer, and a button is pressed when a cut video that requires a smell appears in the video. This is one psychological analysis method. If there are many viewers pressing a button in a predetermined cut video, the cut becomes a strong candidate for adding scent presentation information.

  At the same time, psychological analysis can be performed by the following method. 22 is an apparatus for measuring the size of the pupil of the viewer P1. 23 is an apparatus for measuring the movement of the line of sight. Reference numeral 24 denotes an apparatus for measuring the movement of the face. These can be measured by non-contact means using image processing technology. A device 15 analyzes the psychology of the viewer based on these measurement results.

  For example, when a person is concentrating on the screen or looking at an object of interest, the pupil tends to open wide (mydriasis). On the other hand, if you are looking at an object you are not interested in, it does not change much.

  When looking at an object of interest, the line of sight closely follows that object. Also, the blinking operation is fast and the number of times decreases. On the other hand, when the subject is not interested, the line of sight moves to various subjects. Also, blinking is slow.

  In this way, by measuring the size of the pupil, the movement of the line of sight, the speed of blinking, the frequency, the direction of the face, etc., it is determined whether the viewer is concentrating on the cut video or feeling realistic can do.

  Further, when the device is allowed to contact the human body, the electrocardiograph 29 can be used for psychological analysis.

  15 Pu, Gz, Fa, and Ha indicate the results of psychological analysis from pupillary reflection, gaze measurement, facial motion measurement, and electrocardiograph, respectively.

25 is a means for comprehensively judging the psychological elevation of the viewer. A function G using Pu, Gz, Fa, and Ha as parameters is defined, and whether or not the function value exceeds the reference value Th2 determines psychological uplift. When this condition is satisfied and the viewer desires odor as described above, the scent presentation information can be added to the cut video in which the button is pressed by 26.

  Also, odor presentation information can be added using 16 and 25 together. In other words, by using the logical product of the physical information such as the distance to the odor generating subject and the state and the psychological analysis result, the scent presentation information can be added to the cut video that satisfies both conditions. This makes it possible to present an odor that can be accepted by many viewers.

  The scent presentation information is stored on the DVD together with the video content information. Reference numeral 40 denotes a DVD recording / reproducing apparatus.

Example 2
FIG. 4 is a second embodiment of the present invention related to the means 5 and is a video content screening system with scent presentation information.

  In the figure, reference numeral 10 denotes video content composed of a set of cut videos defined as an image sequence in which photographed images are continuous, and smell presentation information is added by the method described in FIG. Shall.

  The video content 10 is presented on the monitor 20 and is viewed by P2. The psychological state of the viewer is analyzed by 15 based on the measurement results from the pupil measuring device 22, the gaze measuring device 23, the facial motion measuring device 24, the electrocardiograph 29, and the like. This is the same as the method described in FIG.

  Reference numeral 18 denotes means for detecting scent presentation information from 10. 31 is a means for obtaining a logical product of the odor presentation information and the psychological analysis result. When the scent presentation information is “present” and the psychological analysis result “exceeds a predetermined condition”, the scent presentation information and the scent presentation command are sent to the scent database 30. On the other hand, in other cases, the odor presentation command is not performed and the original flow is restored.

  When it is determined by the logical product process 31 that scent presentation is to be performed, the scent presentation information is transmitted to the scent database 30 through the path of the arrow. When the odor database 30 receives the odor selection command and the odor concentration control command as the odor presentation information, the odor database 30 creates a procedure manual for generating the odor and sends information to the odor presentation device 50. 50 emits an odor to the viewer's nose.

  Here, the procedure manual is for outputting an odor close to the odor specified by the odor presentation information. That is, the scent presentation information is the scent intended by the video content production side, but it is often difficult for the user side to actually reproduce the scent. This is because if the odor presenting device on the user side does not have the odor substance, it cannot be presented. The procedure manual is for preparing a combination of generally satisfying odors in the form of a database and selecting the combination even if the odors cannot be completely reproduced.

  The feature of the above processing is to add a smell to the cut video in which the viewer is interested and feels the presence in the cut video that the video producer wants to present the smell. As a result, when an odor is added, the effect is increased by combining the sense of presence effect from vision and the sense of presence effect from smell. When no scent is desired, no scent is presented, so there are few mismatches.

  In addition, although the example which detects the psychological reaction of one viewer is shown in FIG. 4, when there are a plurality of viewers, it can be determined by statistical processing based on data of a plurality of people. If there are several observers, by processing one or two camera images, it is possible to accurately detect pupil changes, line-of-sight movement, and face orientation of each observer.

FIG. 5 is a more specific description supplementing the above description. Video content with scent presentation information is recorded on DVD41.
The screening system can detect the time when the scent presentation information is added or the cut by the scent presentation information detection means 18 that scans the information on the DVD before the video content is screened. In the figure, K1 and K2 are scent presentation information. The reason why it is added to cut 2 and cut 3 will be described.

  This figure shows the scene of FIG. 1 as an example. In cut 1, since the distance Dis1 between the photographing camera and the perfume bottle is long, no scent presentation information is added. Cut 2 is a scene where the customer has a perfume bottle in hand, and since Dis1 is short, K1 is added. The cut 3 is a scene where the customer smells the perfume. Dis1 is further shortened and the distance Dis2 between the customer and the perfume bottle is also short, so information K2 presenting a strong perfume scent is added.

  When video content is screened, the cut video flows below the figure. The psychological reaction of the person who appreciates the video is analyzed. A1, A2, and A3 are psychological reaction analysis results while viewing cut 1, cut 2, and cut 3, respectively.

  The logical product may take K1 and A2, and K2 and A3, but in the figure, logical product is taken between K1 and A1, and K2 and A2. In this way, in the same cut video, even if the logical product of the odor presentation information and the psychological reaction analysis result is not taken, it is slightly shifted, that is, the cut video with the odor presentation information added is seen. A logical product analysis with the scent presentation information may be performed using a psychological reaction analysis.

  By doing in this way, when it comes to a cut video that satisfies the conditions, it is possible to prepare to present an odor without delay.

  In the same figure, the logical product of K1 and A1 is NoGood, that is, the video producer added K1 because he wants to present an odor, but the viewer did not indicate the psychological necessity, so it was determined that no odor was presented. is doing. The logical product of K2 and A2 is determined to present an odor by Good, and a strong fragrance from 50 is presented.

Example 3
FIG. 6 is a third embodiment of the present invention relating to the means 6 and is a video content screening system with scent presentation information. Mainly shows the hardware configuration.

  Reference numeral 100 denotes the entire screening system. Reference numeral 41 denotes a DVD containing video content with scent presentation information. The data is read by the DVD device 40, converted into a video by the video playback software of the information processing device 33, and presented on the monitor 20.

  Reference numeral 21 denotes a camera for photographing the face and eyes of a user who appreciates the reproduced video. The pupil diameter is measured at 22, the line of sight is measured at 23, the orientation of the face is measured at 24, and the psychological reaction is analyzed at 15.

  As described with reference to FIG. 4, when a cut video that requires scent presentation is found from the detection of scent presentation information and psychological reaction analysis results, a procedure manual for generating scent is created and the scent presentation device 50 is driven.

  50 includes an air cannon 57, an air cannon driving device 62, a device 61 for adjusting the gas discharge angle of the air cannon, an odor substance selecting device 63, and an odor generating unit.

  The odor generating unit includes a fragrance reservoir that supplies different types of fragrance to the cylinder 51 of the air gun, and a device 53 that vaporizes the fragrance. The perfume is supplied to the gun barrel according to 63 commands. The perfume is vaporized by heat or ultrasonic waves. In particular, use of ultrasonic waves is suitable for the present invention because it can be vaporized at a very high speed.

  The perfume that has been vaporized and accumulated in the cannon will fly forward as a gas mass αβ from the cannon opening 52 when the conical membrane 58 of the air cannon is pushed out by the solenoid 60. It can be controlled at 61 so that this lump is directed to the user's nose.

  Although a lump of fragrance gas can be continuously released, it is preferable that the scent presentation is performed within 30 seconds in order to avoid olfactory fatigue.

  Next, the validity of the present invention described above will be described using experimental results. Since the experiment method is disclosed in detail in the document “Human Interface Symposium 2004” from page 249 to page 254 of the present inventor, only the result will be briefly described here.

  FIG. 7 is an example of an experiment result in which a button is pressed when a viewer who is viewing video content feels smell in FIG. The video is a two-hour movie where odors are effectively used. The horizontal axis shows the show time, and the vertical axis shows what percentage of a plurality of viewers feel the smell.

  Although it is a time zone when the vertical bar part feels odor, it can be seen that the width of one vertical bar is small. In other words, even if the scent is felt in a certain cut image, the scent is not felt immediately after the cut is switched. Therefore, it can be understood that the scent presentation may be performed in a short time.

  The scenes that require scents are more fixed than the scenes in which the camera moves violently, and the characters often perform characteristic movements and are attracted to the scenes. That is, a cut video in which the distance between the camera and the odor generating subject does not change greatly is effective for odor presentation.

  Moreover, even if it is a cut image conscious of smell, not everyone wants smell but it turns out that there is variation. It can be seen that it is effective to add a scent to a cut video in which 100% of the viewers want a scent, but in a cut video that is not so, it is better to grasp the user's psychological situation and add a scent. If scent is added to a cut video that does not want scent, the video content will be less evaluated due to mismatch.

  Dozens of movies were watched by dozens of viewers and evaluated how many odors should be per movie, and more than 70% of people wanted odors in common. The scenes were several to tens of places in a two-hour movie. The total time of the places was about 10 minutes, although it varied depending on the movie.

  Generally speaking, the result was that several tens of places in a two-hour movie required scents of several tens of seconds per place. From this, it can be seen that the method of adding an odor of about 30 seconds at the longest with the cut video as a feature of the present invention as a unit is appropriate.

  FIG. 8 shows the psychological effect of using the system shown in FIGS. 4 and 6 to present a scent suitable for the content of the video to the cut video that requires the scent, and adding the scent. This is the result of a survey. Examples of video content include a movie about food (dandelion) and a movie about animals (My Neighbor Totoro).

  When a scent-conscious scene cut video is scented every tens of seconds, most viewers respond that the sense of reality has improved. From this result, it can be seen that when an appropriate scent is presented in a scent-conscious video, the sense of presence is improved.

  FIG. 9 shows a result of measuring a change in pupil diameter of a viewer who is watching a soccer video. Mydriasis can be seen around 7 to 9 seconds, which is a scene where the player shot and scored a goal. The audience responded that they love soccer and were also excited in the post-view questionnaire. That is, it is understood that pupil reflex is effective as a means for analyzing a psychological state. In the present invention, it is possible to present an odor when a cut video that gives a sense of realism comes while measuring changes in pupil diameter and analyzing a psychological state.

  FIG. 10 shows the result of measuring the pupil diameter change when the scent is actually presented to the viewer who is watching the movie in which the scent is effectively used.

  Figure (A) shows the case where the scent is conscious but the scene is not a climax on the story when the scent is not added and when the scent is less related to the conscious scent. It is pupil diameter change. In addition, in the figure which shows the result of having measured by adding an odor, the position of a vertical line is the time of adding an odor. The portion to the left of the position of the vertical line shows the change in pupil diameter before the odor is added in the same measurement, but is shown for comparison. This is the same in FIG.

  The pupil diameter is represented by the ratio of the iris opening diameter (pupil diameter) to the black eye, but in the case of the viewer of FIG. He also answered that he felt uncomfortable with the smell in the questionnaire after the appreciation.

  FIG. 5B shows changes in pupil diameter when an odor is conscious and an image of a scene that is a climax on the story is not given an odor and when an odor that matches the conscious odor is given. The viewer is the same as (A). Specifically, this is a case where the lavender smell is presented in a scene where the flask containing the lavender liquid breaks. Since it is a climax scene, the pupil diameter is larger than that in (A) and is further increased by adding an odor.

  Lavender has a calming effect physiologically, and when it presents only an odor, it tends to miosis, but the fact that mydriasis was nevertheless had a great psychological effect of presence. Is. In the questionnaire after the appreciation, he answered that it was interesting.

  In other words, in this experiment, the pupil tends to dilate in interesting scenes and highly realistic scenes, and it can be seen that pupil reflex can be used for psychological analysis. In addition, it can be seen that the presence of the scent suitable for the scent conscious from the video is presented together with the video to further improve the sense of presence. It is verification data which shows the effectiveness of this invention.

  Further, in FIG. 5B, the prominent mydriasis was about 10 seconds from the time indicated by the vertical line with odor. Considering comprehensively based on the knowledge of human olfactory fatigue characteristics, the results of questionnaires, etc., an odor presentation time of one time is suitably within 30 seconds.

  Next, an odor presentation timing control method in the screening system (FIGS. 4 to 6) of video content with odor presentation information according to the second and third embodiments will be described.

  FIG. 11 shows, by experiment, an allowable range and an uncomfortable range when the scent presentation time is shifted back and forth based on the time when the viewer feels scent from the video during the video content screening. It is a result.

  The video used was a CG video with the perfume bottle lid opened and the scent drifting in front of the viewer, and the viewer smelled from the video on average 0.3 seconds after the lid opened. Answer that you feel. This is because in the real world, memory that a person has learned empirically works unconsciously.

  The questionnaire evaluated how the audience felt when the time when the scent was actually displayed was shifted with reference to 0.3 seconds after the lid was opened (presenting the scent without any deviation). .

  In FIG. 11, the horizontal axis represents the odor presentation time lag (seconds), and the vertical axis represents the average rating value of 10 viewers. The relationship between the score and the question is shown in the figure. The solid line indicates the case where the scent presentation is delayed from the reference time, and the one-dot chain line indicates the case where the scent is presented before the reference time, that is, the case where the scent presentation is advanced.

  The experimental results will be described. Scores 1 and 2 are time differences with no problem. Since grade 3 is a time difference that feels "can be discerned but acceptable", and grade 4 is a time difference that feels "cannot wait" or "too early", grade 3.5 is the middle point, ie, grade 3.5 Can be considered.

  Looking at the time difference corresponding to the rating of 3.5, it can be seen that both when the scent presentation is delayed and when it is advanced, the tolerance is 1.8 seconds or less, and when the odor presentation is over 2 seconds, the sense of discomfort increases. In particular, when the scent is presented earlier than the video, it can be seen that the sense of incongruity increases rapidly from the point where it exceeds 2 seconds. This is because in the natural world, odors cannot usually come before visual stimuli, so that the viewer feels that this is a phenomenon that is learned through experience.

  From the above experimental results, in FIG. 4 and FIG. 6, the odor presenting device 50, when the odor presenting information added to the video content includes the time when the odor is presented, is 2.0 seconds before and after the time. It is desirable that the drive is controlled so that the scent reaches the viewer within a short time. Moreover, after starting the odor presentation, as described above, it is desirable to end the odor presentation within 30 seconds.

  According to the present invention, an appropriate scent can be presented during the viewing of a video content with a story, so that the realism of the video content is enhanced and the understanding of the content is deepened. Ideal for movies and home videos.

  Video content and scent presentation information can be recorded on a DVD and sold as a set with a fragrance device that generates scent based on the scent presentation information. Other than movies, it can be applied to video content that provides healing and background video content that relaxes customers in hospitals and waiting rooms.

  In addition, in recent years, video contents have become widespread on the Internet, and the present invention can be applied to movies distributed on the Internet, videos used in electronic commerce (product PR videos), and the like. In this case, in the configuration of FIG. 6, 33 is a personal computer terminal and 20 is a personal computer monitor. An odor presentation device 50 is installed next to the monitor. For example, taking wine sales online as an example, if a wine farmer presents a good scent according to the video scene in which wine is produced, the understanding of wine will increase and the willingness to purchase will improve.

It is a video content creation method illustrating the preparation of the present invention. The first embodiment of the present invention is a method for adding odor information to video content. It is a figure explaining the relationship between the scene which sniffs the smell of a perfume, and a cut image, and the distance from a perfume and an olfactory stimulus. In the second embodiment of the present invention, a video content screening system with scent presentation information is shown. It is an example of a screening method of scented video content. It is a 3rd Example of this invention, and is a hardware block diagram of the screening system of a video content with odor presentation information. It is the experimental result which measured the timing when an appreciator requests an odor presentation during movie appreciation. This is a questionnaire evaluation result on the improvement of the sense of reality when a proper scent is actually added to a movie in which the scent is used effectively. It is an experimental result which shows that a pupil dilates during the video viewing which is interested. It is an experimental result which shows the change of the pupil diameter when an odor is shown at the time of movie viewing. It is the result of the experiment which calculates | requires an odor presentation time difference allowable range.

Explanation of symbols

1. Shooting camera 2 ... Character 3 ... Odor generating subject 4 ... Video recording device 5 ... Distance between shooting camera and smell generating subject, or character Device 6 for measuring distance to odor generating subject ... Odor concentration measuring device 7 ... Video editing processing device 10 ... Video content 11 ... Shooting situation recording device 15 ... Psychological reaction analysis Means 18 ... Smell presentation information detection means 20 ... Video presentation device 22 ... Pupil diameter measurement device 23 ... Gaze measurement device 24 ... Face movement measurement device 25 ... Psychological reaction determination processing means 29 ... Electrocardiograph 31 ... AND processing means 33 ... Information processing device 40 ... DVD recording / playback device 41 ... DVD
50 ... Odor presentation device 51 ... Air cannon cylinder 52 ... Opening 53 ... Vaporizers 54, 55, 56 ... Fragrance reservoir 57 ... Air cannon 58 ... Conical membrane 59 ... Bellows film 60 ... Solenoid 61 ... Angle adjustment device 62 ... Air cannon drive device 63 ... Odor substance selection device 100 ... Screening system

Claims (7)

In a method for adding scent presentation information to video content captured by a camera,
During the production of the video content, the distance between the character and the odor generating subject is measured using a distance measuring means, or the distance between the camera and the odor generating subject is measured,
A method of adding an odor presentation information distance measured by the distance measuring means and said adding odor presentation information cut to meet the predetermined value or less. Find the psychological response value of the observer observing the video content,
It said distance distance measured by the measuring means is below a predetermined value, and the smell of claim 1, characterized in that the addition of odor presentation information to cut the psychological response value exceeds the reference value A method of adding presentation information . The odor according to claim 2, wherein the psychological reaction value is a function value using at least one of a pupil, a line of sight, a facial movement, and a heart rate as a parameter of an observer who observes the video content. A method of adding presentation information . The psychological response value is a function value using at least one of a pupil, a line of sight, a facial movement, a heart rate, and a questionnaire result of an observer who observes the video content as a parameter. A method of adding the described scent presentation information . For each cut video, set the odor concentration using the distance between the measured odor generating subject and the character or camera as a parameter,
Detect the difference in odor concentration for each cut,
The method for adding scent presentation information according to any one of claims 1 to 4, wherein the scent presentation information is added to a cut whose difference has increased by a predetermined level or more. A screening system for screening video content to which the smell presentation information is added by the method according to any one of claims 1 to 5,
Means for detecting the scent presentation information added in advance to the video content;
A means for determining a psychological reaction value of an observer observing the content;
Means for generating an odor by driving the odor generating unit while reproducing the cut with the scent presentation information added and the psychological reaction value exceeds a reference value;
A screening system characterized by A screening system for screening video content to which the smell presentation information is added by the method according to any one of claims 1 to 5,
Means for detecting the scent presentation information added in advance to the video content;
Means for determining a psychological reaction value of an observer observing the video content;
When the odor presentation information is added to the cut and the psychological response value exceeds a reference value in the previous cut, the odor generation unit is driven during the reproduction of the cut. Means to generate odors,
A screening system characterized by

Images