JPH09507620A - Observing a captured object from a selected viewpoint - Google Patents

Abstract

(57) Summary The object (18) has a plurality of spaced positions having a known relative position to each other to generate a sequence of images of the object taken from different viewpoints (17). Photographed from (16). Whether these images can be displayed to the user to constitute a displayable individual image or sequence of images of the object as if they were taken from a user-selected viewpoint (33) different from any of the set viewpoints, Alternatively, it is operated by the processor (22) under user command (24) using known relative position information. The generated or constructed image can be further processed under user control to facilitate zooming in and out on the imaged object and removing unwanted parts of the image.

Description

Detailed Description of the Invention                 Observing a captured object from a selected viewpoint Cross-reference of related applications   This application is a co-pending US patent application filed on January 10, 1994 It is a partial continuation application of No. 08 / 179,383. BACKGROUND OF THE INVENTION   TECHNICAL FIELD OF THE INVENTION   The present invention relates to a technique for recording and displaying an image of an object, particularly from a selected viewpoint. It relates to the manipulation of such images for display.   Description of related technology   For example, an object (e.g., item, event, scene, (Or place) observers from the limited number of viewpoints established at the time of shooting. Observing a sequence of images of an object It has been constrained since then. In fact, recorded as a videotape or movie film image When observing an object that has been viewed, the observer may be a stranger (eg, a director) when the object was captured Are usually limited to a single viewpoint selected by. Such a series of images , The observer said that his desired viewpoint was not selected, and / or Due to the fact that multiple different views of the object being taken into account are not taken into account, Often complained. In addition, multiple viewpoints of the object can be captured and used , If the observer has not selected some other perspective on the object? Still complained of due to the fact that it was not made available for observation. May hug you. SUMMARY OF THE INVENTION   The method and apparatus of the present invention address the above concerns and in the present invention, multiple images are captured. A shadow device provides a space for recording a continuous image of an object from multiple different viewpoints. It is positioned at the picked position. Laser (direction and distance) tracking device Determine the relative position of the chair and synchronize the relative position with the sequence of recorded images. Can be Displaying an object shot from one of the set (taken) viewpoints, If desired, the processor will be taken by the imaging device, as usual. The recorded image is presented to the user as described above. In addition, the processor is Also a series of images or still images of an object for display as if they were taken from the viewpoint selected by the observer. Imaging device for constructing a freeze frame image Observer input provided through the interface in relation to the determined relative position of the Manipulate the sequence of images taken according to. The processor is also a Taken to facilitate zooming in and out on the body and for display The image is processed under user control to remove unwanted parts of the imaged object. Brief description of the drawings   For a more complete understanding of the method and apparatus of the present invention, reference is made to the following detailed description. Thus, it can be said to be obtained when associated with the accompanying drawings. In these drawings And   FIG. 1 is a block diagram of the image processing system of the present invention.   FIG. 2 shows multiple shots around and around an object to be shot by the technique of the present invention. Figure 9 illustrates an example installation of a shadow device.   FIG. 3 shows mounting multiple imaging devices around and around the object to be photographed. Also, a movable structure for supporting is shown.   FIG. 4 is a flow chart of the first embodiment of the method of the present invention.   FIG. 5 is a flow chart of a second embodiment of the method of the present invention. Detailed description of the embodiment   A block diagram of the image processing system 10 of the present invention is shown in FIG. This System connected to storage device 14 (digitized optical camera, high definition Multiple imaging devices 12 (such as film cameras and / or 3D imaging cameras) including. A series of images taken by the imager 12 is processed in the manner described. Separately stored in the storage device 14 in synchronization with the recording time in preparation for future retrieval and processing. Remembered. In this way, a continuous image can be produced on film, light or Are stored on magnetic tape, optical or magnetic disks, or other suitable storage media. Communicating The storage device 14 used to store subsequent images does not have to be used for image retrieval as well. It goes without saying that there is nothing. Therefore, it has the function of storing image data on the medium. The ability to retrieve image data from a later medium may be performed in different locations . Further alternatively, the continuous image is processed for further processing in the manner described. , Using digitization, polarization, different bandwidth, or sequential simultaneous mixed transmission technology , From the imaging device 12 through the line 15 simultaneously, separately, and simultaneously simultaneously. It may be sent (and synchronized according to a time record). Through track 15 Image transmission is a "live" process of images as described further herein. And is particularly effective for display.   In FIG. 2, multiple images are taken at selected locations 16 spaced around the object 18. An example of installing the device 12 is shown. The plurality of imaging devices 12 are different from each other. Simultaneously record a series of images of the object 18 from the viewpoint (hereinafter referred to as the "set viewpoint" 17 "). It is preferably positioned at position 16 for recording.   As used herein, the term "object" 18 refers to a single item, person or thing only. A person, a group of people or a group of things that form a scene, or a particular geographical location Or commonly used to describe an event or activity occurring at that location. The imaged object 18 is therefore, without limitation, in a movie or television production. Instead of live performances such as concerts or sports events televised on television. Also includes "dynamic" events.   In the installation shown in FIG. 2, the five image pickup devices 12 are provided at the respective corners of the virtual square 20. One at a time and one just above the center of this square. As another installation form, A greater or lesser number of imaging devices 12 that are not necessarily completely enclosed It is also possible to take a form including (including a spherical form). The shape of the square 20 is It is just one use case. Therefore, a plurality of different objects 18 are to be imaged. The imaging devices 12 are spaced from each other at a position 16 that gives a set viewpoint 17 If so, the imaging device 12 can be positioned according to the invention in any desired manner. Wear.   In FIG. 1 and FIG. 2, recorded by the imaging device 12 and stored in the storage device 14. Thus, a plurality of consecutive images of the stored object 18 are stored from the storage device 14 to the processor 2 Imaging devices that are searchable simultaneously by two or in the "activity" mode of operation Can be received by the processor over line 15. (Use graphic An interactive device 24 (such as a human interface) is connected to the processor and Used to select the viewpoint from which the user wishes to observe the imaged object. Operated by the user. This selected viewpoint is determined by the imaging device 12 at the position 16. It may include one of a plurality of different setting viewpoints 17 provided by the user. Dialogue device 2 In response to such selection by the user through the processor 4, the processor 22 selects Acquire a series of images taken by the imager at position 16 and shadow these The image includes a monitor 28 or a virtual reality display helmet 30 It will be displayed on the display 26. Instead, to activate the device 24 In response, the user has a series of images taken for viewing in "still screen" mode. One of them can be selected.   Alternatively, the selected viewpoint may be any of the positions 16 associated with the placement of the imaging device 12. Are also defined by different selected positions (eg somewhere between these positions) May include dots. A representative selection position is illustrated in FIG. 2 as reference numeral 32. You. Such a viewpoint (hereinafter referred to as “selected viewpoint 33”) for the object 18 In response to such selection by the user through the interactive device 24, The sessa 22 has a series of recordings recorded by the imaging device 12 at each of the positions 16. Through the use of the fuzzy logic process 34 to capture the image and correspond to the selected position 32. A series of images or a single still image from a sequence of recorded images with a selected viewpoint 33 Form. This formed sequence of images or still images is also displayed on the display 26. Will be presented to the user above. Thus, according to the present invention, the user Provided by placing the imaging device 12 at position 16 relative to the set viewpoint 17. From the selected viewpoint 33 (at one of the positions 32) out of the way A shadow image or a series of images can be observed.   Through the use of the interaction device 24, the user can capture images with multiple imaging devices 12. Supported by the selected image (defined by the selected viewpoint 33, phantom (phantom) Object 1 to observe object 18 from any of a number of selected angles). "Move" around and near 8 and zoom in and out on objects Can be. Here, "supported" means that the processor 22 selects the position 32 and the distance. so Sufficient and appropriate image data necessary to form a continuous image or a still image is acquired by the imaging device. It means that it must be obtained by the device 12. Therefore, enough days High definition film or digital cameras are preferably used to obtain Good. Insufficient data exists to form a continuous or still image. In some situations, the processor 22 may select by the user at such a viewpoint or distance. Image with the best resolution and accuracy possible from existing image data. Will be formed. It should be further recognized that during zooming out the object from position 32 As the distance to 18 increases, the required fineness of the formed continuous images increases. It means that it will decrease considerably. It therefore forms an individual image or a series of images Less image data is needed by the processor 22 to hit Will be.   When zoomed out, the original distance between the imaging device 12 and the object 18 is passed and As there is a lack of available image data as the Or, the series of images or still images taken may contract. For processing zoom images Imaging device 12 that utilizes a fisheye lens to assist the processor 22 in hitting The image data from'completes the image formed or taken (full o ut) can be used to provide the edging image data needed for is there. In such cases, the image data provided by the imager 12 'may be The sequence cut out by the sessa 22 and provided by the conventional imaging device 12 is used. Added around a series of images or still images. The image curvature associated with the fisheye lens is Reduced or eliminated by processor 22 using conventional image processing techniques.   Note that in many installation configurations involving multiple imagers 12, one The image of the object 18 taken from the viewpoint 17 or configured for the selected viewpoint 33 is One of the imagers at position 16 of the other, or some other unwanted object or item May include. For example, in the form shown in FIG. A series of images of the object 18 taken by the imager 12 at one corner of the shape 20 is , May include imagers at diagonally opposite corners of the square. An object 18, eg sports taken during sporting events or other "active" events Considering a stadium or other venue, other objects in the captured image of this object Shooting The presence of the imager 12 would not be confusing. However, movies or TV Others, such as scenes taken in the studio or location for John Shaw For the object 18, the imager 12 (such as the operator of this device) in the image Being present (along with other junk objects) is very confusing and almost real. Absent. Therefore, the process is under the control of the user through the interaction device 24. The server 22 is capable of eliminating unnecessary terms from either the captured or formed continuous image or still image. Image subtraction logic 36 is further utilized to remove the eyes. Instead, no need Items may be color coded and removed through conventional blue masking techniques.   Form a series of images taken from a selected viewpoint 33 using fuzzy logic processing 34 In order to zoom in and out on the object 18, or shadows In order to remove unwanted parts of the imaged object through the image subtraction logic process 36, Some processing of the images taken by Sessa 22 may be different for other images. Spend much more time. Such a delay is output and formed for display It will destroy the continuity of the continuous image. Therefore, the processor 22 Prior to displaying the individual images constructed and / or output from the It further includes an image buffer 23 for sequentially storing over a delay of a predetermined time. Delaying time By storing the image in the buffer 23 of the It is possible to catch up with the image that has been output. The output from the buffer is When there is a continuous delay, a continuous method without interruption for observation from the selected viewpoint 33 The image is then presented by the display device 26. What was associated with the image If there is a sound, this is also delayed in the buffer 23 and output in synchronization. .   The processing of successive images by processor 22 discussed herein is mutually exclusive to imager 12. It is easily and more quickly achieved when the relative position to the is known. Shadow The relative position of the imaging device 12 is determined by the processor 2 through the interface 24. May be entered in 2. Instead of this, the present invention relates to one unit of the imaging device 12. A laser tracking device 31 positioned at a known position, which may include Including. The laser tracking device 31 is directed to and reflected from each imager 12. Firing a laser beam 35 (two such beams are shown in FIG. 2). ing). The reflected beam is the distance and direction (ie relative position) to each imager Is processed by the device 31 to determine Relative position of the imaging device 12 Is transmitted to the storage device 14 and stored with the recorded image, or Alternatively, in "activity" mode, it is transmitted directly to the processor 22 for imaging, Used for zooming and image subtraction processing. The position 16 of the imaging device 12 is fixed , The relative distance information only needs to be calculated once and the image of the object 18 is It is transmitted to the processor 22 prior to recording. On the contrary, the image pickup of the object 18 during photographing When the device 12 moves relative to each other, the relative position information is periodically transferred to the device 31. Therefore, the memory updated and synchronized with the recorded image according to the recording time It is transmitted to the device 14 or the processor 22.   Referring to FIG. 3, mounting a plurality of imaging devices 12 at position 16 A support and support structure 39 is shown. The structure 39 includes a plurality of telescopic arms 41. Including. A universal joint 43 is provided at each end of each one of the arms 41. Each arm 41 The far end of the upper universal joint 43 supports the mounting of the imaging device 12. Self The near-end one of the existing joints 43 is attached to the support frame 45.   The structure 39 is typically fixed in one position during the capture of the stationary object 18. Only However, for non-stationary objects 18, the structure 39 moves with the object being imaged. (E.g., track cart, track (t Ruck), including a helicopter, shown schematically in phantom) mounted on a vehicle 43 Be killed. The use of telescopic arm 41 and universal joint 43 allows multiple The invention at any one of a number of spaced positions 16 that provides a viewpoint Facilitates positioning of the plurality of imaging devices 12 according to. Ar for structure 39 The positions of the frame 41 and the joint 39 may be different during movement of the object 18 and / or the vehicle 43. It can be locked to maintain a substantially constant relative position between the imaging devices 12. Wear.   Referring now to FIG. 4, there is shown a flow chart of a first embodiment of the method of the present invention. I have. A continuous image of the object 18 is first obtained by capturing a plurality of image capture devices 1 having known relative positions. 2 (step 38). Next, the captured image data is the phantom angle. And zooming capabilities (step 40). The processed data is , Then recorded on the medium (step 42) or transmitted active hand (Step 44), a continuous image from the selected viewpoints 17 and 33 selected by the user is displayed. Subsequent processing for displaying each is performed. This kind of display can be selected by the user. And inputting preferred observation information such as distance (step 46). processing The imaged image data is then read in response to user input (step 48), A continuous image or a still image is input by the user (step 49) and the imaging device 12 is known. And the relative position of the image and transmitted to the monitor for observation (step 50).   Referring to FIG. 5, there is shown a flow chart of a second embodiment of the method of the present invention. Stuff A series of images of the body 18 is first obtained by a plurality of image pickup devices 12 having known relative positions. Are captured (step 52). The image is then recorded on a suitable medium. (Step 54). At this point, the sequence of recorded images is Understand that it may be packaged for Use of those images Image data is simultaneously accessed by the processor 22 (step 56), and to input user-friendly observation information through the use of an interactive observation device. Therefore, it is processed and processed according to the known relative position of the imaging device 12 ( (Step 58), whether to generate or form a continuous or still image for observation (step 60), or alternatively, a series of images or still images generated are recorded ( Step 62), and the record is then provided to the observer for later access. (Step 64).   The present invention retains the traditional role of directors in films, television shows and other works. It is not intended to be replaced or abolished. Smell like this The setting viewpoint 17 of the scene and event selected by the director is taken for the user's selection. It is provided with another set viewpoint 17 provided by the imaging device 12. In addition, the illusion The selected viewpoint 33 from the shadow angle can also be obtained by processing a continuous image according to the present invention. It will be available to the observer. If the observer wants to observe the director's choice, this The images of these are displayed. Otherwise, the observer may use the method and apparatus of the present invention. Used for the observations supported by the image data (taken or formed. You are free to choose any other viewpoint or distance (using either image You. Such observations would include observations of successive images as well as still images. .   One direct use of the present invention is for directors to view scenes from many perspectives 17. Will be recorded. Review the recorded images from the set viewpoint 17, To generate a continuous image or a still image from an illusion angle with one other selected viewpoint 33 Thus, the director selects the optimal angle and imager position to create the final record. be able to. In addition, many imaging devices produce different versions of works for general distribution. It can be used for the final shooting. In addition, the processor of the present invention runs a show. While viewing, the observer may choose another viewpoint 33 regarding the phantom angle at home or in the theater. It can be used to select. The feature of the still screen of the present invention is that the role acting is further Required when participating in a game (eg detective / detective or combat game) It facilitates careful consideration by the observer of the recorded scene.   A preferred embodiment of the method and apparatus of the present invention is illustrated in the accompanying drawings and described above in detail. Although described in the clear, the invention is not limited to the disclosed embodiments. And without contravening the spirit of the invention described and defined in the following claims. Many reconfigurations, modifications, and substitutions are possible.

────────────────────────────────────────────────── ─── Continuation of front page    (81) Designated countries EP (AT, BE, CH, DE, DK, ES, FR, GB, GR, IE, IT, LU, M C, NL, PT, SE), CA, JP (72) Inventor Batist, Gerald, Yi.             22094 Virginia, United States             Ston, North Bridge Road 1588

Claims (1)

[Claims]   1. Corresponding multiple imaging devices positioned at different positions A method of processing a sequence of imagery of an object taken from different perspectives,   Determining relative positions of the plurality of imaging devices with respect to each other,   The step of inputting a selection viewpoint for observing an object other than one of the plurality of shooting viewpoints, and And   From the sequence of images taken of the object and the determined relative position of the imaging device, An individual still screen image or object composed of objects as if they were taken from the input selection viewpoint. Is the step of constructing the sequence of images Including the method.   2. A method according to claim 1, wherein   Inputting a selective viewing distance from the object, and   Zoom in or zoom on the object as if taken from the selected viewing distance Processing a sequence of images taken or constructed for output The method further comprising:   3. A method according to claim 1, wherein a sequence of imaged images of the object is unnecessary. An object image, the method comprising the steps of: The method further comprises processing the constructed image.   4. A method according to claim 1, wherein the sequence of images taken is determined. The method further comprising the step of synchronizing relative positions.   5. The method of claim 1, wherein the method is taken for subsequent retrieval and processing. The step of storing the sequence of captured images and the determined relative position of the imaging device. Method included in.   6. The method according to claim 1, wherein the positioning position of the imaging device is The method changes during shooting of an object, the method comprising:   In the step of periodically re-determining the relative position of multiple imaging devices with respect to each other Therefore, the determined relative position changes as the position of the photographing device changes. And said re-determining step, and   Synchronize and relate the determined and changing relative positions to the sequence of images taken. Step The method further comprising:   7. An image processing device,   Positioned at different positions to take a series of images of an object from different perspectives Multiple shooting devices,   Means for determining the relative position of multiple imaging devices with respect to each other,   An input device that selects a viewpoint for observing an object other than one of a plurality of shooting viewpoints, and And   Connected to the imaging device, the determining means and the input device, From the sequence of images taken and the determined relative position of the imaging device, it is as if selective viewing An individual still screen image or a sequence of images composed of an object as if taken from a point. Processor including means for configuring Equipment including.   8. The apparatus according to claim 7, wherein the means for determining is a photographing device. A user interface connected to the processor for manual entry of the determined relative position Device, including   9. The apparatus according to claim 7, wherein the means for determining is a plurality of imaging devices. Determine the distance and direction to each one of the chairs and the relative position of the imaging device with respect to each other Projects a laser beam to each one of multiple imaging devices to identify the device Apparatus, including a laser tracking device to perform.   Ten. The apparatus according to claim 7, wherein the input device is used for observing an object. In order to further select the distance from the object, Zoom in or out on the object as if taken from the selected viewing distance. The apparatus further comprising means for processing the image taken or constructed to render the image.   11. The apparatus according to claim 7, wherein the sequence of images taken of the object is The object image is taken and the processor is taken to subtract the unwanted object image or The apparatus further comprising means for processing the constructed image.   12. The apparatus according to claim 7, wherein a plurality of photographing devices are determined. A device whose relative position is synchronized to the sequence of images taken.   13. The apparatus of claim 7, further comprising a processor for subsequent retrieval and Note the sequence of images taken for processing and the determined relative position of the imaging device. An apparatus further comprising a memory.   14. The apparatus according to claim 7, wherein the position of the photographing device is for photographing an object. The means of changing and determining in the shadow determine the relative position of multiple imaging devices with respect to each other. Means for periodically redetermining, wherein the determined varying relative position is captured A device that is synchronized and associated with a sequence of images.   15． The apparatus of claim 7, wherein the object comprises a moving object, A device for moving a plurality of photographing devices together with an object that moves during photographing. While maintaining the relative position of the imaging devices relative to each other substantially constant A device further comprising:   16. A device according to claim 15 wherein the means for moving is   Movable support stand,   Multiple telescopic arms, each arm pivoting on a movable support platform at the near end of each arm Physically attached, and   Pivotally attach one of multiple imaging devices to each distal end of multiple telescopic arms Means to kick An apparatus, including:   17． The apparatus according to claim 7, wherein the photographing device is digitizing Device, including a video camera.   18． The apparatus according to claim 7, wherein the photographing device is a three-dimensional photographing camera. A device that includes LA.   19. An image processing device,   Positioned at different positions in order to take a sequence of images of the object from different camera perspectives. Multiple cameras,   A laser tracking device that determines the relative position of the cameras with respect to each other,   An input device for selecting a viewpoint for observing an object other than one of the viewpoints of the camera, and   As if selected from the sequence of images taken of the object and the determined relative position of the camera. A series of individual still screen images and images in which an object is composed as if it was taken from an alternative viewpoint Connected to the camera, laser tracking device, and input device to configure Fuzzy logic processor Equipment including.   20. 20. The apparatus according to claim 19, wherein the input device is a distance from the object. Further enabling selection of separation, the device being as if taken from a selected viewing distance. Taken or composed to zoom in or out on the object as if it were The apparatus further comprising a zooming processor for processing the sequence of the imaged images.   twenty one. 20. Apparatus according to claim 19, wherein the sequence of images taken of the object is A device including an unwanted object image, the device being imaged to subtract the unwanted object image The apparatus further comprising an image subtraction processor for processing the composed or constructed image.   twenty two. 20. A device as claimed in claim 19 for subsequent retrieval and processing. Stores a series of captured images synchronized to a determined relative position of the imaging device An apparatus further comprising:   twenty three. A method of observing an object from a viewpoint determined by an observer,   Visually record objects from multiple different viewing positions to generate image data Step,   A step for inputting the selected observation position of the observer that is different from any of the recorded observation positions. ,   From the image data, to create an image of the object taken from the selected observation position, Processing the generated image data according to an alternative viewing position, and   Steps for displaying the composed image Including the method.   twenty four. The method according to claim 23, wherein the processing step comprises Processing the constructed image for a zoom-in and zoom-out observation. Hmm, how.   twenty five. A method of observing an object from a viewpoint determined by an observer,   It relates to the image of an object taken from different camera viewpoints by each of multiple cameras. Storing information that   Sending the stored information to a processor,   Selecting a viewpoint for the object other than any of the camera viewpoints,   From the information, the information is used to construct an image of the object taken from the selected viewpoint. Processing step, and   Observing the constructed image Including the method.   26. A device for observing an object from a viewpoint determined by an observer,   Multiple cameras that record images of objects taken from different camera perspectives,   Means for selecting a viewpoint for an object that is different from any of the camera viewpoints,   The recordings are made to construct images of objects taken from different selected viewpoints. Means for processing the captured image, and   Means for observing the composed image or recording the composed image Equipment including.   27. A device for observing an object from a viewpoint determined by an observer,   First camera means for obtaining image data of the object from the first viewpoint,   Second camera means for obtaining image data of the object from the second viewpoint,   Third camera means for obtaining image data of the object from the third viewpoint,   Observe to select a viewpoint to observe an object different from the first, second, and third viewpoints Observer interaction means capable of receiving human input, and   The image data from the camera is used to construct the image of the object taken from the selected viewpoint. Means responsive to the observer interaction means for processing Equipment including.   28. 28. The apparatus according to claim 27, wherein the processing means zooms an object. Further comprising means for processing images configured for in and zoom out observations, apparatus.   29. A device for observing an object from a viewpoint determined by an observer,   Multiple cameras that record images of objects taken from different camera perspectives,   Device for simultaneously transmitting recorded images synchronized according to the time of recording ,   To construct an image of an object taken from a selected viewpoint that is different from any of the camera viewpoints A computer processor for processing the simultaneously transmitted images,   To the computer processor to select a viewpoint for the constructed image A connected observer interaction device, and   Device for observing or recording a composed image Equipment including.   30. The method according to claim 23, wherein the image data of the object is the shadow of the object. A method for including data of an unnecessary portion of an image, the method including: removing an unnecessary portion from an image Further includes subtracting data associated with the unwanted portion from the image data, such as Method.   31. The method according to claim 25, wherein the image data of the object is the shadow of the object. A method for including data of an unnecessary portion of an image, the method including: removing an unnecessary portion from an image Further includes subtracting data associated with the unwanted portion from the image data, such as Method.   32. 27. The apparatus according to claim 26, wherein the image data of the object is the shadow of the object. A means for including and processing data for the unwanted part of the image removes the unwanted part from the image. Apparatus including means for subtracting data associated with unwanted portions from image data.   33. 28. The apparatus according to claim 27, wherein the image data of the object is the shadow of the object. A means for including and processing data for the unwanted part of the image removes the unwanted part from the image. Apparatus including means for subtracting data associated with unwanted portions from image data.   34. 30. The apparatus according to claim 29, wherein the image data of the object is the shadow of the object. The image processor contains data for unwanted parts of the image, and the computer processor is Means for subtracting data associated with unwanted parts from the image data so as to remove Mu, the device.   35. 25. The method of claim 24, wherein the processing step comprises zooming. When out, complete around the constructed image with fisheye image data Including, methods.