JP5598981B2 - Perceptual stimulus information generation system - Google Patents

Description

  The present invention relates to a perceptual stimulus information generation system, a perceptual stimulus information generation method, and a perceptual stimulus information generation program.

  Conventionally, a pin display is known as an output device that enables a visually handicapped person to acquire two-dimensional information using tactile sensation. The pin display is a display that displays computer character information, graphic information, and the like by unevenness by moving up and down a plurality of pins arranged two-dimensionally. In addition, a tactile mouse that can feed back tactile information according to the movement of the mouse to the user's fingertip by providing a pin display on the computer mouse is also known (see, for example, Patent Document 1).

  Furthermore, a vibration type display panel that can recognize two-dimensional image data such as television image data by tactile sense has been devised (for example, see Patent Document 2). In this vibration type display panel, vibration is generated by applying a voltage corresponding to the display pixel to the vibration element.

JP 2009-086229 A Japanese Patent Laid-Open No. 7-306634

  The pin display has problems such as being expensive, heavy, low resolution, and limited information that can be output. In addition, the tactile mouse has a problem that it is difficult to recognize the absolute position. Further, the vibration type display panel has a problem that the structure is complicated and expensive.

  Further, as a common problem, it is desired to transmit two-dimensional information such as an image to a visually impaired person such as a blind person, a weakly-sighted person, and a color-blind person, more intuitively and cheaply. On the other hand, even if the subject has no visual impairment, information transmission can be effectively carried out if two-dimensional information can be transmitted sensuously and inexpensively in combination with perception other than vision.

  The present invention provides a perceptual stimulus information generation system, a perceptual stimulus information generation method, and a perceptual stimulus information generation program capable of transmitting two-dimensional information at a lower cost by using a perception other than vision such as tactile sense. The purpose is to do.

The perceptual stimulus information generation system according to the embodiment of the present invention includes a type determination unit, an information conversion unit, and a control unit. Type determination means determines the type of the 2-dimensional images by acquiring two-dimensional images. The information conversion means is an image conversion process including at least one of a process of blurring text image data included in the two-dimensional image and an expansion process of a specific color region included in the two-dimensional image . The feature information representing the feature in the unit area corresponding to the designated position of the two-dimensional image is generated by the image conversion process on the two-dimensional image according to the type. The control unit controls the perceptual stimulus device so that a perceptual stimulus according to the feature information is given to the user of the two-dimensional image .

Furthermore, sensory stimulation information generating method according to an embodiment of the present invention includes the steps of determining the type of the acquired by the two-dimensional image a two-dimensional image, blurring the text image data included in the two-dimensional image processing and the an image conversion process includes at least one expansion process of a specific color region included in the two-dimensional image, the image conversion processing with respect to the two-dimensional image corresponding to the type of the two-dimensional image, designation of the two-dimensional image Generating feature information representing a feature in a unit region corresponding to the position; and controlling the perceptual stimulus device so that a perceptual stimulus corresponding to the feature information is given to the user of the two-dimensional image .

  The perceptual stimulus information generation program according to the embodiment of the present invention causes a computer to function as the above-described type determination unit, information conversion unit, and control unit.

The functional block diagram of the perceptual stimulus information generation system which concerns on the 1st Embodiment of this invention. The figure which shows the example which performed the 1st-order differentiation process as an image conversion process in the image conversion part shown in FIG. The figure which shows the example of the two-dimensional image in which it is effective to perform a 2nd-order differentiation process as an image conversion process in the image conversion part shown in FIG. The figure which shows the example which performed the binarization process and the outline extraction process as an image conversion process in the image conversion part shown in FIG. The figure which shows the example which performed the correction process of the spatial frequency as an image conversion process in the image conversion part shown in FIG. The figure which shows the example which performed the process which blurs text image data as an image conversion process in the image conversion part shown in FIG. The figure which shows the example which performed the process which extracts the area | region colored with the specific color as an image conversion process in the image conversion part shown in FIG. The figure which shows the example which performed the expansion process of the specific color area as an image conversion process in the image conversion part shown in FIG. The figure which shows the example which produced | generated the control signal which has a tone-verse waveform with three wave numbers in the stimulus control part shown in FIG. The figure which shows the example which produced | generated the control signal which has a waveform from which the height of a wave changes periodically in the stimulus control part shown in FIG. The figure which shows the specific example of the image conversion process in the image converter shown in FIG. 1, and the production | generation process of the control signal in a stimulus control part. The figure which shows the example which comprised the perceptual stimulus information generation system using the arithmetic unit of the microcomputer provided with the input / output terminal. The flowchart which shows the flow at the time of outputting the two-dimensional image displayed on the display of a computer as a perceptual stimulus by the perceptual stimulus information generation system shown in FIG. The block diagram of the perceptual stimulus information generation system which concerns on the 2nd Embodiment of this invention. The functional block diagram of the microcomputer shown in FIG.

  A perceptual stimulus information generation system, a perceptual stimulus information generation method, and a perceptual stimulus information generation program according to embodiments of the present invention will be described with reference to the accompanying drawings.

(First embodiment)

  FIG. 1 is a functional block diagram of a perceptual stimulus information generation system according to the first embodiment of the present invention.

  The perceptual stimulus information generation system 1 is a system that conveys information related to a two-dimensional image to the user without using vision by giving the user a perceptual stimulus according to the two-dimensional image. A perceptual stimulus information generation system 1 shown in FIG. 1 shows a configuration example in the case where perceptual stimuli are generated according to a two-dimensional image displayed on a computer 2 such as a personal computer or a mobile phone.

  The perceptual stimulus information generation system 1 includes a data processing system 3 and a perceptual stimulus device 4.

  The data processing system 3 generates a control signal corresponding to the two-dimensional image data displayed on the computer 2, and outputs the generated control signal to the perceptual stimulation device 4 or a desired device provided in the computer 2, thereby performing perception. It has a function of controlling the stimulation device 4 or the computer 2. The data processing system 3 can be constructed by causing the arithmetic device 5 of the computer 2 to read a perceptual stimulus information generation program. Specifically, the data processing system 3 causes the arithmetic device 5 of the computer 2 to function as an image type determination unit 3A, an image conversion unit 3B, and a stimulus control unit 3C. However, a circuit may be used to configure the data processing system 3.

  The perceptual stimulus information generation program can be recorded on an information recording medium and distributed as a program product so that the computer 2 can be used as the data processing system 3 of the perceptual stimulus information generation system 1. Of course, the perceptual stimulus information generation program can be downloaded to the computer 2 via a network without using an information recording medium.

  In addition to the arithmetic device 5, the computer 2 includes a position input device 6, a display 7, an instruction input device 8, and a vibration speaker 9. The arithmetic device 5 of the computer 2 functions as the display image generation unit 10 as an original function.

  The display 7 is a monitor capable of displaying a two-dimensional image. Therefore, the display 7 may be omitted when the user does not use vision.

  The display image generation unit 10 has a function of generating two-dimensional image data to be displayed on the display 7 and a function of displaying the two-dimensional image on the display 7 by giving the generated two-dimensional image data to the display 7. .

  The position input device 6 has a function of designating an absolute two-dimensional position of a two-dimensional image displayed on the display 7 and inputting it to the computer 2 as designated position information. FIG. 1 shows an example in which a computer 2 includes a touch panel 11 in which a display 7 and a position input device 6 are arranged in a layered structure.

  The touch panel 11 has a plurality of methods, and any method can be used. Specifically, the touch panel 11 includes a resistive film method, a surface acoustic wave method (ultrasonic method), an infrared method (optical method), an electromagnetic induction method, a capacitance method, and the like. The touch panel 11 includes a method in which position information can be input mainly using a pointing tool other than a finger, such as a touch pen, and a method in which position information cannot be input unless the pointing tool has physical characteristics equivalent to those of the finger or the finger. There is. In addition, in the case of the electromagnetic induction method, a dedicated electromagnetic induction pen is required to input position information.

  For this reason, in accordance with the method of the touch panel 11, an indication instrument for inputting position information via the touch panel 11 such as a touch pen or an electromagnetic induction pen is provided as a component of the position input device 6. FIG. 1 shows an example in which a touch pen 11 </ b> A is provided as an accessory of the touch panel 11.

  If the touch panel 11 is used as the position input device 6 and the display 7, the position at which the finger or the pointing tool is brought into contact with or close to the display 7 is input to the computer 2 as the specified position information. For this reason, even if the user is a visually handicapped person such as a blind person or a low vision person, it is possible to input the designated position information to the computer 2 while confirming the position of the two-dimensional image intuitively and sensuously. . Further, even when the user operates the position input device 6 using vision, the designated position information can be easily input to the computer 2 through reference to the two-dimensional image.

  However, the position input device 6 other than the touch panel 11 may be used as long as the position input device 6 can input the specified position information of the absolute two-dimensional position of the two-dimensional image displayed on the display 7 to the computer 2. It can also be used. In other words, various existing input devices can be used as the position input device 6 if the user can recognize the range of two-dimensional positions that can be specified.

  For example, a touch pad having a finite size can be used as the position input device 6 as it is. Or, even an input device that inputs a relative two-dimensional position, such as a mouse, a trackball, or a pointing device, when a boundary of a specifiable two-dimensional position range is specified, vibration, sound, or voice By providing a function for notifying the user of the boundary of a two-dimensional area that can be specified as an input device itself or an arbitrary device, it can be used as a position input device 6 for inputting designated position information of an absolute two-dimensional position. it can.

  The instruction input device 8 is an input device for inputting instruction information other than the position to the computer 2. The instruction input device 8 includes input devices such as a keyboard and a mouse. Further, when an operation of pressing an electronic button displayed on the touch panel 11 or selecting from a plurality of options is performed through the touch panel 11, the touch panel 11 serves as both the position input device 6 and the instruction input device 8. The same applies when an input device such as a touch pad is used as the position input device 6.

  When the user is visually impaired, the operation of the instruction input device 8 can be supported by using screen reader technology. The screen reader is a technology that reads out information displayed on the display 7 by voice.

  The vibration speaker 9 is a device that vibrates in accordance with a sound signal output from the arithmetic device 5 and generates sound. That is, the speaker is provided with a vibrator.

  The perceptual stimulation device 4 transmits a single or a plurality of perceptions other than human vision according to a control signal output from the data processing system 3 in order to transmit information about the two-dimensional image displayed on the display 7 to the user. A device that stimulates directly or indirectly in one or more ways.

  The sense of stimulation is most effective from the viewpoint of transmitting information to the user more easily and cheaply. Moreover, in order to transmit information with a simpler configuration, a function for stimulating hearing may be provided in the perceptual stimulation device 4. When stimulating hearing, the sensory stimulation device 4 is provided with a speaker 4A.

  On the other hand, typical methods for stimulating the sense of touch include electrical stimulation and vibration.

  Electrical stimulation can be applied by applying a voltage having a predetermined intensity and pattern to a part of a human body such as a finger or a hand. Theoretically, by controlling the voltage applied to the human body, it is possible to simulate a tactile sensation when an object of any material is touched. When electrical stimulation is applied to the human body, the perceptual stimulation device 4 is provided with a voltage application device 4B having electrodes. In this case, making the applied voltage variable is effective from the viewpoint of transmitting more detailed information.

  When stimulating the sense of touch with vibration, the sensory stimulation device 4 can be configured very simply using a vibrator 4C such as an eccentric motor. Note that the sense of touch can be stimulated using ultrasonic vibration, which is a type of vibration. As a vibration conduction method, there are a method of conducting directly from the sensory stimulation device 4 to the human body and a method of conducting indirectly.

  In the case where vibration is directly conducted to the human body, the sensory stimulation device 4 can be configured by fixing the vibrator 4C to a shape that can be worn on the human body and a material mounting portion. For example, when vibration is applied to a finger, the sensory stimulation device 4 can be configured by attaching a vibration motor to a resilient C-shaped or ring-shaped frame or fiber material.

  In this case, the perceptual stimulation device 4 may be configured by providing a plurality of transducers 4C in a plurality of mounting portions so that vibration can be applied to a plurality of fingers. If the vibrator 4C is provided on a plurality of fingers, different vibrations can be applied to each finger. For this reason, it is possible to cope with multi-position input to the touch panel 11 using a plurality of fingers.

  When the vibration is indirectly conducted to the human body, it is effective to apply the vibration to the human body via the position input device 6 operated by a finger or a hand. Therefore, the perceptual stimulation device 4 can be configured to vibrate the pointing device of the touch panel 11 such as the touch pen 11A or the touch panel 11 itself. When the position input device 6 is an input device such as a mouse, a touch pad, a trackball, or a pointer, these input devices may be vibrated. In this case, a vibrator 4C such as a vibration motor may be brought into contact with a vibrating body such as the touch panel 11 or the touch pen 11A. Therefore, the perceptual stimulation device 4 can be configured by providing the vibrator 4C such as a vibration motor with a fixture for the vibrating body.

  As shown in FIG. 1, when the vibration speaker 9 is provided in the computer 2, the touch panel 11 can be vibrated by controlling the vibration speaker 9. If the vibration speaker 9 is used, tactile stimulation by vibration and auditory stimulation by sound can be used in combination. The same applies to the case where a vibration speaker is used as the vibrator 4C in the perceptual stimulation device 4.

  When the computer 2 is a mobile phone, the computer 2 is normally equipped with a vibration mechanism. Accordingly, when the computer 2 is provided with a vibration mechanism such as the vibration speaker 9 and the vibration mechanism can be controlled, the perceptual stimulation device 4 may be omitted. On the contrary, if the perceptual stimulation device 4 is provided, the tactile sensation of the human body can be stimulated even if the computer 2 is not equipped with a vibration mechanism such as the vibration speaker 9.

  When the output from the computer 2 is not sufficient, an amplifier 4D is provided in the perceptual stimulation device 4 as necessary. The input side of the amplifier 4D is connected to the computer 2, and components that generate stimuli such as the vibrator 4C, the speaker 4A, and the voltage applying device 4B are connected to the output side of the amplifier 4D.

  The image type determination unit 3A of the computer 2 acquires at least a part of the two-dimensional image data displayed on the display 7 from the display image generation unit 10 and determines the type of the displayed two-dimensional image. Have

  The type of the two-dimensional image can be specified by various classification methods. For example, focusing on color, a two-dimensional image may be a black and white binary image, a multi-value grayscale image displayed in luminance, a binary or multi-value color image, or a three-dimensional (3D) image. And so on. Or if you pay attention to the contents and attributes of images, 2D images can be used for still images such as digital photographs, videos, text documents, images such as tables, graphs, drawings, and illustrations, and CG (computer graphic) types. Can be classified.

  The above-described determination of the type of the two-dimensional image can be automatically performed by data processing on the two-dimensional image data in the image type determination unit 3A. However, the determination or the determination result can be manually changed based on the instruction information input from the instruction input device 8 by the user's operation. When the image type determination process is automatically performed, the image type determination unit 3A determines whether the two-dimensional image data is color image data or black-and-white image data. The two-dimensional image data is binary image data. Necessity of threshold value processing for pixel value of two-dimensional image data, threshold processing for n-th order differential value (n is an arbitrary natural number) regarding position change of two-dimensional image data, etc. Data processing.

  Examples of the detailed method of the determination processing described above include a method based on the data format of two-dimensional image data, a method based on a histogram of pixel values, and a method based on data obtained by performing predetermined conversion processing on image data. It is done.

  For example, when the data format of the two-dimensional image data is a monochrome bitmap format, it can be determined that the type of the two-dimensional image is a monochrome binary image.

  If the pixel value histogram is binary, it can be determined that the image data is binary image data. On the other hand, when it is determined that the histograms of the RGB values are similar to each other by threshold processing on the correlation coefficient between the histograms of the RGB values, the type of the two-dimensional image is determined to be a grayscale image. be able to. Further, when each histogram of RGB values exhibits a plurality of discontinuous peaks, it can be determined that the type of the two-dimensional image is an image from which a specific color can be extracted. Furthermore, an arbitrary process such as a smoothing process may be performed on the histogram of pixel values.

  As another example, two-dimensional image data is converted into HSV color space data or hue, saturation, and luminance (Luminance) consisting of the three components of hue, saturation, and value. ) And the color space data such as the HLS color space data, and the type of the two-dimensional image can be determined based on the color space data. For example, when it is determined that the hue fluctuation is small by threshold processing for an index representing hue fluctuation in the color space data, the type of the two-dimensional image can be determined to be a grayscale image.

  A plurality of different types of two-dimensional images may be displayed on the display 7. In this case, the two-dimensional image is determined to be a plurality of types different for each position.

  Because of such determination processing, the image type determination unit 3A can determine the entire two-dimensional image data displayed on the display 7 or at least the type of the two-dimensional image displayed on the display 7. A range of two-dimensional image data is configured to be acquired from the display image generation unit 10.

  That is, when the entire 2D image data is used to determine the type of the 2D image, the image type determination unit 3A displays the entire 2D image data regardless of the designated position information input from the position input device 6. Obtained from the image generator 10. On the other hand, when a part of the two-dimensional image data is used for the determination of the type of the two-dimensional image, the image type determination unit 3A has a range of two-dimensional image data corresponding to the designated position information input from the position input device 6. Is obtained from the display image generation unit 10. For example, the image type determination unit 3 </ b> A acquires, from the display image generation unit 10, two-dimensional image data within a preset range around the position specified by the position input device 6.

  That is, the type of the two-dimensional image cannot be determined only from the pixel value at the designated position input from the position input device 6. Therefore, the type of image is determined based on pixels in a range sufficient for determining the type of image including the periphery of the designated position.

  If the entire two-dimensional image data is used for the determination of the type of the two-dimensional image, more reliable determination can be expected. On the other hand, if a part of the two-dimensional image data is used for determining the type of the two-dimensional image, the data processing can be speeded up and the real-time property can be improved.

  The image conversion unit 3B generates feature image data as intermediate image data representing the characteristics of the two-dimensional image data corresponding to the image type based on the image type information generated as a determination result in the image type determination unit 3A. And a function of giving the stimulus control unit 3C pixel value information of feature image data within a predetermined range corresponding to the designated position information acquired from the position input device 6. Further, the image conversion unit 3B generates a feature image data in a partial area including the pixel values of the entire two-dimensional image data from the display image generation unit 10 or at least the designated position input from the position input device 6. The pixel value of the corresponding two-dimensional image data is configured to be acquired.

  The feature image data is image data that can be easily recognized even if the user is visually impaired. In particular, image data obtained by simplifying features of two-dimensional image data corresponding to the type of image or image data in which features of two-dimensional image data corresponding to the type of image are emphasized may be easily recognized image data. Many. Such feature image data can be generated by image conversion processing on two-dimensional image data determined empirically or experimentally.

  The image conversion process is configured by a desired single or a plurality of processes, and the combination of the processes can be determined in advance as an appropriate combination according to the type of image. Specific examples of the image conversion processing method include spatial frequency correction processing, gradation correction processing, binarization processing, position or region extraction processing corresponding to a specific color, smoothing processing that intentionally blurs an image, and gamma conversion. , N-th order differential processing.

  However, a desired image conversion processing method may be selected from a plurality of image conversion processing methods based on the instruction information input from the instruction input device 8. That is, in addition to the above-described image types, the image conversion processing method can be manually changed according to the purpose of the user.

  FIG. 2 is a diagram illustrating an example in which the first-order differentiation process is performed as the image conversion process in the image conversion unit 3B illustrated in FIG.

  As shown in FIG. 2A, when image data representing a simple colored figure is obtained as two-dimensional image data around a specified position or by image conversion processing on the two-dimensional image data, When the first-order differentiation process is performed, feature image data from which the contour of the figure is extracted is generated as shown in (B). That is, in this case, the first-order differentiation process is a figure contour extraction process. In particular, when the user is visually impaired, the contour information of the graphic as shown in FIG. 2 (B) is simpler information than the colored graphic information as shown in FIG. 2 (A). Easy to recognize.

  FIG. 3 is a diagram illustrating an example of a two-dimensional image in which it is effective to perform second-order differentiation processing as image conversion processing in the image conversion unit 3B illustrated in FIG.

  As shown in FIG. 3A, when image data expressing a cylinder in two dimensions by shading is obtained, the contour of the bottom edge can be extracted by performing the first-order differentiation process. However, in order to represent the variation in curvature on the side surface of the cylinder as a simplified two-dimensional image, the second-order differentiation process for the image data shown in FIG. 3A is effective.

  FIG. 4 is a diagram illustrating an example in which binarization processing and contour extraction processing are performed as image conversion processing in the image conversion unit 3B illustrated in FIG.

  As shown in FIG. 4A, when the type of the two-dimensional image data around the designated position is a color still image, if binarization processing is performed on the still image data, the result shown in FIG. As shown, feature image data having a white area and a black area is generated. Therefore, if there is support information such as a still image being a landscape image, it is possible to generate image data that makes it easy to distinguish an empty region and a ground region including a mountain from the shape of the region. On the other hand, if contour extraction processing such as differentiation processing is performed on the two-dimensional image data, feature image data in which the boundary of the region is extracted is generated as shown in FIG. According to the contour extraction image shown in FIG. 4C, the sky / mountain boundary can be easily recognized.

  As a similar application example, if there is support information that the type of 2D image data is an anatomical chart, simplified feature image data that makes it easy to distinguish between a bone region and a muscle region is used for 2D image data. It can be generated by image conversion.

  FIG. 5 is a diagram illustrating an example in which a spatial frequency correction process is performed as an image conversion process in the image conversion unit 3B illustrated in FIG.

  As shown in FIG. 5A, when the contour image data is obtained, the contour line becomes thin if the spatial frequency is large. Therefore, by applying correction processing for reducing the spatial frequency to the contour image data, contour image data with a thick line as shown in FIG. 5B can be generated. As the correction processing, for example, when the spatial frequency exceeds a preset threshold value, there are correction for adjusting to a smaller specific value, correction for reducing the spatial frequency at a certain rate, and the like.

  FIG. 6 is a diagram showing an example in which text image data is blurred as image conversion processing in the image conversion unit 3B shown in FIG.

  When the visually handicapped person wants to confirm the layout of characters from the image data indicating the text as shown in FIG. 6A, a process of intentionally blurring the text such as smoothing process or gamma conversion on the original image data. When applied, image data as shown in FIG. 6B is generated. In the image data shown in FIG. 6B, although the text is displayed inaccurately so that the text cannot be read, each character becomes thick, and as a result, the character arrangement direction is emphasized. Accordingly, the image data shown in FIG. 6B may be appropriate for the visually impaired.

  Similarly, when checking the layout of a document or the layout of an operating screen of an OS (operating system), such blurring processing may be effective. Conversely, when trying to recognize the shape of a character, image processing that emphasizes the outline of the character itself is appropriate. In other words, when the user's purpose is to obtain image information globally, a process for suppressing local image elements is appropriate, and the user's purpose is to obtain local image information. In many cases, a process for enhancing local image elements is appropriate.

  FIG. 7 is a diagram illustrating an example in which processing for extracting a region colored in a specific color is performed as image conversion processing in the image conversion unit 3B illustrated in FIG.

  When the presence or absence of a seal impressed by a visually impaired person in vermilion is confirmed from image data indicating text as shown in FIG. 7A, when the vermilion region is extracted from the original image data, Image data as shown in FIG. 7 (B) is generated. In the image data shown in FIG. 7B, although the text has disappeared, the imprinted portion is selectively depicted. Therefore, for the visually impaired, the image data shown in FIG. 7B is more effective for recognizing the presence or absence of the seal.

  In addition, you may perform the process which expands the extracted specific color area | region. For example, in the case of extracting seal impressions, it is effective to combine them by enlarging adjacent vermilion regions.

  FIG. 8 is a diagram illustrating an example in which a specific color region expansion process is performed as an image conversion process in the image conversion unit 3B illustrated in FIG.

  As shown in FIG. 8A, when a plurality of fine color regions are extracted in a distributed manner, it is effective to expand and combine the color regions as shown in FIG. 8B. Even if processing for reducing the spatial frequency is performed, a plurality of regions can be combined. However, if the process of expanding a specific area is performed, the area of interest can be more emphasized and reliably extracted.

  As another example of the image conversion process, there is a process of adding a texture used as a pattern of a graphic area displayed three-dimensionally in a pattern or CG to a specific area. Thereby, it becomes easy to specify an area on the image data due to a difference in a periodic pattern such as a texture.

  As in the above example, appropriate image conversion processing depends not only on the type of two-dimensional image data but also on the purpose of the user. Therefore, the image conversion unit 3B automatically predicts the user's purpose based on the history information of the designated position input from the position input device 6, and sets a mode for changing the image conversion processing method according to the predicted purpose. May be.

  For example, when the designated position input from the position input device 6 is stationary, the user can predict that the purpose is to acquire local image information at the designated position. Conversely, when the designated position input from the position input device 6 is moving intermittently or continuously, it can be predicted that the purpose is to acquire global image information.

  Therefore, when the designated position is stationary, an image conversion process is performed to generate more detailed image data. When the designated position is moving, simpler image data is generated. The processing method in the image conversion unit 3B can be determined in advance so as to execute the image conversion process.

  On the other hand, image conversion that does not depend on the user's purpose can be automatically executed according to the type of image. For example, the image processing method can be determined so that the image conversion unit 3B automatically executes the spatial frequency correction process, the gradation correction process, and the like according to the type of image.

  Further, a predetermined range corresponding to the designated position to be given to the stimulus control unit 3C is also included in a desired area around the designated position by inputting the instruction information from the instruction input device 8 to the image conversion unit 3B. A plurality of pixels can be variably set as a unit pixel region. For example, it is practical that the unit pixel region is a region in which a necessary resolution equivalent to the contact area when the finger or the touch pen 11A is brought into contact with the touch panel 11 can be obtained.

  Therefore, the width of the unit pixel area may be set in correspondence with the spatial frequency of the feature image data. For example, if the spatial frequency of the feature image data is high, the feature image data becomes fine image data. Therefore, higher resolution is required to obtain feature image data information. For this reason, the unit pixel area may be set small so as to obtain the required resolution depending on the spatial frequency. On the other hand, if the spatial frequency is low, the feature image data becomes coarse image data. Therefore, it is only necessary to obtain a coarse resolution, and the unit pixel area can be set wide so that rough information is transmitted to the user.

  However, a single pixel may be used as a unit pixel region in order to support high resolution regardless of conditions such as spatial frequency.

  Then, the feature image data of the unit pixel region corresponding to the designated position is the target data given from the image conversion unit 3B to the stimulus control unit 3C. Therefore, the image conversion unit 3B may generate feature image data only for the unit pixel region, or generate feature image data having a wider range than the unit pixel region and extract the data of the unit pixel region. May be. And perception stimulation according to the characteristic image data of a unit pixel area is given to a user by control of perceptual stimulus device 4 or vibration speaker 9 by stimulus control part 3C mentioned below.

  From the viewpoint of transmitting information to the user more easily and cheaply through the perceptual stimulus, it is very effective to give a perceptual stimulus to the finger or hand at the timing when the position is specified by operating the position input device 6. For example, if the display 7 is vibrated at the timing when the user touches the touch panel 11, even if the entire touch panel 11 is vibrated, it can be recognized that the position touched by the user vibrates. Therefore, if the delay time from the input of the specified position to the occurrence of the perceptual stimulus is long, the effect of information transmission is reduced. The delay time can be shortened to some extent by increasing the unit pixel area.

  Furthermore, by performing control based on the predicted specified position, the delay time from the input of the specified position to the occurrence of the perceptual stimulus can be shortened without unnecessarily increasing the unit pixel area, that is, without sacrificing the resolution. Can do.

  The designated position at a certain time in the future can be predicted in advance based on history information indicating the locus of the designated position at each past time, that is, the moving direction and moving speed immediately before the specified position. Therefore, an area centered on the future designated position predicted based on the designated position history information including the moving direction and moving speed of the designated position at each past time and the latest designated position information acquired from the position input device 6 is obtained. A unit pixel region may be used. For example, a position moved from the latest designated position by the time required from the input timing of the designated position to the occurrence of the perceptual stimulus can be predicted as a future designated position.

  By such control, output delay due to data processing and control signal transmission can be corrected. And tactile stimulation by vibration etc. can always be given in the position which touched the user in real time. This control can also be applied to the image type determination process corresponding to the designated position in the image type determination unit 3A.

  The stimulus control unit 3C generates a control signal based on the pixel value of the feature image data in the unit pixel region corresponding to the designated position acquired from the image conversion unit 3B, and the generated control signal is transmitted to the perceptual stimulation device 4 or the vibration. A function of outputting to the speaker 9 is provided. That is, the stimulus control unit 3C has a function of transmitting the feature near the specified position of the feature image data to the user as a perceptual stimulus of a predetermined pattern by controlling the perceptual stimulus device 4 or the vibration speaker 9.

  The control signal can be generated by converting pixel value information in the unit pixel region corresponding to the designated position according to a predetermined rule. The conversion rule to the control signal can be variably set to a desired rule by inputting instruction information from the instruction input device 8 to the stimulus control unit 3C.

  When the control target by the control signal is one or a combination of the vibrator 4C, the speaker 4A, the voltage applying device 4B, and the vibration speaker 9, as shown in FIG. 1, vibration, sound, voltage, etc. In addition to the amplitude and frequency of the subject to which the sensory stimulus is applied, parameters such as wave number (number of peaks), wave area (power), and swell can be set in correspondence with the pixel values of the feature image data.

  FIG. 9 is a diagram showing an example in which a control signal having a tone-verse waveform with three wave numbers is generated in the stimulus control unit 3C shown in FIG. 1, and FIG. 10 is a diagram showing the wave height in the stimulus control unit 3C shown in FIG. It is a figure which shows the example which produced | generated the control signal which has a waveform which changes periodically.

  For example, when the feature image data is binary black-and-white image data, a control signal is transmitted so that the presence / absence of a value in the unit pixel area specified at the designated position can be transmitted to the user as the presence / absence of vibration, voltage, or sound. Can be generated. In this case, the user can recognize the outline and area of the feature image data based on the presence or absence of the stimulus.

  On the other hand, if the feature image data is multivalued image data, the density or luminance of the feature image data can be made to correspond to the amplitude of the control signal or the length of the frequency. In this case, the user can determine the density of the feature image data based on vibration, voltage, or sound intensity and frequency.

  If the feature image data is color image data, the hue and saturation can be made to correspond to the amplitude of the control signal, the level of the frequency, and combinations of these patterns. In this case, the user can determine the hue and saturation of the feature image data based on vibration, voltage, or sound intensity and frequency. In addition, the control signal can be generated so as to generate vibration, voltage, or sound only when a pixel of a specific color such as green exists in the unit pixel region specified at the specified position. In this case, the user can determine the presence or absence of the specific color based on the presence or absence of vibration, voltage, or sound.

  As another example, when it is determined that the designated position is in the predetermined region for a predetermined time or longer, the control signal can be switched so that detailed information at that point can be transmitted. For example, the RGB value can be expressed by the wave height of three divided vibrations, or by the vibration corresponding to the hue.

  FIG. 11 is a diagram illustrating a specific example of the image conversion process in the image conversion unit 3B and the control signal generation process in the stimulus control unit 3C illustrated in FIG.

  As shown in FIG. 11A, when the image data to be observed is image data of a document used for paperwork or the like, the document data stamped on a monochrome image or the document data highlighted in red is displayed. As described above, colors are often used in a small part. Therefore, when image data division processing is performed in the image conversion unit 3B as shown in FIG. 11B, the area excluding the range set in advance as a local area is monochrome binary data or grayscale data. If it is, it can be determined that the document data uses a color locally.

  Therefore, when the color region extraction process shown in FIG. 7 is performed in the image conversion unit 3B and the stimulus control unit 3C generates a control signal that generates vibrations different from the black region in the colored region, the user can select a color other than black. Can recognize the presence and area.

  By the way, when the computer 2 is a personal computer, by connecting the perceptual stimulation device 4 to the audio output terminal or the beep speaker, the control signal can be easily perceived from the stimulation control unit 3C without changing the existing structure. It can be output to the device 4. The Beep speaker is a speaker that is responsible for outputting a simple Beep sound generated by a Beep function with frequency and time as arguments. In this case, in order to generate sufficient vibration, sound, or voltage from the perceptual stimulation device 4, it is necessary to connect an amplifier (amplifier) 4D to the vibrator 4C, the speaker 4A, or the voltage application device 4B.

  Further, FIG. 1 shows an example in which the data processing system 3 is built in the computing device 5 of the computer 2 itself that outputs a two-dimensional image that is a target of information transmission, but the data processing system is used by using another computing device. 3 may be configured.

  FIG. 12 is a diagram illustrating an example in which the perceptual stimulus information generation system 1 is configured using a microcomputer arithmetic device having input / output terminals.

  As shown in FIG. 12, the perceptual stimulus information is also obtained by connecting the perceptual stimulus device 4 to the output port 21 side of the microcomputer 22 provided with the universal serial bus (USB) terminal 20 and the output port 21. The generation system 1 can be configured. In this case, the data processing system 3 is constructed by causing the arithmetic unit of the microcomputer 22 to read the perceptual stimulus information generation program.

  By configuring the perceptual stimulus information generation system 1 as shown in FIG. 12, it can be connected to an existing computer 2A as an attachment. For this reason, the information regarding the two-dimensional image displayed on the computer 2A can be easily transmitted to the user using the perceptual stimulus without changing the structure of the computer 2A. In particular, if the perceptual stimulus information generation system 1 is configured as shown in FIG. 12, the speaker 9A built in the computer 2A can be used for the screen reader function. Therefore, by using the screen reader and the sensory stimulus in combination, information can be transmitted to the user at a lower cost.

  Next, the operation and action of the perceptual stimulus information generation system 1 will be described.

  FIG. 13 is a flowchart showing a flow when the two-dimensional image displayed on the display 7 of the computer 2 is output as a perceptual stimulus by the perceptual stimulus information generation system 1 shown in FIG.

  First, in step S <b> 1, the image type determination unit 3 </ b> A acquires the two-dimensional image data output to the display 7 of the computer 2 from the display image generation unit 10.

  Next, in step S2, the image type determination unit 3A automatically performs the type of the acquired two-dimensional image data according to a preset data processing method. In addition, when necessary, the user operates the instruction input device 8 to specify the data processing method of the two-dimensional image data or the type of the two-dimensional image data itself.

  Next, in step S <b> 3, the image conversion unit 3 </ b> B acquires specified position information from the position input device 6 such as the touch panel 11. That is, when the user operates the position input device 6 to specify a position on the two-dimensional image displayed on the display 7, the specified position is acquired from the position input device 6 as position specifying information by the image conversion unit 3B. .

  Next, in step S4, the image conversion unit 3B represents the characteristics of the two-dimensional image data in the unit pixel region corresponding to the designated position based on the image type information generated as the determination result in the image type determination unit 3A. The feature image data that is easy to recognize is generated. That is, the image conversion unit 3B generates the feature image data of the unit pixel region corresponding to the designated position by a combination of image conversion processes as shown in FIG. 2, FIG. 4, FIG. 5, FIG. At this time, by setting the region corresponding to the predicted designated position as the unit pixel region, the delay between input and output can be shortened.

  Then, the image conversion unit 3B gives the feature image data in the unit pixel area corresponding to the designated position to the stimulus control unit 3C.

  Next, in step S5, the stimulus control unit 3C generates a control signal for one or both of the perceptual stimulus device 4 and the vibration speaker 9 according to a preset method based on the pixel value of the feature image data in the unit pixel region. . This method of generating the control signal can also be specified by inputting instruction information from the instruction input device 8 to the stimulus control unit 3C.

  Next, in step S <b> 6, the stimulus control unit 3 </ b> C outputs the generated control signal to one or both of the perceptual stimulus device 4 and the vibration speaker 9. Accordingly, when information is transmitted to the user using vibration, the vibrator 4C and the vibration speaker 9 of the perceptual stimulation device 4 generate vibration according to the feature image data at the designated position according to the control signal. When information is transmitted to the user using sound, the speaker 4A and the vibration speaker 9 of the perceptual stimulation device 4 generate sound corresponding to the feature image data at the designated position according to the control signal. Furthermore, when information is transmitted to the user using electrical stimulation, the voltage application device 4B of the perceptual stimulation device 4 directly or indirectly performs electrical stimulation according to the feature image data at the designated position according to the control signal. Give to the user.

  For this reason, the user can recognize the image information at the designated position of the two-dimensional image as a perceptual stimulus according to the type and attribute of the information. Moreover, the perceptual stimulus is generated based on the feature image generated by converting the two-dimensional image so that the feature can be easily recognized according to the type of the image. Therefore, the user can more easily recognize information regarding the two-dimensional image.

  That is, the perceptual stimulus information generation system 1 as described above converts the two-dimensional image information displayed on the display 7 into a simplified or characterized feature image according to the type and purpose of the image, and the touch panel 11 or the like. A perceptual stimulus by vibration or the like is given to the user based on the feature image corresponding to the designated position acquired from the position input device 6.

  Therefore, according to the perceptual stimulus information generation system 1, even a user who does not use vision can selectively and easily recognize desired information from the two-dimensional image displayed on the display 7.

  In particular, in the perceptual stimulus information generation system 1, local pixel values of displayed two-dimensional image data are not converted into vibrations or electrical stimuli, but are determined based on global two-dimensional image data in advance. Perceptual stimuli such as vibrations and electrical stimuli are generated from the pixel values of the feature image data generated so as to facilitate feature recognition according to the type of image. In addition, the user recognizes that a perceptual stimulus has been received at the position where the designated position is input. For this reason, for a user who does not use vision, information about a two-dimensional image can be obtained as a perceptual stimulus that is easier to recognize. Therefore, the perceptual stimulus information generation system 1 is effective as a means for transmitting two-dimensional image information to a visually impaired person.

  Moreover, since the perceptual stimulus information generation system 1 has a simple structure, it can be easily applied to the existing computers 2 and 2A. In particular, the perceptual stimulus information generation system 1 has a simple structure and is inexpensive compared to a pin display that is a conventional tactile display.

  In the above-described example, the example in which the two-dimensional image generated in the computers 2 and 2A is the transmission target to the user has been described. However, the two-dimensional image generated in a device other than the computers 2 and 2A is transmitted to the user. It may be a transmission target. For example, a two-dimensional image displayed on a television that has received an analog broadcast or a digital broadcast, a two-dimensional image output from an image recording device equipped with a recording device such as a hard disk, or an image recording medium such as a DVD (Digital Versatile Disc) A two-dimensional image output from an image reproduction device that reproduces a recorded image can be a transmission target to the user by the perceptual stimulus information generation system 1. Among these, as a practical example, there is an application in which a perceptual stimulus is generated using the perceptual stimulus information generation system 1 for recognizing a data display layout in digital television broadcasting.

  In this case, if the two-dimensional image data to be transmitted is an analog signal, an analog-to-digital converter (ADC) may be provided in the perceptual stimulus information generation system 1. Further, if the position input device 6 such as the touch panel 11 and the display 7 are separately required, they may be constituent elements of the perceptual stimulus information generation system 1. For example, the computers 2 and 2 </ b> A themselves shown in FIG. 1 may be components of the sensory stimulus information generation system 1.

  In the above example, the case where the information to be transmitted to the user is the two-dimensional image information has been described. However, two-dimensional information other than the image can be the transmission target. For example, two-dimensional map information representing a difference in surface roughness and material can be set as a transmission target to the user. As described above, any tactile sensation can be artificially given to the user by controlling the electrical stimulation.

  Therefore, when the type of 2D map information that can be displayed as a 2D image is determined to be a 2D surface roughness map by the image type determination unit 3A, the surface at the position specified by the position input device 6 is used. A tactile stimulus that simulates roughness can be given to the user as an electrical stimulus. For this reason, the user can recognize the surface roughness of a desired object without actually touching the object. On the other hand, if a tactile stimulus that is emphasized more than the actual surface roughness is given to the user, the perceptual stimulus information generation system 1 can be used as an amplification inspection device for the surface roughness. In this case, the user can inspect the surface roughness of the object without skill.

  When the type of the two-dimensional map information is a two-dimensional material map, the user can recognize the touch of the material without actually touching the object by simulating the touch of the material by electrical stimulation.

  For this reason, even a user who uses vision can recognize not only two-dimensional image information but also various contents of two-dimensional information by using tactile sense and hearing in addition to vision. In particular, if a tactile stimulus for each material is simulated by the perceptual stimulus information generation system 1, it can be expected that the user will experience virtual reality. In addition, even when the transmission target is a two-dimensional image, various information such as what a part with a sensory stimulus represents between a normal visual person and a visually impaired person can be mutually confirmed.

(Second Embodiment)
FIG. 14 is a block diagram of a perceptual stimulus information generation system according to the second embodiment of the present invention, and FIG. 15 is a functional block diagram of the microcomputer 22 shown in FIG. In addition, about the component similar to the perceptual stimulus information generation system 1 in 1st Embodiment shown in FIG. 1 or FIG. 12, the same code | symbol is attached | subjected and description is abbreviate | omitted about the same content.

  The perceptual stimulus information generation system 1A in the second embodiment shown in FIG. 14 includes a small camera 30, a camera driver 31, a sensor 32, a perceptual stimulus device 4, a finger fixture 33, a microcomputer 22, and an instruction input device 8. It has.

  The small camera 30, the camera driver 31, the sensor 32, and the sensory stimulation device 4 are fixed to the finger fixing tool 33. That is, the finger fixing tool 33 is an instrument for fixing the small camera 30, the camera driver 31, the sensor 32, and the sensory stimulation device 4 to the finger. For this reason, the small camera 30, the camera driver 31, the sensor 32, and the sensory stimulation device 4 can be fixed to the user's finger by the finger fixing tool 33.

  Of course, you may fix the small camera 30, the camera driver 31, the sensor 32, and the sensory stimulation apparatus 4 to the part of the human body which instruct | indicates positions other than a user's finger | toe. The small camera 30 and the camera driver 31 may not be fixed to the user. However, it is desirable that the small camera 30 be fixed to the user so that the small camera 30 moves following the finger or hand from the viewpoint of capturing a two-dimensional image with sufficient resolution.

  The small camera 30 is a camera such as a visible light camera or an infrared camera that can capture a two-dimensional color image or monochrome image of the subject O as a still image or a moving image. The subject O may be a three-dimensional object such as a landscape in addition to a planar two-dimensional image such as an image on paper. In addition, a proximity lens 30A is provided in the small camera 30 as necessary. As a result, even if the subject O is a fine object such as a text printed on paper, a two-dimensional image with a high resolution can be taken locally. In addition, when not fixing a camera to the finger fixing tool 33, you may use the camera which is not small.

  The camera driver 31 is a device that controls the small camera 30 by outputting a control signal to the small camera 30 under the control of the microcomputer 22. For example, the small camera 30 is prepared so that a plurality of shooting modes corresponding to the state of the subject O can be selected. In such a case, the camera driver 31 can give the small camera 30 an instruction to select a desired shooting mode. For example, when a high-resolution image is shot using the proximity lens 30 </ b> A, the aperture shooting mode can be selected under the control of the camera driver 31.

  The sensor 32 has a function of measuring spatial data for obtaining one or both of the position and the movement of the part of the human body that indicates the position of a finger or a hand. For example, if the direction and acceleration of an object are measured using an orientation sensor and an acceleration sensor, the position of the object can be measured based on the measured direction and acceleration. Therefore, an orientation sensor and an acceleration sensor can be used as a position sensor. Moreover, if a azimuth acceleration sensor is used, the motion of the target can be detected.

  The microcomputer 22 includes an ADC 34, a digital to analog converter (DAC) 35, and an input / output (I / O) port 36. Further, the microcomputer 22 functions as the data processing system 3 by causing the microcomputer 22 to read the perceptual stimulus information generation program.

  The output side of the small camera 30 and the sensor 32 is connected to the input side of the ADC 34. For this reason, the image data captured by the small camera 30 and the analog signal of the data measured by the sensor 32 are converted into digital signals by the ADC 34 and input to the microcomputer 22. The output side of the DAC 35 is connected to the camera driver 31 and the input side of the sensory stimulation device 4. Therefore, the digital control signal generated by the microcomputer 22 is converted into an analog control signal by the DAC 35 and output to the camera driver 31 and the perceptual stimulation device 4.

  The instruction input device 8 is connected to the I / O port 36 of the microcomputer 22. The instruction input device 8 includes an input device such as a button. Various instruction information can be input to the microcomputer 22 by operating the instruction input device 8.

  The data processing system 3 includes a camera control unit 3D in addition to the image type determination unit 3A, the image conversion unit 3B, and the stimulus control unit 3C having the same functions as those of the perceptual stimulus information generation system 1 in the first embodiment.

  The camera control unit 3D outputs a control signal to the camera driver 31 to set a shooting condition such as a shooting mode of the small camera 30 through the camera driver 31, and information indicating the shooting condition of the small camera 30 as an image type. A function to be given to the determination unit 3A and the image conversion unit 3B.

  The image type determination unit 3A has a function of determining the type of part or all of the two-dimensional image data acquired from the small camera 30 according to the shooting conditions of the small camera 30 acquired from the camera control unit 3D. The method for determining the type of image data is as described in the first embodiment. That is, when a color image is taken by the small camera 30, two-dimensional image data composed of RGB values and luminance values representing the red, green, and blue gradations for each position is stored in the image type determination unit 3A. Entered. Then, based on the RGB value and the luminance value, the image type determination unit 3A determines the image type by a preset data processing method.

  Further, the shooting condition of the small camera 30 can be used as a trigger for starting the image type determination process. For example, when the shooting condition of the small camera 30 is not a mode for local shooting such as an aperture shooting mode, the shooting target of the small camera 30 that is a target of information transmission is likely to be a position designation range by the user. . Therefore, in such a case, the image type determination unit 3A can be configured to autonomously perform the image data type determination process.

  Whether or not the shooting mode is a mode for local shooting can be determined not only by determination based on selection information of the shooting mode acquired from the camera control unit 3D but also by threshold processing determination for the focal length of the small camera 30. For example, when the focal length is about 30 cm, the focal length exceeds the threshold value, so it can be determined that the shooting purpose is a rough grasp of the shooting target. For this reason, an image type determination process is executed. On the other hand, if the focal length is about 1 cm, it can be determined that the purpose of photographing is to designate the local position of the photographing target and acquire detailed information. For this reason, the image type determination process is not executed.

  The image conversion unit 3B and the stimulus control unit 3C have the same functions as those in the first embodiment. However, the image conversion unit 3B acquires various spatial data such as position data and acceleration data from the sensor 32, and a part of a human body such as a finger in a data region that is a target of image type determination based on the acquired spatial data. Is configured to determine the absolute position of. The obtained absolute position is regarded as a designated position corresponding to the feature image data given to the stimulus control unit 3C.

  In addition, similarly to the designated position input from the position input device 6 in the first embodiment, the image conversion processing method is changed depending on whether the designated position estimated from the measurement data of the sensor 32 is stationary or moving. A mode to change can be prepared. For example, when the sensor 32 is stationary for a predetermined time, the image conversion processing method in the image conversion unit 3B can be switched to an image conversion processing method for generating more local and detailed feature image data.

  According to the perceptual stimulus information generation system 1A configured as described above, even if a two-dimensional image is not output as an image signal, simplification or characterization from the two-dimensional image according to the type and purpose of the two-dimensional image. Thus, it is possible to generate the feature image data, and to give the user a perceptual stimulus corresponding to the feature image corresponding to the designated position estimated based on the measurement data from the sensor 32.

  Specifically, first, the small camera 30 is fixed to the finger via the finger fixing tool 33. Then, the small camera 30 is controlled by the operation of the instruction input device 8 through the camera control unit 3D and the camera driver 31, and the photographing mode of the small camera 30 is set to a mode for photographing the entire observation target with a focal length of about 30 cm.

  Next, the small camera 30 is controlled by the operation of the instruction input device 8 through the camera control unit 3 </ b> D and the camera driver 31, and the entire observation target is photographed by the small camera 30. At this time, shooting mode information is given from the camera control unit 3D to the image type determination unit 3A. Then, the image type determination unit 3A acquires a two-dimensional image from the small camera 30 and performs a determination process for the type of the two-dimensional image. The determination result is given to the image conversion unit 3B. On the other hand, the relative position of the sensor 32 with respect to the position of the two-dimensional image specified from the imaging conditions at this time is set as an absolute initial position of the sensor 32 with respect to the two-dimensional image, and is output to the image conversion unit 3B.

  Next, the small camera 30 is controlled by the operation of the instruction input device 8 through the camera control unit 3D and the camera driver 31, and the photographing mode of the small camera 30 is set to the aperture photographing mode. Then, the user moves his / her finger to a position where information is to be obtained, and a close-up image is shot in the aperture shooting mode by operating the instruction input device 8. Then, measurement data such as direction, acceleration, and azimuth acceleration is output from the sensor 32 that has moved with the finger, and local two-dimensional image data is output from the small camera 30 to the image conversion unit 3B.

  Next, the image conversion unit 3B estimates a designated position by a finger with respect to the two-dimensional image from the measurement data of the sensor 32 and the initial position. Further, the image conversion unit 3B converts the two-dimensional image photographed in the aperture photographing mode into feature image data by image conversion processing corresponding to the type of the two-dimensional image. Then, the image conversion unit 3B gives the feature image data in the unit pixel area corresponding to the designated position to the stimulus control unit 3C.

  Further, a perceptual stimulus corresponding to the feature image is given to the user in the same flow as steps S5 and S6 of FIG. For this reason, the user can recognize the information at the local position of the two-dimensional image photographed in the aperture photographing mode of the small camera 30 as a perceptual stimulus.

(Other embodiments)
Although specific embodiments have been described above, the described embodiments are merely examples, and do not limit the scope of the invention. The novel methods and apparatus described herein can be implemented in a variety of other ways. Various omissions, substitutions, and changes can be made in the method and apparatus described herein without departing from the spirit of the invention. The appended claims and their equivalents include such various forms and modifications as are encompassed by the scope and spirit of the invention.

DESCRIPTION OF SYMBOLS 1, 1A Perceptual stimulus information generation system 2, 2A Computer 3 Data processing system 3A Image type determination part 3B Image conversion part 3C Stimulation control part 3D Camera control part 4 Perceptual stimulus apparatus 4A Speaker 4B Voltage application apparatus 4C Vibrator 4D Amplifier 5 Operation Device 6 Position input device 7 Display 8 Instruction input device 9 Vibration speaker 10 Display image generation unit 11 Touch panel 11A Touch pen 20 USB terminal 21 Output port 22 Microcomputer 30 Small camera 30A Proximity lens 31 Camera driver 32 Sensor 33 Finger fixing tool 34 ADC ,
35 DAC
36 I / O port O Subject

Claims (7)

And determining the type determining unit a type of the 2-dimensional images by acquiring two-dimensional images,
An image conversion process including at least one of a process of blurring text image data included in the two-dimensional image and an expansion process of a specific color region included in the two-dimensional image, wherein the image conversion process is performed according to the type of the two-dimensional image. the image conversion processing with respect to the two-dimensional image, the information converting unit for generating feature information indicating a feature in the unit area corresponding to the designated position of the two-dimensional image,
Control means for controlling the perceptual stimulus device so that the perceptual stimulus according to the feature information is given to the user of the two-dimensional image ;
A perceptual stimulus information generation system comprising: The information conversion means is configured to display the two-dimensional image and acquire the designated position from a touch panel for inputting the designated position,
The perceptual stimulus information generation system according to claim 1, wherein the control unit is configured to control a vibrator that vibrates the touch panel or the user's finger. The perceptual stimulus information generation system according to claim 1, wherein the information conversion unit is configured to change the image conversion process according to history information of the designated position.   The perceptual stimulus information generation system according to claim 1, wherein the information conversion unit is configured to generate feature information representing a feature in a unit region centered on a position predicted from history information of the designated position. Photographing means for photographing the two-dimensional image ;
A sensor attached to a part indicating the position of the user and measuring spatial data of the part for obtaining the designated position;
The perceptual stimulus information generation system according to claim 1, further comprising: And determining the type of the 2-dimensional images by acquiring two-dimensional images,
An image conversion process including at least one of a process of blurring text image data included in the two-dimensional image and an expansion process of a specific color region included in the two-dimensional image, wherein the image conversion process is performed according to the type of the two-dimensional image. the image conversion processing with respect to the two-dimensional image, and generating a feature information indicating a feature in the unit area corresponding to the designated position of the two-dimensional image,
Controlling a perceptual stimulus device so that a perceptual stimulus according to the feature information is given to a user of the two-dimensional image ;
A method for generating perceptual stimulus information. Computer
Determining type determining unit a type of the 2-dimensional images by acquiring two-dimensional images,
An image conversion process including at least one of a process of blurring text image data included in the two-dimensional image and an expansion process of a specific color region included in the two-dimensional image, wherein the image conversion process is performed according to the type of the two-dimensional image. the image conversion processing with respect to two-dimensional images, the user of the information conversion means for generating feature information indicating a feature in the unit area corresponding to the designated position of the two-dimensional images, and sensory stimulation the 2-dimensional image corresponding to the feature information Control means for controlling the sensory stimulation device to be applied to,
Perceptual stimulus information generation program to function as.