JP2010079529A - Information processor, information processing method, program therefor and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor wherein the operability or usability of direct operation is improved by eliminating a trouble when using an application when using a TUI (Tangible User Interface). <P>SOLUTION: The information processor has: an image extraction part extracting an image of an operating object disposed on a screen surface or approaching it; an ID recognition part acquiring ID information for identifying the object from the image of the object; an ID information table; an attribute information acquisition part acquiring attribute information corresponding to the ID information from the ID information table; a start image display part displaying a start image corresponding to the application information of the attribute information acquired by the attribute information acquisition part on a screen; an angle recognition part receiving the selection of the start image displayed by the start image display part from an arrangement angle of the ID information on the screen face, and controlling an execution start of an application corresponding to the start image; and a processing execution part executing the application corresponding to an execution start instruction from the angle recognition part. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an information processing apparatus that performs image processing and display, an information processing method, a program thereof, and a recording medium.

  Today, when operating a computer, a GUI (Graphical User Interface) in which a user uses a mouse and a display is widely used. For example, when an electronic file containing document data is displayed on the display, the user clicks an image on the display called an icon representing an electronic file name and an application program for document display corresponding to the electronic file with the mouse. As a result, the application program for displaying the document is activated and the document data is displayed on the display. Hereinafter, the application program is simply referred to as an application.

  However, these GUIs are visual and auditory interactions, and are indirect operations via images displayed on the display. “Tangible User Interface (TUI) that fuses information and physical world” is based on the idea that tactile feedback unique to individual information is necessary to improve direct operability. Has been advocated.

  As an image display device using TUI, a CCD camera that captures an object on a screen and a projector that displays an image on the screen are provided (for example, see Patent Document 1). Further, when a circular barcode is attached to an object such as a model or paper that can be held with one hand, and the user places this object on the screen, the image display device described in Patent Document 1 is , By reading the circular barcode attached to the object from the image data captured by the CCD camera and acquiring the information of the object from the circular barcode, projecting an image related to the object on the screen, or manually moving the object placed on the screen There is known a technique for giving a motion to an image already projected on a screen in accordance with movement information for recognizing the motion of the object when the object is moved by.

In the image display device using the above-described TUI, an actual object is picked up and operated. Therefore, compared with a device using a GUI, the object can be directly operated to display a screen corresponding to the operation. It is possible to provide information related to objects and objects.
JP 2007-011276 A

  However, in a computer or the like using a GUI, when an application is started, the application can be started and the electronic file can be used together with the electronic file by clicking an icon. However, the conventional image display apparatus using the above-described TUI Then, the user does not perform an operation such as starting an application to be used in advance, reading the circular barcode attached to the object, and setting the read object information in the active application. There was a trouble of not being allowed.

  The present invention has been made to solve the above-described problems, and can eliminate the trouble of using an application when using a TUI, thereby improving the usability and operability of a direct operation. An object is to provide an information processing apparatus, an information processing method, a program thereof, and a recording medium.

  In order to solve the above-described problem, an information processing apparatus according to the first aspect of the present invention includes an image extraction unit that extracts an image of an object when an operation object placed or approached on a screen surface is imaged. The ID recognition unit for acquiring ID information for identifying the object from the image of the object extracted by the image extraction unit, the display content, the selection display content, the next step, and the approval display are stored in the storage unit in association with each other. The ID information table stored in the storage unit in association with the application information, the ID information and the attribute information including the application information, and the attribute information corresponding to the ID information acquired by the ID recognition unit. An attribute information acquisition unit acquired from the table, and a startup image corresponding to the application information of the attribute information acquired by the attribute information acquisition unit, A startup image display unit to be displayed on the screen, and selection of a startup image displayed by the startup image display unit from an arrangement angle on the screen surface of the ID information acquired by the ID recognition unit is received. An angle recognition unit that controls the start of execution of a corresponding application, and a process execution unit that executes an application corresponding to an execution start command from the angle recognition unit.

  With this configuration, when an object is placed on or close to the screen, a startup image corresponding to the application associated with the attribute information of the object is displayed on the screen, and the startup image that has received selection of the displayed startup image is supported Therefore, it is possible to improve the usability and operability of direct operation by omitting the trouble of using the application when using the TUI.

  In the information processing apparatus according to claim 1, the ID information table includes general display information, and the information described in the general display information table can be displayed together. It is characterized by. Therefore, in the ID information table, the ID information and the start screen are associated with each other, and the display content is associated with the selected display content, the next step, and the application information associated with the approval display, The process execution unit may be configured to activate an application corresponding to the activation image. Thereby, since the application corresponding to an object is started, the display of the screen according to the attribute of an object and the information regarding an object can be provided to a user with starting of an application.

  According to a third aspect of the present invention, in the information processing apparatus according to the first aspect, the image of the object extracted by the image extraction unit is configured by a barcode image, and the ID recognition unit is Analyzing whether the image of the object is a barcode image, and determining that the image of the object is a barcode image, the ID information is acquired from the barcode image. . In this configuration, since a barcode image is used, the object can be easily recognized.

  According to a fourth aspect of the present invention, in the information processing apparatus according to the first aspect, the application information table corresponds to an approval operation and can be used as an approval operation based on an ID that can be approved. . According to a fifth aspect of the present invention, in the information processing apparatus according to the first aspect, in the angle recognition unit, an angle obtained by dividing the number of the activation screens from 360 degrees in the selection of the activation image. The threshold value is used.

  The invention according to claim 6 is the information processing apparatus according to claim 1, wherein when the object to be operated is projected on the screen, the object used before that is used. Thus, the angle can be changed.

  The invention according to claim 7 is the information processing apparatus according to claim 1, further comprising a timer for measuring time, wherein the timer recognizes the angle of the ID information at an arbitrary time. To do.

  The invention according to claim 8 is characterized in that, in the information processing apparatus according to claim 1, the count value is added every time the angle is recognized, and the selected state is set when an arbitrary count value is reached. To do.

  According to the present invention, it is possible to eliminate the trouble of using an application when using a TUI, and improve the usability and operability of a direct operation.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First embodiment of the present invention)
FIG. 1 is a side view of the image display apparatus according to the first embodiment of the present invention. FIG. 2 is a perspective view of the image display apparatus according to the first embodiment of the present invention. As shown in FIG. 1, an image display device 1 according to the present embodiment includes a surface 11, a screen 12, a projection surface 13, a housing 14, a projector 15 installed in the housing 14, and a CCD (Charge The device is composed of a coupled device (camera 16) and an information processing apparatus 100 to which an input device 17 (operation input unit) is connected.

  The screen 12 is a transmissive screen that has been subjected to diffusion treatment. The projector 15 is installed toward the screen 12, and an image from the projector 15 is projected onto the screen 12. The CCD camera 16 continues to shoot the screen 12. A projector 15 and a CCD camera 16 are connected to the information processing apparatus 100, and an input image from the CCD camera 16 and an output image to the projector 15 are processed. The surface 11 is made of a transparent member having a certain degree of strength for use as a desk. The input device 17 is configured by a pointing device such as a mouse.

  As shown in FIG. 2, the image display device 1 of the present embodiment has a rectangular flat surface portion (surface 11), and includes a desk-shaped display portion (screen 12) and an information processing device 100. The display unit (screen 12) is configured such that an image projected from the inside of the housing 14 is displayed at the central portion of a rectangular flat surface (surface 11).

  As shown in FIG. 1, the image display device 1 includes a screen 12, a casing 14 that supports the screen 12, a projector 15 that is provided in the casing 14 and projects an image on a projection surface 13, and an interior of the casing 14. And a CCD camera 16 for photographing the screen 12 from the back side. The CCD camera 16 disposed in the casing 14 and the information processing apparatus 100 are connected by a cord, and the projector 15 and the information processing apparatus 100 disposed in the casing 14 are optically coupled.

  The screen 12 has a double structure, and a projection surface 13 on which a projection image is projected is provided on the back side of the screen 12, and the projection surface 13 and the surface 11 are in close contact with each other. For example, when the information processing apparatus 100 is activated, a pointer (for example, an arrow pointer) that moves according to an operation of a mouse or the like is displayed on the projection surface 13 together with a desktop image of the operating system installed in the information processing apparatus 100. Etc. are displayed. The user can feel as if it is “displayed” on the screen 12 by viewing the projection image projected on the projection surface 13 from the front side of the screen 12. Further, when the user operates the information processing apparatus 100, the projected image projected on the projection plane 13 from the projector 15 changes, and the content “displayed” on the screen 12 changes as needed.

  Both the surface 11 and the projection surface 13 are transparent, but the surface on the side close to the surface 11 of the projection surface 13 is provided with fine irregularities, and when an image is projected onto the projection surface 13, the light is Since the light is slightly diffused and transmitted, the projected image can be viewed from various angles from the surface side of the screen 12 provided with the surface 11. Here, the surface 11 may be covered with a transparent protective sheet so that the surface 11 is hardly damaged, or may be coated with a transparent paint or the like.

  The information processing apparatus 100 can operate a projection image projected from the projector 15 onto the back side of the screen 12 in accordance with an image obtained by the CCD camera 16. The information processing apparatus 100 may be created exclusively for the image display apparatus 1 of the present embodiment, or may be configured by installing predetermined software on a personal computer. Further, the information processing apparatus 100 may be disposed in the housing 14.

  The projector 15 is coupled to a display (not shown) of the information processing apparatus 100 by an optical system such as a reflection mirror and a beam splitter (not shown), and can project an image generated by the information processing apparatus 100 onto the projection surface 13 of the screen 12. It is like that.

  The CCD camera 16 is connected to the information processing apparatus 100 with a code via, for example, a USB (Universal Serial Bus) interface, and is drawn on the surface side of the screen 12, that is, the object placed on the surface 11 or the surface 11. A figure, a shadow reflected on the front surface 11 and the like are photographed at a predetermined time interval from the back surface side of the screen 12, that is, the projection surface 13 side, and image data can be obtained. Image data corresponding to the photographed image is supplied to the information processing apparatus 100.

  FIG. 2 shows a mode in which the user M uses the image display device 1 by sitting in front of the image display device 1. For example, a circular barcode is affixed to an object of a size that can be held by one hand, and the user M places an object held by the hand on the surface 11 of the screen 12 or approaches the image display device 1. Reads the circular barcode and performs processing related to the object.

  Objects can be building miniatures, copier miniatures, wood miniatures, small devices such as cameras, or paper that can be placed on or approached the surface 11 of the screen 12 to identify objects such as barcodes. Any image can be used as long as possible images can be attached.

  FIG. 9 shows a circular barcode attached to an object. The objects are shown as photographic paper 50, miniature printer 30, miniature multifunction device 20, miniature tree 40, miniature camera 60, ID card 70, and the like. A circular barcode image as shown in FIG. 9 is affixed to the bottom surface of these objects. Further, in the photographic paper 50, a circular barcode image is pasted on the back surface thereof.

  The circular barcode functioning as ID information (identification information) in the present invention will be described. The circular barcode image shows ID information for identifying each object. The circular barcode 301 is a barcode in which a one-dimensional barcode is arranged in a circle around a predetermined point. The one-dimensional bar code is a bar code that represents a numerical value or the like by the thickness of the striped line and the interval between them, but the bar of the circular bar code 301 is arranged in a circle, so that the distance from the center in the radial direction Correspondingly, the lines and intervals become thicker. That is, each line of the barcode has a wedge shape. The circular barcode 301 is characterized in that a white portion is long to facilitate discrimination between the barcode start point 301s and end point 301e and to identify the direction of the object. By analyzing the start point 301s and the end point 301e, the position and orientation of the circular barcode 301 on the screen can be acquired.

  FIG. 3 shows a device configuration diagram of the image display device according to the first embodiment of the present invention. As described above, the image display device 1 includes the projector 15, the CCD camera 16, the input device 17, and the information processing device 100. The information processing apparatus 100 includes a processing apparatus 101 such as a CPU (Central Processing Unit), a main storage apparatus 102 such as a RAM (Random Access Memory) mainly loaded with applications and data necessary in the short term, and a long term. An auxiliary storage device 103 (storage unit) such as an HDD (Hard Disk Drive) in which data that needs to be stored is stored.

  FIG. 4 is a diagram illustrating a functional configuration example of the information processing apparatus according to the first embodiment of the present invention, and a portion surrounded by a dotted line is information according to the first embodiment of the present invention. 2 shows a functional configuration of the processing apparatus, and includes an image extraction unit 110, an ID recognition unit 120, an attribute information acquisition unit 130, a projection image generation unit 140, a process selection reception unit 150, a process execution unit 160, a registration unit 170, and The angle recognition unit 180 is configured. These members are modules of a program executed by a processing device such as a CPU.

  The image extraction unit 110 binarizes the image output from the CCD camera, for example, and extracts a specific image portion such as a circular barcode image of an object placed on the screen 12 or a shadow such as a human finger. It is supposed to be. The image extracted by the image extraction unit 110 is not particularly limited to a shadow such as a circular barcode image or a human finger. However, in the embodiment of the present invention, a circular barcode image or a shadow of a finger will be described as an example. To do. Further, the image extraction unit 110 processes the image output from the CCD camera so that a specific image can be easily extracted.

  The ID recognition unit 120 acquires ID information from the image of the object extracted by the image extraction unit 110. The ID information is, for example, an ID uniquely assigned to the object. For example, if the image extracted by the image extraction unit 110 is a circular barcode image, the ID recognizing unit 120 reads the pattern of the bar array in the circular barcode image, and reads the object pattern from the read pattern of the bar array. ID is specified. The pattern is specified as 1 when the black bar is at a predetermined position and 0 when it is not present, and is expressed in binary.

  A specific example of reading a circular barcode image is described in Patent Document 1: Japanese Patent Application Laid-Open No. 2007-011276, and particularly described in the description of FIGS. 38 to 42 of Patent Document 1. . The ID recognizing unit 120 (ID recognizing unit in Patent Document 1) may read a circular barcode image with such an equivalent function of the embodiment.

  The attribute information acquisition unit 130 acquires attribute information corresponding to the ID acquired by the ID recognition unit 120. For example, the attribute information acquisition unit 130 refers to an ID information table (attribute information table) stored in the auxiliary storage device 103 to acquire attribute information from the object ID.

  The ID information table stores IDs, display contents, and approval operation information. An example of the ID information table is shown in FIG. The ID information table shown in FIG. 5 is information in which attribute information such as an object ID, display contents, and approval operation information (application information) is associated. Note that the ID information table includes general display contents and special display contents for generating a startup screen (described later). The general display content represents a general-purpose startup screen held by the object, and is described in the general display information table as shown in FIG. The special display content is a start screen unique to the object, and is described in the ID information table. In addition, what is described in the special display content may be associated with a plurality of IDs. The application information is, for example, a name or ID that identifies the application. The registration unit 170 generates an ID information table and adds / deletes the contents of the ID information table, generates an attribute file, and adds / deletes the contents of the attribute file.

  The application information table is information in which application information is associated with a path indicating the location of an application execution file. An example of the application information table is shown in FIG. The information processing apparatus 100 also has an approval operation information table (not explicitly shown in FIG. 4) as shown in FIG.

  The angle recognizing unit 180 acquires the angle on the screen of the ID information acquired by the ID recognizing unit 120 and performs a series of processes described in detail later. The acquired angle is stored in the memory. Thereafter, the angle of the ID acquired by the ID recognition unit 120 is monitored by the angle recognition unit 180.

  The projection image generation unit 140 (activation image display unit) projects the activation image corresponding to the application name acquired by the attribute information acquisition unit 130 onto the projection surface 13 on the back side of the screen 12 via the projector 15. ing. The activation image is an image for activating an application selected by the user. An image displayed on the screen 12 is shown in FIG. FIG. 11 shows a state in which a miniature multifunction device 20 is on the screen 12 and four startup images 19 are projected around it. The four startup images 19 correspond to each application, and are distinguished as startup images 19d from startup images 19a.

  The process execution unit 160 is configured to execute the application selected by the angle recognition unit 180. For example, the process execution unit 160 outputs the application name from the angle recognition unit 180, refers to the application information table stored in the auxiliary storage device 103, acquires the application path from the application name, and executes the application. It is like that. The path indicates the location of the application execution file. The timer has a function of measuring time at an arbitrary interval. The angle confirmation timing is notified for the angle confirmation.

  Processing of the information processing apparatus according to the first embodiment of the present invention configured as described above will be described. FIG. 10 is a flowchart illustrating an example of a program executed by the information processing apparatus according to the first embodiment of the present invention. Note that the program executed by the information processing apparatus according to the embodiment of the present invention may be stored in a recording medium such as a CD-ROM.

  Referring to FIG. 10, first, the CCD camera 16 outputs an image obtained by photographing the image on the screen 12 (in this example, the miniature multifunction device 20) to the image extraction unit 110 (step S1). The timing at which the CCD camera 16 captures an image on the screen 12 is a specific time interval (for example, about 7.5 frames per second). The image extraction unit 110 is configured such that the user M places an object with the circular barcode image attached on the screen 12, and the like, from the image output from the CCD camera 16, the circular barcode image attached to the object, etc. A specific image portion is extracted (step S2).

  The ID recognition unit 120 recognizes an object ID from a specific image such as a circular barcode image extracted by the image extraction unit 110 in the form of a numerical value (step S3). Next, the ID recognizing unit 120 recognizes the circular bar image, reads the pattern of the array of bars in the circular barcode image, specifies the ID of the object from the pattern of the read array, and the process proceeds to step S5. If the image is other than a circular barcode, the process proceeds to step S1.

  Subsequently, the attribute information acquisition unit 130 refers to the ID information table illustrated in FIG. 5 and collates whether or not the corresponding ID is described in the table (step S5). If the recognized ID is not in the ID information table (step S6: No), the process returns to the ID recognition flow. If the ID of the recognized object is in the ID information table (step S6: Yes), the attribute information of the corresponding object is acquired (step S7). For example, when the object ID is “1”, the catalog display application, the layout simulation, the environment simulation, and the instruction display application that are application names corresponding to the object with the ID “1” are the object ID “1”. As attribute information.

  The projection image generation unit 140 generates a startup image corresponding to each application name based on the ID information acquired by the attribute information acquisition unit 130 (step S8), and uses the projector 15 as a startup screen on the projection plane 13. Through the projection (step S9). For example, the image projected on the entire surface of the projection surface 13 is updated and projected at specific time intervals (for example, about 7.5 frames per second), and the startup image is an image of the entire surface of the projection surface 13. Projected along with the update.

  For example, the startup screen has a form as shown in FIG. Here, the object whose ID is “1” is the miniature MFP 20, the object whose ID is “2” is the miniature printer 30, the object whose ID is “11” is the miniature tree 40, and the ID is “33”. ”Is the photographic paper 50, and the object whose ID is“ 55 ”is the camera 60. For example, when the miniature multifunction device 20 is recognized by the information processing apparatus 100, in step S9, four startup images 19 corresponding to the application names are projected on the screen 12 as shown in FIG. Although individual explanation is omitted, when other objects with different IDs are recognized, one or more activation images 19 corresponding to the individual IDs of the recognized objects are projected. In step S9 and subsequent steps, the user operates the object (moving the object on the screen surface and changing the posture angle) to give the next instruction.

  The angle recognition unit 180 determines whether or not the user M is operating the object based on the output from the ID recognition unit 120 (step S8). That is, first, the number of activation screens is measured, and 360 degrees is divided to obtain a quotient to obtain a threshold angle (step S10). Then, the timer is started to measure time (step S11), the angle information of the ID recognized by the ID recognition unit 120 is acquired and held in the memory (step S12). In addition, the projection image generation unit 140 is notified so as to change the color of the startup image (19a) located at the top (represented by hatching) (step S13). The projector 15 displays the result on the screen. FIG. 12 shows how the change has been made.

  Then, the control unit not explicitly urges the angle recognizing unit 180 to confirm the ID angle at an arbitrary set timing. The angle recognizing unit 180 acquires the angle information of the ID, subtracts it from the angle already held in the memory, and determines whether the value exceeds the threshold value compared with the previously set threshold value (step S14). . If the threshold is exceeded (step S14: Yes), a reset signal is sent to the timer (step S15). After the reset signal is sent and the timer starts counting from the beginning, the process returns to the flow of obtaining (monitoring) the angle information of the ID from step S12. The projection image generation unit determines that the user M has selected this application, and changes the color of the (application) startup image corresponding to the most recently acquired ID angle information stored in the memory. 140 is notified (step S13). The projector 15 displays the result on the screen. An example of a change is shown in FIG. In FIG. 13, since the object is rotated counterclockwise and exceeds the threshold value, the color of the next activation image (19b) is changed (represented by hatching).

  If it is determined in step S14 that the threshold is not exceeded (No in step S14), the count is added (step S16). Thereafter, it is determined whether or not the current count value exceeds an arbitrary value (step S17), and if it does not exceed (step S17: No), the process returns to the flow from step S14. If it is exceeded in step S17 (step S17: Yes), it is determined that the user M has selected this application execution, and the most recently acquired ID angle information stored in the memory is included in the angle information. The projection image generation unit 140 is notified so as to change the color of the corresponding (application) startup image to a different color (step S18). The projector 15 displays the result on the screen. An example of a change is shown in FIG. In FIG. 14, the color of the startup image (19b) is changed (represented by a mesh line).

  Then, the process execution unit 160 refers to the application information table shown in FIG. 7 from the ID number and angle, and is associated with the object ID acquired by the attribute information acquisition unit 130 and specified by the angle. The path of the existing application is acquired (step S19), and the target application is executed (step S20).

  After the application is executed in step S20, windows and images specific to the application are displayed on the screen 12, and the startup image projected in step S9 disappears.

  In the ID information table shown in FIG. 5, the object ID and the attribute file are represented in a one-to-one correspondence, but the object ID may be associated with a plurality of attribute files. Good.

  Although detailed description is omitted, information can be registered in advance in the ID information table and the application information table, and the ID of the object and whether the object corresponding to the ID is a physical object or a document. Registered in advance. The physical object is a miniature multifunction device 20, a printer 30, a tree 40, or the like. A document is photographic paper 50 or the like, and image data that is the content of photographic paper 50 is in the information processing apparatus 100.

  As described above, the information processing apparatus 100 according to the first embodiment of the present invention displays a startup image corresponding to an application associated with attribute information of an object when the object is placed on or approaches the screen. In order to execute the application corresponding to the startup image that has been displayed and received the selection of the displayed startup image, the trouble of using the application is omitted when using the TUI, and the usability of direct operation Operability can be improved.

(Second embodiment of the present invention)
The second embodiment of the present invention is a form in which an authentication function is provided so as to recognize information related to a plurality of objects (a plurality of objects to which a circular barcode is attached).

  The configuration and functional configuration of the information processing apparatus according to the second embodiment of the present invention are not shown because they are the same as the configuration of the information processing apparatus 100 according to the first embodiment of the present invention. Duplicate description is omitted, and among the constituent elements constituting the information processing apparatus according to the second embodiment of the present invention, the constituent elements constituting the information processing apparatus according to the first embodiment of the present invention The same components are denoted by the same reference numerals, and description thereof is omitted. Hereinafter, a case where information on two objects (objects) is recognized will be described as an example.

  As in the first embodiment, the object is a photo card, a miniature printer, a miniature multifunction device, a miniature tree, a camera, and a member card (see FIG. 9). Circular barcode image is affixed to

  Subsequently, processing of the information processing apparatus according to the second embodiment of the present invention will be described. FIG. 15 is a flowchart illustrating an example of a program executed by the information processing apparatus according to the second embodiment of the present invention. Note that the program executed by the information processing apparatus according to the embodiment of the present invention may be stored in a recording medium such as a CD-ROM.

  According to FIG. 15, as in the first embodiment, first, the CCD camera 16 outputs an image obtained by photographing an object on the screen 12 to the image extraction unit 110 (step S1). The timing at which the CCD camera 16 captures an image on the screen 12 is a specific time interval (for example, about 7.5 frames per second). The image extraction unit 110 includes a circular bar attached to an object from an image output from the CCD camera 16 in a situation where the user M places the camera 60 which is an object to which a circular barcode image is attached on the screen 12. A part of a specific image such as a code image is extracted (step S2).

  The ID recognition unit 120 recognizes an object ID from a specific image such as a circular barcode image extracted by the image extraction unit 110 in the form of a numerical value (step S3). Next, the ID recognition unit 120 recognizes the circular barcode image, reads the pattern of the array of bars in the circular barcode image, specifies the ID of the object from the pattern of the read array, and the process proceeds to step S5. If the image is other than a circular barcode, the process proceeds to step S1.

  Subsequently, the attribute information acquisition unit 130 refers to the ID information table illustrated in FIG. 5 and collates whether or not the corresponding ID is described in the table (step S5). If the recognized ID is not in the ID information table (step S6: No), the process returns to the ID recognition flow. If the ID of the recognized object is in the ID information table (step S6: Yes), the attribute information of the corresponding object is acquired (step S7). For example, when the object ID is “1”, the catalog display application, the layout simulation, the environment simulation, and the instruction display application that are application names corresponding to the object with the ID “1” are the object ID “1”. As attribute information.

  The projection image generation unit 140 generates a startup image corresponding to each application name based on the ID information acquired by the attribute information acquisition unit 130 (step S8), and uses the projector 15 as a startup screen on the projection plane 13. Through the projection (step S9). For example, the image projected on the entire surface of the projection surface 13 is updated and projected at specific time intervals (for example, about 7.5 frames per second), and the startup image is an image of the entire surface of the projection surface 13. Projected along with the update.

  Note that the ID information table includes general display contents and special display contents for generating the startup screen. The general display content represents a general-purpose startup screen held by the object, and is described in the general display information table. The special display content is a start screen unique to the object, and is described in the ID information table. In addition, what is described in the special display content may be associated with a plurality of IDs.

  For example, the startup screen has a form as shown in FIG. For example, when the camera 60 is recognized by the information processing apparatus 100, in step S9, seven startup images 19 corresponding to the application names are projected on the screen 12 as shown in FIG.

  The angle recognition unit 180 determines whether or not the user M is operating the object based on the output from the ID recognition unit 120 (step S8). That is, first, the number of activation screens is measured, and 360 degrees is divided to obtain a quotient to obtain a threshold angle (step S10). Then, the timer is started to measure time (step S11). The angle information of the ID recognized by the ID recognition unit is acquired and stored in the memory (step S12). In addition, the projection image generation unit 140 is notified to change the color of the startup image (19a) located at the top (represented by hatching) (step S13). The projector 15 displays the result on the screen. FIG. 17 shows how the change has been made.

  Then, the control unit not explicitly urges the angle recognizing unit 180 to confirm the ID angle at an arbitrary set timing. The angle recognizing unit 180 acquires the angle information of the ID, subtracts it from the angle already held in the memory, and determines whether the value exceeds the threshold value compared with the previously set threshold value (step S14). . If the threshold is exceeded (step S14: Yes), a reset signal is sent to the timer (step S15). After the reset signal is sent and the timer starts counting from the beginning, the process returns to the flow of obtaining (monitoring) the angle information of the ID from step S12. The projection image generation unit determines that the user M has selected this application, and changes the color of the (application) startup image corresponding to the most recently acquired ID angle information stored in the memory. 140 is notified (step S13). The projector 15 displays the result on the screen. An example of a change is shown in FIG. In FIG. 18, since the object is rotated counterclockwise and exceeds the threshold value, the color of the next activation image (19b) is changed (represented by hatching).

  If it is determined in step S14 that the threshold is not exceeded (No in step S14), the count is added (step S16). Thereafter, it is determined whether or not the current count value exceeds an arbitrary value (step S17), and if it does not exceed (step S17: No), the process returns to the flow from step S14. If it is exceeded in step S17 (step S17: Yes), it is determined that the user M has selected this application execution, and the most recently acquired ID angle information stored in the memory is included in the angle information. The projection image generation unit 140 is notified so as to change the color of the corresponding (application) startup image to a different color (step S18). The projector 15 displays the result on the screen. An example of a change is shown in FIG. In FIG. 19, the color of the activation image (19b) is changed (represented by a halftone line).

  Here, particularly in the second embodiment, the necessity of approval is determined (step S21). Referring to the application information table shown in FIG. 7, since “ID” is described in the “approval display” of the specific file list application instructed to be executed (step S21: Yes), an ID object is set up. A message (for example, “Please insert ID”) is displayed (step S22). In this state, if the ID information table whose approval operation is “ID” is contacted, the ID information is passed to the processing unit according to the approval operation information table as shown in FIG. 8 (step S23).

  FIG. 20 shows a state where a member card is placed. In order to indicate that the ID has been received and approved, the projection image generation unit is notified of the color change and is changed (represented by hatching). The ID information is transferred to the processing unit, and the received processing unit displays a specific file (corresponding to a startup image) based on the ID information. FIG. 21 shows a state where a file is displayed. The angle recognition unit 180 monitors the angle of the member card.

  When the member card is rotated (see FIG. 22), the angle recognizing unit 180 recognizes the angle, and the same processing as described above is performed to exceed the threshold value, thereby changing the color of the object. Thereafter, when the count exceeds a specific value, it is selected and is a document, and therefore, the display content in Document of the general display information table is displayed as a startup screen. FIG. 23 shows the state. The change of the angle is recognized by the angle recognizing unit 180 using the member card used in advance for the selection of the activation screen. FIG. 24 shows a state in which the color of “print out” has been changed (provisionally selected).

  If the count exceeds a specific value without changing the angle, the selected state is entered. FIG. 25 shows the state. In the example of FIG. 25, since “printout” is selected, referring to the application information table, in the case of printout, “Print” is displayed in the approval display, so the approval operation of the ID information table is “Printer”. When a certain object (here, the miniature multifunction device 20) is placed, it is recognized and approved, and a printout is instructed. FIG. 26 shows the state.

  Then, the process execution unit 160 refers to the application information table shown in FIG. 7 from the ID number and angle, and is associated with the object ID acquired by the attribute information acquisition unit 130 and specified by the angle. The path of the existing application is acquired (step S19), and the target application is executed (step S20).

  As described above, the information processing apparatus 100 according to the second embodiment of the present invention can select a startup image without using an input device such as a mouse, and can continue to operate even when there are a plurality of objects. Since it can be used as an approval operation based on a possible ID, security can be further improved and operability is also good.

  In the embodiment apparatus, the input device 17 such as a mouse is operated to place the pointer on the screen on any of the activation images 19 on the screen 12, and the same instruction is given by an operation such as clicking. I can do it, but I won't touch it here.

  As described above, the present invention eliminates the trouble of using an application when using a TUI, has the effect of improving the usability and operability of direct operations, and processing images. It is useful for an information processing apparatus that performs display.

It is a side view of the image display apparatus which concerns on the 1st, 2nd embodiment of this invention. 1 is a perspective view of an image display device according to first and second embodiments of the present invention. It is an apparatus block diagram of the image display apparatus which concerns on the 1st, 2nd embodiment of this invention. It is a figure which shows the functional structure of the information processing apparatus which concerns on the 1st, 2nd embodiment of this invention. It is a figure which shows an example of ID information table. It is a figure which shows an example of a general display information table. It is a figure which shows an example of an application information table. It is a figure which shows an example of an approval operation | movement information table. It is a figure which shows the circular barcode stuck on the object. It is a flowchart which shows an example of a process of the information processing apparatus which concerns on the 1st Embodiment of this invention. It is a figure which shows an image when the miniature of a multifunction machine is grounded on the screen. It is a figure which shows an image when a starting screen will be in the state before selection. It is a figure which shows an image when the miniature of a multifunction machine is rotated and the starting screen will be in the state before selection. It is a figure which shows an image when a starting screen will be in a selection state. It is a flowchart which shows an example of a process of the information processing apparatus which concerns on the 2nd Embodiment of this invention. It is a figure which shows an image when a camera is grounded on a screen. It is a figure which shows an image when a starting screen will be in the state before selection. It is a figure which shows an image when a camera is rotated and a starting screen will be in the state before selection. It is a figure which shows an image when a starting screen will be in a selection state and it will be waiting for a member card. It is a figure which shows an image when a member card is put and it will be in a selection state. It is a figure which shows an image when the file relevant to a member card and a camera is displayed as a list. It is a figure which shows an image when rotating a member card and a starting screen will be in the state before selection. It is a figure which shows an image when a starting screen is projected according to Document. It is a figure which shows an image when a starting screen will be in the state before selection. It is a figure which shows an image when a starting screen is selected and it will be in a printer waiting state. It is a figure which shows an image when the miniature of a multifunction peripheral is grounded on a screen and printout is selected.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image display apparatus 10 File list 11 Surface 12 Screen 13 Projection surface 14 Case 15 Projector (projection part)
16 CCD camera (imaging part)
DESCRIPTION OF SYMBOLS 19 Startup image 20 Miniature compound machine 30 Miniature printer 40 Miniature tree 50 Photo paper 60 Camera 70 ID card 100 Information processing apparatus 101 Processing apparatus 102 Main storage apparatus 103 Auxiliary storage apparatus (storage section)
110 Image extraction unit 120 ID recognition unit (object recognition unit)
130 Attribute Information Acquisition Unit 140 Projected Image Generation Unit (Startup Image Display Unit)
160 Process Execution Unit 170 Registration Unit 180 Angle Recognition Unit 220 Object Recognition Unit 250 Process Selection Accepting Unit 301 Circular Bar Code 380 Related ID Information Search Unit 390 Display Processing Unit

Claims (11)

An image extraction unit for extracting an image of the object when an operation object placed or approached on the screen surface is imaged;
An ID recognition unit for acquiring ID information for identifying the object from the image of the object extracted by the image extraction unit;
Application information stored in the storage unit in association with the display content and selection display content, the next step, the approval display,
An ID information table stored in a storage unit in association with the ID information and attribute information including the application information;
An attribute information acquisition unit that acquires attribute information corresponding to the ID information acquired by the ID recognition unit from the ID information table;
A startup image display unit for displaying a startup image corresponding to the application information of the attribute information acquired by the attribute information acquisition unit on the screen;
Angle recognition that accepts selection of a startup image displayed by the startup image display unit from an arrangement angle on the screen surface of the ID information acquired by the ID recognition unit, and further controls execution start of an application corresponding to the startup image And
An information processing apparatus comprising: a process execution unit that executes an application corresponding to an execution start command from the angle recognition unit.   The information processing apparatus according to claim 1, wherein the ID information table includes general display information, and the information described in the general display information table can be displayed together. The image of the object extracted by the image extraction unit is composed of a barcode image,
The ID recognition unit analyzes whether the image of the object is a barcode image, and acquires the ID information from the barcode image when it is determined that the image of the object is a barcode image. The information processing apparatus according to claim 1.   The information processing apparatus according to claim 1, wherein the application information table corresponds to an approval operation and can be used as an approval operation based on an ID that can be approved.   The information processing apparatus according to claim 1, wherein the angle recognition unit uses an angle threshold obtained by dividing the number of the activation screens from 360 degrees in selecting the activation image.   2. The information processing apparatus according to claim 1, wherein when an object to be operated is projected on the screen, the angle can be changed using an object used before that.   The information processing apparatus according to claim 1, further comprising a timer that counts time, wherein the timer recognizes the angle of the ID information every arbitrary time.   2. The information processing apparatus according to claim 1, wherein a count value is added each time an angle is recognized, and a selected state is reached when an arbitrary count value is reached. Prepare an ID information table stored in the storage unit in association with attribute information including application information stored in the storage unit in association with ID information, display content, selection display content, next step, approval display Every
An image extraction step of extracting an image of the object when an operation object placed or approached on the screen surface is imaged;
An ID recognition step of acquiring ID information for identifying the object from the image of the object extracted by the image extraction step;
An attribute information acquisition step of acquiring attribute information corresponding to the ID information acquired by the ID recognition step from the ID information table;
A startup image display step of displaying a startup image corresponding to the application information of the attribute information acquired by the attribute information acquisition step on the screen;
An angle for accepting selection of an activation image displayed by the activation image display step from an arrangement angle on the screen surface of the ID information acquired by the ID recognition step, and further controlling execution start of an application corresponding to the activation image A recognition step;
A process execution step of executing an application corresponding to the execution start command from the angle recognition step. An image extraction process for extracting an image of the object when an operation object placed or approached on the screen surface is imaged;
ID recognition processing for acquiring ID information for identifying the object from the image of the object extracted by the image extraction processing;
Attribute information acquisition processing for acquiring attribute information corresponding to the ID information acquired by the ID recognition processing from the ID information table;
A startup image display process for displaying a startup image corresponding to the application information of the attribute information acquired by the attribute information acquisition process on the screen;
An angle for accepting selection of an activation image displayed by the activation image display process from an arrangement angle on the screen surface of the ID information acquired by the ID recognition process, and further controlling an execution start of an application corresponding to the activation image Recognition processing,
A program for an information processing apparatus that causes a computer to execute a process execution process for executing an application corresponding to an execution start command by the angle recognition process.   The computer-readable recording medium which recorded the information processing program of Claim 10.

Images