JP6811642B2 - Image forming device, information processing system, information processing program and information processing method - Google Patents

Description

The present invention relates to an image forming apparatus, an information processing system, an information processing program and an information processing method, and in particular, for example, an image forming apparatus, an information processing system, and information processing which are set in a state corresponding to a series of changes in the position of a person. Regarding programs and information processing methods.

An example of this type of image forming apparatus is disclosed in Patent Document 1. In the copying apparatus disclosed in Patent Document 1, when a copying request is made based on the image data registered in the image memory by the IC card, the CPU identifies the presence or absence of the copying request by the IC card and registers it in the image memory. It controls whether or not a copy request can be made based on the image data, and restricts the use of the image data on the image memory by a third party.

Japanese Unexamined Patent Publication No. 5-122476

However, in the technique disclosed in Patent Document 1, in order to use the image data on the image memory, it is necessary to insert the IC card into the copying device. That is, unless the user can directly operate the copying device, it is not possible to print the image data or the like.

Therefore, a main object of the present invention is to provide a novel image forming apparatus, information processing system, information processing program and information processing method.

Another object of the present invention is to provide an image forming apparatus, an information processing system, an information processing program, and an information processing method that can improve convenience.

The first invention, the receiving means, tracking means, state determination means, setting means, the print execution means, and a preview display unit, an image forming apparatus. The receiving means receives the print data from the external terminal. The tracking means tracks the position of the person with respect to the image forming apparatus itself at the place where the image forming apparatus itself is installed. The state determining means of the image forming apparatus itself according to the positional relationship with the person when a series of changes in the position of the person tracked by the tracking means indicate that the person is approaching the image forming apparatus itself. Determine what it should be. The setting means sets the state of the image forming apparatus itself to the desired state determined by the state determining means. The print executing means is set to a printable state as it should be by the setting means, and when a predetermined condition is satisfied, printing is executed based on the print data received by the receiving means. The preview display means displays a preview image corresponding to the print data in response to the print execution means performing printing based on the print data.

According to the first invention, when a person approaches the image forming apparatus, the state of the image forming apparatus itself is set to the desired state according to the positional relationship with the person, so that convenience can be improved. it can.
Further, according to the first invention, when print data is received, it is temporarily held, set to a printable state, and when a predetermined condition is satisfied, printing is executed based on the print data. Therefore, for example, print data can be printed. Printing can be performed when the transmitting person approaches the image forming apparatus. Therefore, it is possible to perform user authentication when a person approaches and perform printing processing based on the user authentication.
Further, according to the first invention, since the preview image of the print data is displayed, the content printed by the preview image can be known without looking at the output image.

The second invention is subordinate to the first invention and further includes direction detecting means. The direction detecting means detects the moving direction of the person based on a series of changes in the position of the person tracked by the tracking means. For example, the current moving direction is detected from the position immediately before the person and the current position. The preview display means displays the preview image so that the vertical direction coincides with the moving direction detected by the direction detecting means.

According to the second invention, it is possible to display a preview image that is easy to see for an approaching person.

The third invention is subordinate to the first invention, and the line-of-sight direction detecting means detects the line-of-sight direction of a person tracked by the tracking means when the person is approaching the image forming apparatus itself. The preview display means displays the preview image so that the vertical direction coincides with the line-of-sight direction detected by the line-of-sight direction detecting means.

Also in the third invention, a preview image that is easy to see for an approaching person can be displayed.

The fourth invention is subordinate to any of the first to third inventions and further comprises a floor sensor. The floor sensor is provided in an environment in which the image forming apparatus itself is arranged. The tracking means tracks the position of the person based on the output of the floor sensor.

According to the fourth invention, since the floor sensor is used, the person can be tracked by detecting the change in pressure of the size and shape corresponding to the person's foot. Further, if a specific pressing shape can be detected, the arrangement position of another installation object installed in the environment in which the image forming apparatus itself is arranged can be identifiable.

A fifth aspect of the invention is subject to claim 4 , wherein the tracking means tracks the position of a person in the environment from an initial position based on the output of the floor sensor.

According to the fifth invention, a series of changes in position from the initial position can be detected.

The sixth invention is subordinate to the fifth invention, where the initial position is the seating position of the person being tracked by the tracking means.

According to the sixth invention, if the person who uses the office desk in the seat position is identifiablely stored, the person can be identified by tracking the position of the person from the initial position.

A seventh invention is an information processing system including an image forming apparatus and a server communicably connected to the image forming apparatus, wherein the server is a person with respect to the image forming apparatus at a place where the image forming apparatus is installed. A tracking means for tracking a position, when a series of changes in the position of a person tracked by the tracking means indicate that the person is approaching the image forming apparatus, the image forming apparatus is subjected to the positional relationship with the person. A state determining means for determining an ideal state, a setting means for instructing the image forming apparatus to set the state of the image forming apparatus to the ideal state determined by the state determining means, and printing as the ideal state by the setting means. A print instruction means for instructing the image forming apparatus to execute printing when the state is set to be possible and a predetermined condition is satisfied, and the image forming apparatus is a receiving means for receiving print data from an external terminal and a print instruction. When the means instructed to execute printing, the print execution means that executes printing based on the print data received by the receiving means, and the print data according to the print execution means that executes printing based on the print data. Ru with a preview display means for displaying a preview image corresponding to an information processing system.

The eighth invention is an information processing program executed by a computer, in which a receiving step for receiving print data from an external terminal on a computer processor, a position of a person with respect to the office equipment at a place where the office equipment is installed. When a series of changes in the position of the person tracked in the tracking step and the tracking step indicate that the person is approaching the office equipment, the state of the office equipment should be determined according to the positional relationship with the person. determining the state determination step, setting step of setting a state there should determined in clerical state condition determination step of a device, and set to a printable state as the state should be in the setting step, when a predetermined condition is satisfied, A print execution step that executes printing based on the received print data in the reception step, and a preview display step that displays a preview image corresponding to the print data are executed in response to the execution of printing based on the print data in the print execution step. It is an information processing program.

A ninth invention is an information processing method, wherein (a) a step of receiving print data from an external terminal, and ( b ) a step of tracking the position of a person with respect to the office equipment at a place where the office equipment is installed. ( C ) When a series of changes in the position of the person tracked in step ( b ) indicate that the person is approaching the office equipment, the ideal state of the office equipment is determined according to the positional relationship with the person. Steps to be performed , ( d ) Set the state of the office equipment to the desired state determined in step ( c ), (e) Set the state to be printable as the desired state in step (d), and set predetermined conditions. When satisfied, the preview image corresponding to the print data according to the step (a) of executing printing based on the received print data in step (a) and (f) performing printing based on print data in step (e). It is an information processing method including a step of displaying .

In the seventh to ninth inventions as well, the convenience can be improved as in the first invention.

According to the present invention, when a person approaches the image forming apparatus, the state of the image forming apparatus itself is set to the desired state according to the positional relationship with the person, so that the person can directly operate the image forming apparatus. The image forming apparatus can be operated appropriately even if it is not in the state. Therefore, convenience can be improved.

FIG. 1 is an illustrated diagram showing an example of a configuration of an information processing system according to a first embodiment of the present invention. FIG. 2 is a block diagram showing an electrical configuration of the image forming apparatus in FIG. FIG. 3 is an illustrated diagram showing a bird's-eye view of the environment to which the information processing system shown in FIG. 1 is applied. FIG. 4 is an illustrated diagram for explaining a range set for each office device in order to determine the positional relationship between each office device and a person shown in FIG. FIG. 5 (A) is a graphic diagram showing a table of person information, FIG. 5 (B) is a graphic diagram showing a table of device information, and FIG. 5 (C) is a graphic diagram showing a table of state information. .. FIG. 6 is an illustrated diagram showing an example of a memory map of the RAM of the image forming apparatus shown in FIG. FIG. 7 is an illustrated diagram for explaining the specific contents of the data storage area shown in FIG. FIG. 8 is a flow chart showing a part of an example of the state control processing of the CPU of the image forming apparatus shown in FIG. FIG. 9 is a second part of the state control process of the CPU of the image forming apparatus shown in FIG. 1, and is a flow chart following FIG. FIG. 10 is a third part of the state control process of the CPU of the image forming apparatus shown in FIG. 1, and is a flow chart following FIG. FIG. 11 is a fourth part of the state control process of the CPU of the image forming apparatus shown in FIG. 1, and is a flow chart following FIG. FIG. 12 is a fifth part of the state control process of the CPU of the image forming apparatus shown in FIG. 1, and is a flow chart following FIG. FIG. 13 is an illustrated diagram showing another application example of the information processing system shown in FIG. FIG. 14 is an illustrated diagram showing an example of the appearance configuration of the image forming apparatus in the second embodiment. FIG. 15 is a cross-sectional view showing an example of a partial cross section of the liquid crystal panel with a built-in sensor shown in FIG. FIG. 16 is an illustrated diagram for explaining an example of a method of detecting a touch position when the liquid crystal panel with a built-in sensor shown in FIG. 14 is touch-operated. FIG. 17 is an illustrated diagram for explaining another example of a method of detecting a touch position when the liquid crystal panel with a built-in sensor shown in FIG. 14 is touch-operated. FIG. 18A is an illustrated diagram for explaining the angle of view of the camera provided in the image forming apparatus in the second embodiment and the line of sight of the person photographed by the camera, and FIG. 18B is the line of sight of the person. It is a schematic diagram which shows the display example of the corresponding preview image. FIG. 19 is an illustrated diagram showing an example of the configuration of the information processing system in the third embodiment.

[First Example]
FIG. 1 is an illustrated diagram showing an example of the information processing system 10. With reference to FIG. 1, the information processing system 10 of the first embodiment includes an image forming apparatus 12, and a floor sensor (floor pressure sensor) 14 is connected to the image forming apparatus 12. Further, the image forming apparatus 12 is connected to the cutting machine 18 and the plurality of user terminals 30 via a network 16 such as a LAN.

In the information processing system 10 of the first embodiment, one image forming device 12 and one cutting machine 18 are provided, but a plurality of image forming devices 12 and / and the cutting machine 18 may be provided. .. Further, in the information processing system 10 of the first embodiment, the image forming apparatus 12 is connected to a plurality of user terminals 30, but the number of user terminals 30 may be one. Further, the image forming apparatus 12, the cutting machine 18, and the user terminal 30 may be connected by wire or wirelessly.

The image forming apparatus 12 is typically a multifunction device (MFP: Multifunction Peripheral) having a copying function, a printer function, a scanner function, a facsimile function, and the like. However, the image forming apparatus 12 may include any one of a copying function, a printer function, a scanner function, and a facsimile function.

The floor sensor 14 is composed of a large number of pressure sensors. The pressure-sensitive sensor is a sensor whose resistance value changes depending on the contact pressure (magnitude of load), has a sheet-like thickness, and is formed in a predetermined size and a predetermined shape. In this first embodiment, as will be described later, based on the output of the floor sensor 14, pressing by a protrusion (protruding portion) formed on the lower surface of a person's foot, an image forming device 12, a cutting machine 18, and an office desk 32. For example, one pressure sensor is formed in a square shape of 10 cm × 10 cm in order to detect and manage the position in two-dimensional coordinates.

The cutting machine 18 is a device for cutting paper, and although not shown, the cutting machine 18 includes a microcomputer and a communication module. The microcomputer communicates with an external device (external device) via the network 16 by using the communication module. In the first embodiment, the microcomputer turns on / off the power of the cutting machine 18 including itself according to the instruction from the image forming apparatus 12.

The user terminal 30 is a general-purpose computer (terminal) used by the user, and specifically, a desktop PC, a notebook (laptop) PC, a tablet PC, or the like is applicable. Although not shown, the user terminal 30 is connected to or integrally provided with a monitor and an input device.

FIG. 2 is a block diagram showing an unlimited example of the electrical configuration of the image forming apparatus 12 shown in FIG. As shown in FIG. 2, the image forming apparatus 12 includes a CPU 50, and the CPU 50 includes a RAM 54, an HDD 56, a communication unit 58, a modem 60, a touch panel control circuit 62, a display control circuit 64, and an operation unit detection circuit via a bus 52. 66, connected to the image reading unit 68 and the image forming unit 70. Further, the image forming apparatus 12 includes a touch panel 72, a main body display 74, and an operation unit 76. The touch panel 72 is connected to the touch panel control circuit 62, the main body display 74 is connected to the display control circuit 64, and the operation unit 76 is connected to the operation unit detection circuit 66.

The CPU 50 controls the overall control of the image forming apparatus 12. The RAM 54 is used as a working area and a buffer area of the CPU 50. The HDD 56 is the main storage device of the image forming apparatus 12, and stores the image data read by the image reading unit 68, the image data transmitted from the external computer, and the like.

However, the image data read by the image reading unit 68 is subjected to predetermined processing such as amplification, analog / digital conversion, shading correction, color conversion from RGB to YMC, and color gradation adjustment. The CPU 50 stores the image data subjected to the predetermined processing in the HDD 56, or controls the image forming unit 70 to print the corresponding image on a recording paper (paper) or the like.

Although not shown, the image forming apparatus 12 is also provided with a ROM for storing default values for the startup program of the image forming apparatus 12 and various information.

The communication unit 58 is an interface or module connected to the network 16 for the image forming apparatus 12 to communicate with another (external) computer (for example, the user terminal 30) via the network 16. The modem 60 is connected to a telephone line and transmits and receives data about the facsimile.

The touch panel 72 is a capacitance type touch panel, and is provided on the display surface of the main body display 74. However, the main body display 74 in which the touch panel is integrally provided may be provided. Further, as the touch panel, other types such as a resistance film type, an LCD (Liquid Crystal Display) type with a built-in optical sensor, and an infrared type can also be used.

The touch panel control circuit 62 applies a voltage or the like required for the touch panel 72, and when a touch operation (touch input) within the effective touch range of the touch panel 72 is detected, the touch panel control circuit 62 outputs touch coordinate data indicating the position of the touch input. Output to CPU 50.

The main body display 74 is a display device provided on the operation panel, and an LCD or an organic EL is used. On the main body display 74, various software buttons required for the operation of the image forming apparatus 12 and various settings, various setting contents, a preview image, an image showing the state of the image forming apparatus 12, and the like are displayed.

The display control circuit 64 includes a GPU, a VRAM, and the like, and under the instruction of the CPU 50, the GPU uses the image generation data (not shown) stored in the RAM 54 to display various screens. The data is generated in VRAM, and the generated screen data is output to the main body display 74.

The operation unit 76 is a hardware button provided on the image forming apparatus 12, and includes, for example, a power button, a reset button, a power saving button, and a home button. The operation unit detection circuit 66 outputs an operation signal or operation data corresponding to the operation of the operation unit 76 to the CPU 50.

The image reading unit 68 includes a line sensor that scans a document placed on a transparent platen or the like, and the line sensor measures the brightness and chromaticity of the reflected light imaged on the light receiving element under the instruction of the CPU 50. It is detected, image data based on the image of the surface of the document is generated, and as described above, it is input to the CPU 50 after being subjected to a predetermined process. For example, the image data obtained by scanning is transmitted from the communication unit 58 to an external computer such as the user terminal 30 via the network 16.

The image forming unit 70 prints an image corresponding to the image data on a recording paper (paper) or the like as described above according to the instruction from the CPU 50. The image forming unit 70 includes an exposure unit, a developing device, a photoconductor drum, a cleaner unit, a charging device, an intermediate transfer belt unit, a secondary transfer roller, a fixing unit, and the like, and displays an image on paper conveyed from a paper feed tray. The formed and image-formed paper is ejected to the output tray. As the image data for forming an image on the paper, the image data read by the image reading unit 68, the image data transmitted from an external computer, and the like are used.

FIG. 3 is an illustrated diagram when a bird's-eye view of the environment (a certain room) to which the information system 10 of the first embodiment is applied. As shown in FIG. 3, the information processing system 10 of the first embodiment is applied to a certain room of a certain company, and a person (user) uses an image forming apparatus 12, a cutting machine 18, and a user terminal 30. can do.

As shown in FIG. 3, a room is provided with an image forming apparatus 12, a floor sensor 14, and a cutting machine 18. In FIG. 3, the walls partitioning the room are shown with diagonal lines. The floor sensor 14 is spread all over the floor of a certain room. The image forming apparatus 12 and the cutting machine 18 are arranged at predetermined positions in a certain room. Further, in a certain room, a plurality of office desks 32 for a plurality of persons to perform work are arranged, and a user terminal 30 used by each person is placed on each office desk 32. Further, two shelves are arranged between the place (area) where the image forming apparatus 12 and the cutting machine 18 are arranged and the area where the plurality of office desks 32 are arranged. Between the two shelves, between each shelf and the wall is a passage from the area where the plurality of office desks 32 are arranged to the area where the image forming apparatus 12 and the cutting machine 18 are arranged. Further, an entrance / exit of a certain room is provided in the vicinity of the image forming apparatus 12.

As described above, the image forming apparatus 12 is connected to the user terminal 30 via the network 16. Therefore, each person working in a certain room prints the document or the like by outputting (transmitting) the print data about the document or the like created by using the user terminal 30 to the image forming apparatus 12 together with the print instruction. be able to. In addition, each person can scan, copy, and transmit a facsimile using the image forming apparatus 12. In addition, each person can use the cutting machine 18 to cut unnecessary paper or disc media (CD, DVD, etc.). Further, each person can create a document or the like using the user terminal 30.

In order to save power, office equipment such as the image forming apparatus 12, the cutting machine 18, and the user terminal 30 are turned off or put into a state in which power consumption is suppressed as much as possible (power saving mode or standby state) when not in use. It is common to be done.

Generally, in the case of the image forming apparatus 12, when not in use, the power saving mode is set, and a person detection sensor such as a pyroelectric sensor (infrared sensor) is used according to the operation of a person (user). Depending on the detection of a person by using, the mode is shifted to the normal mode. When the pyroelectric sensor is used, the image forming apparatus 12 is set to shift at an earlier timing than the person shifts to the normal mode by operating a button.

Further, in general, the cutting machine 18 is not connected to the network, and a person turns the power on / off. Alternatively, the power of the cutting machine 18 is turned on according to the setting of the paper or the like to be cut by the person in the cutting machine 18, and the power of the cutting machine 18 is turned off when a predetermined time elapses after the cutting is completed.

Further, in general, in the case of the user terminal 30, when the power saving mode is set to be used, when the person instructs the user terminal 30 to shift to the power saving mode, or nothing is performed for a predetermined time. When no action is taken, it goes into power saving mode and goes into normal mode in response to a person operating any key on the keyboard, touching the touch panel, or clicking or moving the computer mouse. Will be migrated.

Therefore, in the environment as shown in FIG. 3, for example, even when a person leaves the room by passing in front of the image forming apparatus 12, when this person is detected by the pyroelectric sensor, the image forming apparatus 12 usually operates. It may shift to the mode. Therefore, there is a problem that wasteful power is consumed. In order to avoid this, when the distance for detecting (sensing) a person by the pyroelectric sensor is set short, the time until the image forming apparatus 12 shifts to the normal mode is increased by operating the image forming apparatus 12. There is a possibility that it is almost the same as when shifting to normal mode. Also, setting (adjusting) such a distance is troublesome.

Further, in the case of the cutting machine 18 and the user terminal 30, the person operates the cutting machine 18 and the user terminal 30 to shift from the power saving mode (or power off) to the normal mode (or power on). The person needs to wait for the use of the cutting machine 18 and the user terminal 30 until the operation is required and the mode is changed to the normal mode (or the power is turned on).

Therefore, in this first embodiment, the position of the person is tracked based on the output of the floor sensor 14, and the image forming apparatus 12, the cutting machine 18, or the cutting machine 18 or based on the series of changes (movement locus) of the tracked person's position. The ideal state of the user terminal 30 is determined, and the image forming apparatus 12, the cutting machine 18, or the user terminal 30 is set (changed) to the determined state. Here, the ideal state means a state (usable state) in which a person (user) is ready to be considered necessary when using the office equipment.

However, since the user terminal 30 is installed on the seat of the person who uses it (on the office desk 32), the user terminal 30 cannot be recognized based on the output of the floor sensor 14. Therefore, when identifying a moving person based on the output of the floor sensor 14, the office desk 32 is detected instead of the user terminal 30. Therefore, in this specification, the office equipment means an image forming device 12, a cutting machine 18, and an office desk 32 when identifying a moving person, but when changing the state, the office equipment means an image forming device 12. 12, meaning the cutting machine 18 and the user terminal 30.

FIG. 4 is an illustrated diagram showing a range (area) R1 and a range R2 set for office equipment (12, 18, 32).

As shown in FIG. 4, a range R1 and a range R2 are set in the office equipment (12, 18, 32). The range R1 is the range of the distance d1 from the office equipment (12, 18, 32), and the range R2 is the range excluding the range R1 in the range of the distance d2 from the office equipment (12, 18, 32). As can be seen from FIG. 4, the distance d2 is larger than the distance d1. For example, the distance d1 is about 1 m, and the distance d2 is about 2 m.

Further, as can be seen from FIG. 4, a semicircular (fan-shaped) range R1 and a strip-shaped (part of the donut-shaped) range R2 are set in front of the office equipment (12, 18, 32). Will be done. That is, the range R1 and the range R2 are set so that the person can be detected when the person approaches or uses the office equipment (12, 18, 32).

In this first embodiment, the range R1 and the range R2 of the same size are set regardless of the type of the office equipment (12, 18, 32), but the office equipment (12, 18, 32) The magnitude of range R1 and / and range R2 may vary depending on the type.

Further, the distance d1 and the distance d2 for determining the size of the range R1 and the range R2 are the distances from the central position on the front surface of the office equipment (12, 18, 32). However, the front surface of the office equipment (12, 18, 32) is the surface facing the person when using the office equipment (12, 18, 32).

In this first embodiment, a series of changes in the position of the person are detected based on the output of the floor sensor 14, and when the person is approaching the office equipment (12, 18, 32), the image forming apparatus 12 is cut. The states of the machine 18 and the user terminal 30 are set (changed) according to the position of a person.

Judgment as to whether a person is approaching office equipment (12, 18, 32) is performed as follows. First, the distance (first distance) between the current position information of the person and the office equipment (12, 18, 32) and the previous position information of the person and the office equipment (12, 18, 32) (second distance). ) Are compared to determine whether the first distance is shorter than the second distance. When the first distance is shorter than the second distance, it is further determined whether or not the moving direction of the person is toward the office equipment (12, 18, 32). When the moving direction is toward the office equipment (12, 18, 32), it is determined that the person is approaching the office equipment (12, 18, 32). However, the moving direction of the person is determined by the direction of the vector starting from the previous position information and ending at the current position information.

When the first distance is the second distance or more and the moving direction is not toward the office equipment (12, 18, 32), it is said that the person is approaching the office equipment (12, 18, 32). Not judged.

In this way, since the position of the person is detected and the movement direction is calculated (determined), if the position of the foot moved in the movement direction by the distance corresponding to the stride is detected, a plurality of people can be in the room. Each person can be tracked individually, even when moving through. However, the stride is determined based on the average stride of an adult male and the average stride of an adult female.

Further, the identification of the moving person and the setting of the states of the image forming apparatus 12, the cutting machine 18, and the user terminal 30 are performed using the tables shown in FIGS. 5A to 5C. FIG. 5 (A) is an illustrated diagram showing an example of a person information table, FIG. 5 (B) is an illustrated diagram showing an example of a device information table, and FIG. 5 (C) is an example of a state information table. It is a schematic diagram which shows. In this first embodiment, the tables shown in FIGS. 5A to 5C are created in advance, and when the corresponding data is stored in the HDD 56 of the image forming apparatus 12 and the state control process is executed. It is read and stored in the RAM 54.

As shown in FIG. 5A, the terminal ID and the device ID are described in the person information table corresponding to the person ID. The person ID is identification information for identifying a person existing in the environment to which the information processing system 10 is applied. In this first embodiment, the person ID is represented by a four-character alphabet. However, the identification information does not have to be limited, and numbers or other symbols may be used as long as the person can be identified. This also applies to the terminal ID and the device ID described later. However, the person ID, the terminal ID, and the device ID are set so as to be identifiable.

The terminal ID is identification information for identifying the user terminal 30 used by a person. In this embodiment, it is expressed using the letters T and numbers. However, as the terminal ID, the IP address assigned to the user terminal 30 on the network 16 may be used. Alternatively, the MAC address assigned to the communication unit included in the user terminal 30 may be used. When the IP address or MAC address is used, the image forming apparatus 12 can know the source of the print instruction by the IP address or MAC address. However, when the IP address or MAC address is not used as the terminal ID, the IP address or MAC address is associated with the terminal ID.

The device ID is identification information for identifying the image forming apparatus 12, the cutting machine 18, and the office desk 32. In this embodiment, the device ID is represented using the letters M and numbers. However, the device ID described in the person information table is the device ID for the office desk 32 used for the seat of the person indicated by the corresponding person ID. In this way, the device ID is included in the person information table in order to associate the user terminal 30 used by the person with the office desk 32. As a result, as will be described later, when it is detected that a person has started moving based on the output of the floor sensor 14, the office desk 32 arranged at or near the starting point where the movement has started It is possible to identify a person.

As shown in FIG. 5B, in the device information table, the name, pressing shape, and position information are described corresponding to the device ID. The device ID is as described above. The names are the names of the office equipment to which the equipment ID is assigned, and in the first embodiment, the image forming apparatus 12 (multifunction device), the cutting machine 18, and the office desk 32. The pressing shape is a shape formed by pressing the floor sensor 14 when the image forming apparatus 12, the cutting machine 18, and the office desk 32 are arranged on the floor sensor 14. That is, protrusions that press the floor sensor 14 in the shape indicated by the pressing shape are formed on the lower surface or the sole of the foot of the image forming device 12, the cutting machine 18, and the office desk 32 corresponding to the device ID.

The position information represents the position where the corresponding image forming apparatus 12, the cutting machine 18, and the office desk 32 are arranged by using coordinates. For example, the position information is the coordinates of the position where the image forming apparatus 12, the cutting machine 18, and the office desk 32 are arranged when the floor surface of the environment to which the information processing system 10 is applied is represented by a two-dimensional coordinate system. .. However, the position where the pressing-shaped protrusion is provided is determined at the position of the image forming device 12, the cutting machine 18, and the office desk 32 where the pressing-shaped protrusion is formed. For example, in the embodiment shown in FIG. 3, in the drawing, the upper left apex of the floor portion is set as the origin, the horizontal direction is the X-axis direction, and the vertical direction is the Y-axis direction. The unit of length of each axis component of the position information is cm.

As shown in FIG. 5C, in the state information table, states 1, state 2 and state 3 are described corresponding to the device IDs. The device ID is as described above. The states 1, the state 2, and the state 3 indicate the contents of the states set in the image forming apparatus 12, the cutting machine 18, and the office desk 32 to which the corresponding device IDs are attached. However, the state set for the office desk 32 means the state of the user terminal 30 arranged on the office desk 32.

Therefore, when the movement of an object in the environment is detected based on the output of the floor sensor 14, the pressed shape of the object against the floor sensor 14 is recognized to determine whether the moved object is a person or an office device. Judged.

Based on the output of the floor sensor 14, if the same pressing shape as the pressing shape described in the device information table is not detected once and then detected again, the corresponding office equipment (12, 18, 32) is detected. It is determined that the office equipment has been moved, and the location information of the office equipment is updated. On the other hand, if the pressed shape detected based on the output of the floor sensor 14 is different from the pressed shape described in the device information table and the size is an oval shape (footprint shape) of about 20 to 30 cm, It is determined that the person has been moved, and the person is identified.

The position information of the position where the pressure changes from the output of the floor sensor 14 is stored in chronological order, and by referring to the table of device information, the office desk 32 can be located at the starting point of the change of the position information or a position in the vicinity thereof. When is arranged, the person who uses the office desk 32 is specified by referring to the person information table. However, when a person enters from the outside of the room, the person is not specified because the office desk 32 is not arranged at the position of the starting point of the change of the position information or the position in the vicinity thereof.

When the person is approaching the image forming apparatus 12, when the person enters the range R2 set in the image forming apparatus 12, the image forming apparatus 12 is in the power-on (normal mode) state from the power saving mode state. When the range R1 is entered, the image forming apparatus 12 is set to a state in which the printing process can be executed. Therefore, when a person transmits a print instruction and print data to the image forming apparatus 12 using the user terminal 30, the image forming apparatus 12 receives and holds the print instruction and the print data, and then when the person approaches, when the person approaches. Executes the print process for the retained print data. However, when the person who approaches the image forming apparatus 12 cannot be identified, the image forming apparatus 12 does not execute the printing process even when the print instruction and the print data are held. In this way, the image forming apparatus 12 executes the user authentication based on the output of the floor sensor 14 and also executes the printing process based on the user authentication.

When the person is approaching the cutting machine 18, when the person enters the range R2 set in the cutting machine 18, the cutting machine 18 is set from the power off state to the power on state. In the case of the cutting machine 18, the power-on state is maintained even if a person enters (moves) the range R1. Therefore, when a person heads for the cutting machine 18, the power is turned on when the person approaches the cutting machine 18, so that the person can cut immediately. However, the cutting machine 18 sets the state according to a command from the image forming apparatus 12. For example, the CPU 50 of the image forming apparatus 12 transmits a command (Wake-on-LAN) for activating the cutting machine 18 using the communication unit 58. Then, the cutting machine 18 is set (changed) from the power-off state to the power-on state according to the command.

When a person is approaching his / her office desk 32 (user terminal 30), when the person enters the range R2 set in his / her office desk 32, the power saving mode state of the user terminal 30 is maintained. Further, when entering the range R1, the state of the normal mode in which the login screen is displayed is set. However, the command for setting the state of the user terminal 30 is transmitted from the image forming apparatus 12. When the image forming apparatus 12 sets the state of the normal mode, the image forming apparatus 12 transmits a command (Wake-on-LAN) for activating the user terminal 30 used by the specified person by using the communication unit 58. Then, the user terminal 30 is set (changed) from the power-off (power saving) state to the power-on state according to the command. Therefore, when a person heads for his / her own user terminal 30, the login screen is displayed when he / she approaches the user terminal 30, so that he / she can log in to the user terminal 30 as soon as the person is seated. However, if the person who approaches the office desk 32 (user terminal 30) cannot be identified, the image forming apparatus 12 does not send a command for setting the state of the user terminal 30 installed on the office desk 32.

In this way, it is the person's image that determines whether the person is not only in (existing) in range R1 or range R2, but also approaching the image forming apparatus 12, the cutting machine 18, and the office desk 32. This is to prevent the state from being changed as much as possible even when only crossing the front of the forming device 12, the cutting machine 18, and the office desk 32. Further, when the person leaves the image forming apparatus 12, the cutting machine 18, and the office desk 32, the power is not set to the on state. That is, unnecessary operations are not executed. Therefore, wasteful power consumption can be prevented as much as possible.

Further, in this first embodiment, the tables shown in FIGS. 5 (A) to 5 (C) are created in advance, but the table of device information shown in FIG. 5 (B) forms an image. After the device 12, the cutting machine 18, and the office desk 32 are installed in a certain room or after the installation position is changed, the image forming device 12 outputs the output of the floor sensor 14 according to the instructions of the administrator of the information processing system 10. The position information of the image forming apparatus 12 itself, the cutting machine 18 and the office desk 32 may be acquired and created based on the above. However, among the device information, the device ID, name, and pressing shape are created in advance.

Further, in the first embodiment, protrusions having a pressing shape are formed on the lower surface or the sole of the foot of the office equipment (installed object) such as the image forming apparatus 12, the cutting machine 18, and the office desk 32. It may be attached to the underside of office equipment or the sole of the foot.

Further, in this first embodiment, one pressing shape is assigned to one office device, but a plurality of pressing shapes may be assigned. In such a case, by assigning a plurality of pressing shapes to the office equipment, the office equipment may be identified by the difference in the number, positions, and the magnitudes of the pressing pressure.

FIG. 6 is an illustrated diagram showing an example of the memory map 300 of the RAM 54 of the image forming apparatus 12 shown in FIG. As shown in FIG. 6, the RAM 54 includes a program storage area 302 and a data storage area 304. The program storage area 302 stores a program (information processing program) for the state control process executed by the image forming apparatus 12, and the information processing program includes the main processing program 302a, the communication program 302b, the sensor output detection program 302c, and the device. It is composed of an information update program 302d, a tracking program 302e, a state determination program 302f, a state setting program 302g, an operation detection program 302h, an image generation program 302i, an image display program 302j, a scan program 302k, a print program 302m, a copy program 302n, and the like. .. This information processing program is read from, for example, the HDD 56 built in the image forming apparatus 12 and stored in the RAM 54.

The main processing program 302a is a program for executing the main routine of the state control processing (information processing) of the first embodiment. The communication program 302b is a program for communicating with an external computer such as a user terminal 30.

The sensor output detection program 302c is a program for detecting the output of the floor sensor 14 every predetermined time (for example, several hundred msec). The device information update program 302d includes the position information of the office equipment (12, 18, 32) in the environment to which the information processing system 10 is applied, based on the output of the floor sensor 14 detected according to the sensor output detection program 302c. This is a program for updating the device information data 304e.

The tracking program 302e is a program for tracking a person by detecting the position of the person in chronological order based on the output of the floor sensor 14 and calculating (determining) the moving direction of the person.

The state determination program 302f is a program for determining the state of the office equipment (12, 18, 30) with reference to the state information data 304f corresponding to the state information table. The state setting program 302g is a program for setting the office equipment (12, 18, 30) in the state determined according to the state determination program 302f. Therefore, the state setting program 302g is also a program for activating (Wake-on-LAN) the cutting machine 18 in the power-off state and the user terminal 30 in the sleep state.

The operation detection program 302h is a program for detecting operation input data. That is, the touch coordinate data from the touch panel 72 and the button operation signal (button operation data) from the operation unit 76 are detected. The CPU 12a acquires the touch coordinate data and / and the button operation data detected according to the operation detection program 302h, and stores the acquired touch coordinate data and / and the button operation data in the RAM 54 in chronological order.

The image generation program 302i is a program for generating screen data for various display screens displayed on the main body display 74 by using the image generation data 304b described later. Although not shown, the screen data is generated on the VRAM by the GPU built in the display control circuit 64 under the instruction of the CPU 50.

The image display program 302j is a program for displaying a display screen corresponding to the screen data generated according to the image generation program 302i on the main body display 74, and the CPU 50 controls the display control circuit 64 and is generated on the VRAM. The screen data is output to the main body display 74.

The scan program 302k is a program for scanning a document and acquiring image data subjected to predetermined processing. The print program 302m is a program for executing a print process according to a print instruction and print data from an external computer such as a user terminal 30. The copying program 302n is a program for scanning a document and executing a printing process on the image data acquired by the scanning.

Although not shown, the program storage area 302 also stores a program for executing other functions included in the image forming apparatus 12.

Further, in the data storage area 304, operation input data 304a, image generation data 304b, floor sensor data 304c, person information data 304d, device information data 304e, state information data 304f, tracking data 304g, scan data 304h and print data 304i is stored.

The operation input data 304a is touch coordinate data from the touch panel 72 and button operation data from the operation unit 76, and is stored in chronological order. The image generation data 304b is data used when generating various screens displayed on the operation panel, and includes polygon data, texture data, and the like. The image generation data 304b is read from the HDD 56 and stored in the RAM 54. The floor sensor data 304c is data about resistance values output from a large number of pressure-sensitive sensors, and is stored so that each pressure-sensitive sensor can be identified by two-dimensional coordinates.

The person information data 304d is data about the table of person information shown in FIG. 5A, and is set according to the environment to which the information processing system 10 is applied. The device information data 304e is data about the device information table shown in FIG. 5B, is set according to the environment to which the information processing system 10 is applied, and position information based on the detection result of the floor sensor 14. Is updated. The state information data 304f is data about the state information table shown in FIG. 5C, and is set according to the environment to which the information processing system 10 is applied. As described above, the person information data 304d, the device information data 304e, and the state information data 304f are read from the HDD 56 and stored in the RAM 54.

The tracking data 304g is data about the position information of the person and the current moving direction of the person detected and calculated according to the tracking program 302e. The scan data 304h is image data acquired when the original is scanned. The print data 304i is print data transmitted together with a print instruction from an external computer such as the user terminal 30. Identification information (terminal ID) of an external computer such as the user terminal 30 of the transmission source is added to the print data.

The data storage area 304 also stores other data necessary for executing the information processing program, and is also provided with counters (timers) and flags necessary for executing the information processing program.

8 to 12 are flow charts showing an example of the state control process of the CPU 50 shown in FIG. Hereinafter, the state control process will be described, but a detailed description of the same process as the process once described will be omitted.

The state control process is started when the image forming apparatus 12 is set to the power saving mode, and is started when a predetermined time elapses after the state control process is completed.

As shown in FIG. 8, when the CPU 50 starts the state control process, the CPU 50 detects the output of the floor sensor 14 in step S1. In the next step S3, it is determined whether or not there is a change in pressure. If it is "NO" in step S3, that is, if there is no change in pressure, it is determined in step S5 whether or not there is an operation. That is, the CPU 50 determines whether or not the operation input data 304a of the current frame is stored in the data storage area 304. However, the frame has a predetermined time of 1/30 second, 1/60 second, or 1/120 second.

In parallel with the state control process, the CPU 50 detects the touch coordinate data from the touch panel 72 and the button operation data from the operation unit 76, and stores the detected touch coordinate data and / and the button operation data in chronological order. Execute the process.

If it is "NO" in step S5, that is, if there is no operation, the process returns to step S1. On the other hand, if "YES" in step S5, that is, if there is an operation, in step S7, it is determined whether or not the power saving mode is set. If the result is "NO" in step S7, that is, if the power saving mode is not set, the process proceeds to step S55 shown in FIG. On the other hand, if "YES" in step S7, that is, if the power saving mode is set, the image forming apparatus 12 itself is set to the power saving mode state. In the power saving mode, the power supply to the components other than the CPU 50, the RAM 54, the communication unit 58, the touch panel control circuit 62, the operation unit detection circuit 66, the touch panel 72, and the operation unit 76 is stopped.

Further, if "YES" in step S3, that is, if there is a change in pressure, the pressed shape is recognized in step S9. Here, the CPU 50 recognizes the shape formed by the plurality of newly pressed pressure-sensitive sensors as the pressure changes. In the next step S11, the position information is acquired. Here, the center coordinates or the center of gravity coordinates calculated from the coordinates set in the plurality of pressure-sensitive sensors being pressed are acquired as the position information. The position information data acquired here is stored (added) in chronological order as tracking data 304 g. However, when the CPU 50 acquires a plurality of position information in step S11, the CPU 50 determines that a plurality of persons are moving in different plurality of places, and can identify the position information data for each different person. Remember.

In the following step S13, it is determined whether or not the equipment is office equipment (12, 18, 32). Here, the CPU 50 determines whether or not the pressing shape that matches the pressing shape recognized in step S9 is included in the device information table.

If "YES" in step S13, that is, if the office equipment (12, 18, 32), in step S15, the position information of the corresponding office equipment (12, 18, 32) is displayed in the device information table. The position information acquired in step S11 is updated, and the process returns to step S1.

If it is "NO" in step S13, that is, if it is not the office equipment (12, 18, 32), it is determined in step S17 whether or not the office desk 32 is near the starting point. Among the location information data included in the tracking data 304g, it is determined whether or not there is an office desk 32 (device ID) including the location information close to the oldest location information in time. That is, in this step S17, it is determined whether or not there is a person who has started moving from the position of the office desk 32.

If the result is "NO" in step S17, that is, if there is no office desk 32 near the starting point, the process proceeds to step S23 shown in FIG. If "YES" in step S17, that is, if there is an office desk 32 near the starting point, the person is specified in step S19. In this step S19, the CPU 50 refers to the device information data 304e to acquire the device ID of the office desk 32 existing near the starting point, and further, refers to the person information data 304d to describe the acquired device ID. Acquire the person ID.

In the following step S21, it is determined whether or not there is a print instruction from the specified person. That is, the CPU 50 determines whether or not the print data 304j from the specified person is stored in the RAM 54. If "NO" is obtained in step S21, that is, if there is no print instruction from the specified person, the process proceeds to step S23 in FIG. On the other hand, if "YES" in step S21, that is, if there is a print instruction from the specified person, the process proceeds to step S35 in FIG.

As shown in FIG. 9, in step S23, it is determined whether or not a person (position information) is approaching the image forming apparatus 12. As described above, the CPU 50 compares the current position information with the distance between the image forming apparatus 12 (first distance) and the previous position information with the distance between the image forming apparatus 12 (second distance), and the first distance is determined. Determine if it is shorter than the second distance. This also applies to the case where it is determined whether or not a person (position information) is approaching the cutting machine 18 and the user terminal 30 (office desk 32).

If the result is "NO" in step S23, that is, if the person is not approaching the image forming apparatus 12, the process returns to step S1 shown in FIG. On the other hand, if "YES" in step S23, that is, if the person is approaching the image forming apparatus 12, whether or not the person exists within the range R2 set in the image forming apparatus 12 in step S25. To judge. In step S25, the CPU 50 determines whether or not the current position information is included in the range R2 set in the image forming apparatus 12. Hereinafter, the same applies to the case where it is determined whether or not the person exists in the range R1 or the range R2 set in the cutting machine 18 and the user terminal 30 (office desk 32).

If the result is "NO" in step S25, that is, if the person does not exist within the range R2 set in the image forming apparatus 12, the process proceeds to step S29. On the other hand, if "YES" in step S25, that is, if the person is within the range R2 set in the image forming apparatus 12, in step S27, the image forming apparatus 12 itself is brought into the state corresponding to the range R2. The setting is made, and the process proceeds to step S29. In step S27, the image forming apparatus 12 is set to the power-on state (normal mode) according to the state information table shown in FIG. 5C. However, if the power is already on, the process of step S27 is skipped.

In step S29, it is determined whether or not the person is approaching the cutting machine 18. If "NO" in step S29, that is, if the person is not approaching the cutting machine 18, the process returns to step S1. On the other hand, if "YES" in step S29, that is, if the person is approaching the cutting machine 18, it is determined in step S31 whether or not the person is within the range R2 set in the cutting machine 18.

If it is "NO" in step S31, that is, if the person does not exist within the range R2 set in the cutting machine 18, the process returns to step S1. On the other hand, if "YES" in step S31, that is, if the person exists in the range R2 set in the cutting machine 18, the cutting machine 18 is set in the state corresponding to the range R2 in step S33. , Return to step S1. In step S33, the image forming apparatus 12 (CPU50) causes the cutting machine 18 to be set to the power-on state (normal mode) according to the state information table shown in FIG. 5C. However, if the cutting machine 18 is already in the power-on state, the process of step S33 is skipped.

Further, as shown in FIG. 10, in step S35, it is determined whether or not the specified person is approaching the image forming apparatus 12. If "NO" in step S35, the process proceeds to step S41. On the other hand, if "YES" in step S35, it is determined in step S37 whether or not the specified person exists within the range R2 of the image forming apparatus 12.

If "NO" in step S37, the process proceeds to step S41. On the other hand, if "YES" in step S37, the image forming apparatus 12 is set to a state corresponding to the range R2 set in the image forming apparatus 12 itself in step S39, and the process proceeds to step S41.

In step S41, it is determined whether or not the identified person is approaching the cutting machine 18. If "NO" in step S41, the process proceeds to step S47. On the other hand, if "YES" in step S41, it is determined in step S43 whether or not the specified person exists within the range R2 set in the cutting machine 18.

If "NO" in step S43, the process proceeds to step S47. On the other hand, if "YES" in step S43, the cutting machine 18 is set to a state corresponding to the range R2 set in the cutting machine 18 itself in step S45, and the process proceeds to step S47.

In step S47, it is determined whether or not the identified person is approaching his / her office desk 32. If "NO" is set in step S47, that is, if the specified person is not approaching his / her office desk 32, the process proceeds to step S53 shown in FIG.

On the other hand, if "YES" in step S47, that is, when the specified person is approaching his / her own office desk 32, the specified person is set to his / her own office desk 32 in step S49. Determine if it is within range R2. If "NO" in step S49, that is, if the specified person does not exist within the range R2 set in the own office desk 32, the process proceeds to step S53. On the other hand, if "YES" in step S49, that is, if the specified person exists within the range R2 set in the own office desk 32, the user terminal 30 of the specified person in step S51. Is set to a state corresponding to the range R2 set in the office desk 32 where the user terminal 30 itself is arranged, and the process proceeds to step S53. However, in this first embodiment, since the table of state information shown in FIG. 5C is followed, the user terminal 30 is in the same state when the person is outside the range R2 and when the person is inside the range R2. Is set to. That is, the state does not change.

As shown in FIG. 11, in step S53, it is determined whether or not the specified person is approaching the image forming apparatus 12. If "NO" in step S53, the process proceeds to step S59. On the other hand, if "YES" in step S53, it is determined in step S55 whether or not the specified person exists within the range R1 set in the image forming apparatus 12.

If "NO" in step S55, the process proceeds to step S59. On the other hand, if "YES" in step S55, the image forming apparatus 12 is set to a state corresponding to the range R1 set in the image forming apparatus 12 itself in step S57, and the process proceeds to step S59.

In step S59, it is determined whether or not the identified person is approaching the cutting machine 18. If "NO" in step S59, the process proceeds to step S65. On the other hand, if "YES" in step S59, it is determined in step S61 whether or not the specified person exists within the range R2 set in the cutting machine 18.

If "NO" in step S61, the process proceeds to step S65. On the other hand, if "YES" in step S61, the cutting machine 18 is set to a state corresponding to the range R1 set in the cutting machine 18 itself in step S63, and the process proceeds to step S65. However, in this first embodiment, since the table of state information shown in FIG. 5C is followed, the cutting machine 18 is in the same state when the person is in the range R2 and when the person is in the range R1. Is set to. That is, the state does not change.

In step S65, it is determined whether or not the identified person is approaching his / her office desk 32. If "NO" in step S65, the process returns to step S1 shown in FIG. On the other hand, if "YES" in step S65, it is determined in step S67 whether or not the specified person exists within the range R1 set in the own office desk 32.

If "NO" in step S67, the process returns to step S1 shown in FIG. On the other hand, if "YES" in step S67, in step S69, the user terminal 30 of a specific person is set to a state corresponding to the range R1 set in the office desk 32 where the user terminal 30 itself is arranged. Return to step S1.

Further, as shown in FIG. 8, if "NO" is obtained in step S7, it is determined in step S71 shown in FIG. 12 whether or not the scan is executed. That is, the CPU 50 determines whether or not the start of scanning is instructed.

If "NO" is obtained in step S71, that is, if the scan is not executed, the process proceeds to step S75. On the other hand, if "YES" in step S71, that is, if the scan is executed, the scan is executed in step S73 and the process proceeds to step S75.

In step S75, it is determined whether or not to execute the copy. That is, the CPU 50 determines whether or not the start of copying is instructed. If "NO" in step S75, the process proceeds to step S79. On the other hand, if "YES" in step S75, the copy is executed and then the process proceeds to step S79.

In step S79, other processing is executed, and the process returns to step S1. Other processes include copy mode, scan mode, facsimile mode settings, and various settings in each mode. In the copy mode, various settings such as the number of copies, print density, magnification, and paper size are applicable. In the scan mode, various settings such as document size, resolution, and scan data destination settings are applicable. In the facsimile mode, as various settings, settings such as a facsimile destination and a transfer destination of received data are applicable.

According to this first embodiment, when a person approaches the office equipment (12, 18, 32), the image forming apparatus 12 and the cutting machine 18 are set according to the range set in the office equipment (12, 18, 32). And since the state of the user terminal 30 is set to the desired state, it is possible to prevent the state of the device from being changed only when the person is set to the office equipment (12, 18, 32) and passes within the range, and the person When approaching the device, it is set to the desired state such as a usable state, so that the desired state can be set without directly operating the image forming apparatus 12, the cutting machine 18, and the user terminal 30. That is, convenience can be improved. Further, since the states of the image forming apparatus 12, the cutting machine 18, and the user terminal 30 are not changed only by passing through, wasteful power consumption can be prevented as much as possible.

Further, according to the first embodiment, since a series of changes in the position of the person are detected based on the output of the floor sensor 14, the person who uses the person is selected from the office desk 32 arranged near the starting point of the change. When the specified person approaches the image forming apparatus 12 and the print data from the specific person is retained, the print process for the retained print data is executed, so that the user's personal authentication is performed. It is possible to execute the printing process with ensured security without performing the above separately.

In the first embodiment, the case where the floor sensor 14 is spread all over the floor in the environment to which the information processing system 10 is applied has been described, but the present invention is not limited to this. For example, as shown in FIG. 13, a portion capable of recognizing a person when using the image forming apparatus 12, the cutting machine 18, and the office desk 32 (user terminal 30) and the image forming apparatus 12 in the environment (room). , The floor sensor 14 may be provided in a part of the passage when moving toward the cutting machine 18 and the office desk 32 (user terminal 30).

In such a case, the change in the position of the person (movement locus) with respect to the portion where the floor sensor 14 is not provided is the movement of the person tracked based on the output of the floor sensor 14 in the portion where the floor sensor 14 is provided. Interpolated (estimated) from the locus. In the above-described first embodiment, in order to detect the position of the person and calculate the moving direction when the person moves, when the person enters the area where the floor sensor 14 is not provided, the last calculated movement is performed. It is determined that the person is on the extension of the direction. After that, when a person enters the area where the floor sensor 14 is provided, if the person is on or near the extension line, the movement locus of the portion where the floor sensor 14 is not provided is interpolated.

In the first embodiment, the floor sensor 14 is provided to track the position of a person moving in the environment and to identify the person, but the present invention is not limited to this. Instead of the floor sensor 14, one or more cameras capable of taking a bird's-eye view of the environment are installed on the ceiling, and the position of the person can be tracked based on the image taken by the cameras. May be specified. However, in such a case, a figure or character (number) that can identify each person should be written on the shoulder of the jacket worn by each person, and these figures or characters (numbers) should be written in the captured image. By recognizing (number), a person can be individually identified.
[Second Example]
The information processing system 10 of the second embodiment displays a preview image of the print data on the image forming apparatus 12, and notifies a person approaching the image forming apparatus 12 of the contents of the print data. Since it is the same as, the duplicate description is omitted.

FIG. 14 is a perspective view of an example of the appearance configuration of the image forming apparatus 12 applied to the information processing system 10 of the second embodiment when viewed from diagonally above. The image forming apparatus 12 shown in FIG. 14 includes a main body 102 including an image forming section 70, and a paper feed cassette is provided below the main body 102. In addition, a paper output tray is provided on the upper part (upper surface) of the main body 102, and an operation unit 76 and a liquid crystal display device 80 with a built-in optical sensor are further provided on the upper part. The liquid crystal display device 80 with a built-in optical sensor is a device having the functions of both the touch panel 72 and the main body display 74. Therefore, the liquid crystal display device 80 with a built-in optical sensor functions as an operation panel that displays software keys, functions as a display device that displays various operation screens and preview images, and also functions as a scanner that scans documents. That is, the liquid crystal display device 80 with a built-in optical sensor has a touch function, a display function, and a scan function. Further, an operation unit 76 is provided on the front side of the liquid crystal display device 80 with a built-in optical sensor, and an image pickup device 78 is provided at the center of the front end surface of the operation unit 76.

FIG. 15 is an illustrated diagram schematically showing a cross-sectional structure of a part of the sensor-embedded liquid crystal panel of the optical sensor-embedded liquid crystal display device 80 provided in the image forming apparatus 12 of the second embodiment. FIG. 16 is an illustrated diagram showing a method of detecting a touch position by a reflected image. FIG. 17 is an illustrated diagram showing a method of detecting a touch position by an image.

As shown in FIG. 15, the liquid crystal display device 80 with a built-in optical sensor includes a liquid crystal panel with a built-in sensor (hereinafter, simply referred to as “liquid crystal panel”) 82 and a backlight 84 arranged on the back side of the liquid crystal panel 82. However, FIG. 15 is a cross-sectional view of a portion of the liquid crystal panel 82 corresponding to one pixel, and one pixel is composed of three sub-pixels of RGB (red, green, and blue). Although not shown, the liquid crystal panel 82 and the backlight 84 are controlled by a control circuit.

As shown in FIG. 15, the liquid crystal panel 82 includes an active matrix substrate 82a arranged on the back surface side and an opposing substrate 82b arranged on the front surface side, and a liquid crystal layer 82c is provided between the active matrix substrate 82a and the opposing substrate 82b. Is sandwiched.

The active matrix substrate 82a is provided with a pixel electrode 800, a data signal line 802, an optical sensor 804, an alignment film 806, a polarizing plate (polarizing filter) 808, a glass substrate 810, and the like. Further, the facing substrate 82b is provided with a color filter 812r (red), 812g (green), 812b (blue), a light shielding film 814, a counter electrode 816, an alignment film 806, a glass substrate 810, a polarizing plate 808, and the like.

In such a liquid crystal panel 82, when displaying an image, light is emitted from the backlight 84, and a voltage is applied between the pixel electrode 800 and the counter electrode 816. By applying a voltage, the orientation (liquid crystal orientation) of the liquid crystal molecules in the liquid crystal layer 82c is changed. Therefore, the overall transmittance of the liquid crystal layer 82c whose liquid crystal orientation has been changed and the two polarizing plates 808 is changed, and the brightness of the display is changed.

Further, in the liquid crystal panel 82, when scanning a document, the document is placed on the polarizing plate 818 of the active matrix substrate 82a, and light is emitted from the backlight 84. The light of the backlight 84 is reflected by the document on the polarizing plate 808, and the reflected light passes through the color filters 812r, 812g, 812b and is detected by the optical sensor 804. Therefore, the image of the original is read.

Further, in the liquid crystal panel 82, when the user touches the position (touch position), when the user touches the polarizing plate 808 with the fingertip or the like, the reflected image of the user's fingertip or the like is detected by the optical sensor 804. .. Specifically, as shown in FIG. 16, the light emitted from the backlight 84 is reflected by an object such as a user's finger. The reflected light reflected by the object is incident on the optical sensor 804. At this time, the level of the sensor output signal output from the optical sensor 804 fluctuates. When the level of the sensor output signal is equal to or higher than a predetermined value (threshold value), it is determined that the object exists. Then, the touch position is detected according to the position of the pixel in which the object is detected.

Further, the liquid crystal panel 82 can also detect the touch position by detecting the image with the optical sensor 804. The optical sensor 804 included in the liquid crystal panel 82 can also detect external light transmitted through the facing substrate 82b or the like. As shown in FIG. 17, when there is an object such as a user's finger, the incident of the external light is hindered, and the amount of the external light incident on the optical sensor 804 is reduced. Therefore, the level of the sensor output signal output from the optical sensor 804 fluctuates, and it is determined that the object exists.

The electrical configuration and detailed description of the liquid crystal display device 80 with a built-in optical sensor will be disclosed in Japanese Patent Application Laid-Open No. 2010-62940, which the applicant filed earlier and has already been published. I will omit it.

In the information processing system 10 of the second embodiment, the image forming apparatus 12 detects the line-of-sight direction of the person when the person approaches (approaches) the image forming apparatus 12 itself. Then, when the image forming apparatus 12 holds the print instruction and the print data of the person, the image forming apparatus 12 executes the print process for the print data and displays the preview image of the print data on the liquid crystal display device 80 with a built-in optical sensor. indicate. At this time, the preview image is rotated according to the line-of-sight direction of the person. In the second embodiment, the preview image is displayed in an orientation that is easy for a person to see. Specifically, as shown in FIG. 18 (B), it is parallel to the line-of-sight direction shown in FIG. 18 (A), and the upper part of the preview image is arranged on the tip (arrow tip) side in the line-of-sight direction. The bottom is placed on the rear end (arrowhead) side in the line-of-sight direction.

Therefore, in the second embodiment, as described above, the image forming apparatus 12 further includes an imaging apparatus 78 such as a digital camera. However, the image pickup apparatus 78 may be attached to the image forming apparatus 12 by using a predetermined interface such as a USB cable.

As can be seen from FIG. 18A, the image pickup apparatus 78 is arranged at the center of the front surface side of the image forming apparatus 12. Further, as shown in FIG. 14, the image pickup apparatus 78 is an upper portion of the image forming apparatus 12, and is provided at the center of the front end surface of the operation unit 76. However, the position where the image pickup apparatus 78 is provided is an example and should not be limited. As long as the face of a person approaching the image forming apparatus 12 can be photographed, it may be provided at another position.

It should be noted that a method of extracting a person's face image from a photographed image and detecting the person's line-of-sight direction from the face image is already known and is not an essential content of the present invention. ..

Further, since the image processing for rotating an image such as a preview image according to an arbitrary angle is already well known, the description of the method for rotating and displaying the preview image will be omitted.

According to the second embodiment, in addition to the effect of the first embodiment, the preview image of the print data is displayed toward the person approaching the image forming apparatus 12, so that the printed matter can be displayed by looking at the preview image. You can easily find out who it belongs to. Also, the preview image is easy to see. Therefore, the person can know who the printed matter belongs to by approaching the image forming apparatus 12 to a position slightly away from the image forming apparatus 12.

In the second embodiment, the line of sight of the person is detected, and the preview image is rotated and displayed so that the vertical direction coincides with the line of sight, but the present invention is not limited to this. Since not only the position of the person but also the moving direction of the person is detected, the preview image may be rotated and displayed so that the vertical direction coincides with the moving direction of the person. This is because when a person moves, it is considered that the line of sight is usually directed in the moving direction. Therefore, in such a case, it is not necessary to provide the image pickup device 78.
[Third Example]
The information processing system 10 of the third embodiment further includes a server 20, connects the floor sensor 14 to the server 20 instead of the image forming apparatus 12, and the CPU 20a of the server 20 controls the states shown in FIGS. 8 to 12. Since it is the same as that of the first embodiment except that the processing is executed, the duplicate description will be omitted.

FIG. 19 is an illustrated diagram showing an example of the configuration of the information processing system 10 of the third embodiment. As shown in FIG. 19, in the third embodiment, the information processing system 10 includes a server 20. The server 20 is a general-purpose server and includes circuit components such as a CPU 20a, a RAM 20b, and a communication unit 20c. Since the CPU 20a, the RAM 20b, and the communication unit 20c are the same as the CPU 50, the RAM 54, and the communication unit 58 included in the image forming apparatus 12, duplicate description will be omitted.

Further, the floor sensor 14 is connected to the server 20 instead of the image forming apparatus 12. Further, the server 20 is connected to the image forming apparatus 12, the cutting machine 18, and the plurality of user terminals 30 via the network 16. Further, the server 20 stores a person information table, an office equipment information table, and a status information table in the built-in HDD. However, instead of the HDD, these tables may be stored in a database connected directly to the server 20 or via the network 16.

In the third embodiment, the server 20 (CPU 20a) executes a process corresponding to the state control process (FIGS. 8 to 12) shown in the first embodiment. However, in the third embodiment, when a person approaches the image forming apparatus 12 and enters the range R2 set in the image forming apparatus 12, the CPU 20a of the server 20 is "YES" in step S25 or in step S37. “YES”), instructing the image forming apparatus 12 to set the state corresponding to the range R2 (step S27 or step S39).

Further, when a person approaches the image forming apparatus 12 and enters the range R1 set in the image forming apparatus 12, the CPU 20a of the server 20 informs the image forming apparatus 12 whether or not there is a print instruction from the person. Inquire (step S55). Then, the server 20 instructs the image forming apparatus 12 to start the printing process in response to the notification from the image forming apparatus 12 that there is a printing instruction (“YES” in step S55) (step S57).

In the third embodiment as well, the convenience can be improved as in the first embodiment. In addition, it is possible to execute a printing process in which security is ensured without separately performing personal authentication of the user.

The screens and specific numerical values given in each of the above embodiments are examples, and can be appropriately changed according to the actual product. Further, when the same effect is obtained, the order of each step shown in the flow chart may be changed as appropriate.

10 ... Information processing system 12 ... Image forming device 14 ... Floor sensor 18 ... Cutting machine 20 ... Server 30 ... User terminal 50 ... CPU
54 ... RAM
56 ... HDD
58 ... Communication unit 72 ... Touch panel 74 ... Main unit display 76 ... Operation unit 78 ... Imaging device 80 ... Liquid crystal display device with built-in optical sensor

Claims (9)

Receiving means for receiving print data from an external terminal,
A tracking means for tracking the position of a person with respect to the image forming apparatus itself at the place where the image forming apparatus itself is installed.
When a series of changes in the position of the person tracked by the tracking means indicate that the person is approaching the image forming apparatus itself, the image forming apparatus itself may have a positional relationship with the person. A state-determining means that determines the desired state ,
Setting means to set the state of the image forming apparatus itself to the state is to determined by the state determining means,
A print executing means that executes printing based on print data received by the receiving means when the setting means sets the printable state as the desired state and satisfies a predetermined condition, and a print executing means.
An image forming apparatus including a preview display means for displaying a preview image corresponding to the print data in response to printing based on the print data by the print execution means . Further provided with a direction detecting means for detecting the moving direction of the person based on a series of changes in the position of the person tracked by the tracking means.
Said preview display means, said direction detecting means vertically in the moving direction detected by displays the preview image so as to match the image forming apparatus according to claim 1. When a person tracked by the tracking means approaches the image forming apparatus itself, the line-of-sight direction detecting means for detecting the line-of-sight direction of the person is further provided.
It said preview display means, the sight line direction detecting unit vertically on the detected viewing direction by displays the preview image so as to match, according to claim 1 Symbol placing the image forming apparatus. Further equipped with a floor sensor provided in the environment in which the image forming apparatus itself is arranged,
The image forming apparatus according to any one of claims 1 to 3 , wherein the tracking means tracks the position of the person based on the output of the floor sensor. The image forming apparatus according to claim 4 , wherein the tracking means tracks the position of the person in the environment from an initial position based on the output of the floor sensor. The image forming apparatus according to claim 5 , wherein the initial position is a seat position of a person tracked by the tracking means. An information processing system including an image forming apparatus and a server communicatively connected to the image forming apparatus.
The server
A tracking means for tracking the position of a person with respect to the image forming apparatus at the place where the image forming apparatus is installed.
The image forming apparatus should be in accordance with the positional relationship with the person when a series of changes in the position of the person tracked by the tracking means indicate that the person is approaching the image forming apparatus. State-determining means for determining state,
The setting means for instructing the image forming apparatus to set the state of the image forming apparatus to the ideal state determined by the state determining means, and the setting means are set to a printable state as the desired state. , The image forming apparatus is provided with a printing instruction means for instructing the execution of printing when a predetermined condition is satisfied.
The image forming apparatus
Receiving means for receiving print data from an external terminal,
When the printing instruction means is instructed to execute printing, the print execution means that executes printing based on the print data received by the reception means, and the print execution means that executes printing based on the print data. An information processing system comprising a preview display means for displaying a preview image corresponding to the print data accordingly. An information processing program executed by a computer
To the processor of the computer
Receiving step to receive print data from an external terminal,
A tracking step that tracks the position of a person with respect to the office equipment at the location where the office equipment is installed.
When a series of changes in the position of the person tracked in the tracking step indicates that the person is approaching the office equipment, the ideal state of the office equipment is determined according to the positional relationship with the person. State determination step ,
A setting step that sets the state of the office equipment to the desired state determined in the state determination step,
A print execution step of setting a printable state as the desired state in the setting step and executing printing based on the print data received in the reception step when a predetermined condition is satisfied, and a print execution step.
An information processing program that executes a preview display step of displaying a preview image corresponding to the print data in response to executing printing based on the print data in the print execution step . (A) Step of receiving print data from an external terminal,
( B ) A step of tracking the position of a person with respect to the office equipment at the place where the office equipment is installed,
( C ) When a series of changes in the position of the person tracked in the step ( b ) indicate that the person is approaching the office equipment, the office equipment according to the positional relationship with the person. Steps to determine what should be ,
( D ) A step of setting the state of the office equipment to the desired state determined in the step ( c ),
(E) A step of setting a printable state as the desired state in the step (d) and executing printing based on the print data received in the step (a) when a predetermined condition is satisfied.
(F) An information processing method including a step of displaying a preview image corresponding to the print data in response to executing printing based on the print data in the step (e) .

Images