US11899991B2 - Printing system, information processing apparatus, and non-transitory computer readable medium for restricting image forming for speech input - Google Patents

Printing system, information processing apparatus, and non-transitory computer readable medium for restricting image forming for speech input Download PDF

Info

Publication number
US11899991B2
US11899991B2 US17/645,359 US202117645359A US11899991B2 US 11899991 B2 US11899991 B2 US 11899991B2 US 202117645359 A US202117645359 A US 202117645359A US 11899991 B2 US11899991 B2 US 11899991B2
Authority
US
United States
Prior art keywords
image forming
response
restriction
printing
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US17/645,359
Other languages
English (en)
Other versions
US20230030024A1 (en
Inventor
Ryoto YABUSAKI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Business Innovation Corp
Original Assignee
Fujifilm Business Innovation Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Business Innovation Corp filed Critical Fujifilm Business Innovation Corp
Assigned to FUJIFILM BUSINESS INNOVATION CORP. reassignment FUJIFILM BUSINESS INNOVATION CORP. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YABUSAKI, RYOTO
Publication of US20230030024A1 publication Critical patent/US20230030024A1/en
Application granted granted Critical
Publication of US11899991B2 publication Critical patent/US11899991B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12—Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201—Dedicated interfaces to print systems
    • G06F3/1202—Dedicated interfaces to print systems specifically adapted to achieve a particular effect
    • G06F3/121—Facilitating exception or error detection and recovery, e.g. fault, media or consumables depleted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12—Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201—Dedicated interfaces to print systems
    • G06F3/1202—Dedicated interfaces to print systems specifically adapted to achieve a particular effect
    • G06F3/1218—Reducing or saving of used resources, e.g. avoiding waste of consumables or improving usage of hardware resources
    • G06F3/1219—Reducing or saving of used resources, e.g. avoiding waste of consumables or improving usage of hardware resources with regard to consumables, e.g. ink, toner, paper
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12—Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201—Dedicated interfaces to print systems
    • G06F3/1223—Dedicated interfaces to print systems specifically adapted to use a particular technique
    • G06F3/1237—Print job management
    • G06F3/1239—Restricting the usage of resources, e.g. usage or user levels, credit limit, consumables, special fonts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12—Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201—Dedicated interfaces to print systems
    • G06F3/1223—Dedicated interfaces to print systems specifically adapted to use a particular technique
    • G06F3/1237—Print job management
    • G06F3/1267—Job repository, e.g. non-scheduled jobs, delay printing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12—Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201—Dedicated interfaces to print systems
    • G06F3/1278—Dedicated interfaces to print systems specifically adapted to adopt a particular infrastructure
    • G06F3/1285—Remote printer device, e.g. being remote from client or server
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12—Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201—Dedicated interfaces to print systems
    • G06F3/1278—Dedicated interfaces to print systems specifically adapted to adopt a particular infrastructure
    • G06F3/1285—Remote printer device, e.g. being remote from client or server
    • G06F3/1288—Remote printer device, e.g. being remote from client or server in client-server-printer device configuration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Definitions

  • the present disclosure relates to a printing system, an information processing apparatus, and a non-transitory computer readable medium.
  • Japanese Unexamined Patent Application Publication No. 2019-083497 discloses an image processing apparatus capable of executing different types of jobs.
  • the image processing apparatus includes a controller and a detection unit.
  • the controller performs control of the execution of an input job.
  • the detection unit detects the utterance of one of multiple predetermined target speeches on the basis of a speech detected by a sound detection unit. Time frames are set in advance by job type, and whether one of the target speeches is uttered in a predetermined time frame assigned to a job under execution is detected.
  • the controller stops the execution of the job.
  • Non-limiting embodiments of the present disclosure relate to preventing a waste of supplies compared with a case where an image forming instructions respectively given in response to speech input and input other than the speech input are processed in the same manner.
  • aspects of certain non-limiting embodiments of the present disclosure overcome the above disadvantages and/or other disadvantages not described above.
  • aspects of the non-limiting embodiments are not required to overcome the disadvantages described above, and aspects of the non-limiting embodiments of the present disclosure may not overcome any of the disadvantages described above.
  • a printing system including: a receiving unit that receives a first instruction given in response to speech input by a user and a second instruction given in response to input other than the speech input by the user, the first instruction and the second instruction each serving as an image forming instruction to form a processed image on a recording medium; a restriction unit that performs restriction of image forming in which the image is to be formed on the recording medium, the restriction being performed in response to the receiving unit receiving the first instruction; and a storage unit that stores the image subjected to the restriction of the image forming on the recording medium, the restriction being performed by the restriction unit.
  • FIG. 1 is a diagram illustrating an example overall configuration of a printing system in this exemplary embodiment
  • FIG. 2 is a diagram illustrating an example hardware configuration of a smart speaker in this exemplary embodiment
  • FIG. 3 is a diagram illustrating an example hardware configuration of a server in this exemplary embodiment
  • FIG. 4 is a diagram illustrating an example hardware configuration of a printer in this exemplary embodiment
  • FIG. 5 is a diagram for explaining example outline operations performed by the printing system in response to a printing request from a personal computer (PC);
  • PC personal computer
  • FIGS. 6 A and 6 B each illustrate first example outline operations performed by the printing system in response to a printing request from a corresponding one of the PC and the smart speaker;
  • FIGS. 7 A and 7 B each illustrate second example outline operations performed by the printing system in response to a printing request from the smart speaker to discharge a corresponding one of cases where a printed material has 12 sheets and where a printed material has three sheets;
  • FIG. 8 illustrates third example outline operations performed by the printing system in response to a printing request from the smart speaker
  • FIG. 9 is a block diagram illustrating an example functional configuration of the server or the printer in this exemplary embodiment.
  • FIG. 10 is a flowchart illustrating first example operations of the server or the printer in this exemplary embodiment
  • FIG. 11 is a flowchart illustrating second example operations of the server or the printer in this exemplary embodiment
  • FIG. 12 is a flowchart illustrating a modification of the second example operations of the server or the printer in this exemplary embodiment
  • FIG. 13 is a flowchart illustrating third example operations of the server or the printer in this exemplary embodiment.
  • FIG. 14 is a flowchart illustrating fourth example operations of the server or the printer in this exemplary embodiment.
  • a printing system that receives a first instruction given in response to speech input by a user and a second instruction given in response to input other than the speech input by the user.
  • the first instruction and the second instruction each serve as an image forming instruction to form a processed image on a recording medium.
  • the printing system performs restriction of the image forming on the recording medium and stores the image subjected to the restriction of the image forming.
  • any of the smart speaker and the printer may serve as an information processing apparatus.
  • a server as a relay between the smart speaker and the printer is provided and taken as an example of the information processing apparatus.
  • FIG. 1 is a diagram illustrating an example overall configuration of a printing system 1 in this exemplary embodiment.
  • the printing system 1 includes a smart speaker 10 , a server 20 , and a printer 40 that are connected to a communication network 80 .
  • a smart speaker 10 one server 20 , and one printer 40 are illustrated in FIG. 1 , two or more smart speakers 10 , two or more servers 20 , and two or more printers 40 may be provided.
  • the printing system 1 is an example of the printing system
  • the smart speaker 10 is an example of the apparatus that gives the first instruction
  • the printer 40 is an example of an image forming apparatus.
  • the smart speaker 10 is a speaker with a speech assistant function that is capable of vocally answering a speech from the user after acquiring various pieces of information via the communication network 80 and also capable of controlling the operations of various devices.
  • the smart speaker 10 is also called an AI speaker.
  • the smart speaker 10 in response to the user making a printing request vocally, the smart speaker 10 performs speech recognition of the printing request, generates request information on the basis of the result of the speech recognition, and transmits the request information to the server 20 .
  • the server 20 executes various processes on the basis of the information transmitted from the smart speaker 10 .
  • the server 20 receives request information requesting printing from the smart speaker 10 and transmits a printing instruction based on the request information to the printer 40 .
  • the server 20 is provided as an example of the information processing apparatus.
  • the printer 40 prints an image on the recording medium such as a paper sheet.
  • the printer 40 prints an image on the recording medium on the basis of the printing instruction transmitted from the server 20 .
  • the smart speaker 10 is a device outside the printer 40 in the configuration in this exemplary embodiment; however, the configuration of the present disclosure is not limited to this. A configuration in which the smart speaker 10 is a device inside the printer 40 may be used.
  • the communication network 80 is a network used for information communications between the smart speaker 10 and the server 20 and between the server 20 and the printer 40 .
  • the Internet may be used as the communication network 80 .
  • FIG. 2 is a diagram illustrating an example hardware configuration of the smart speaker 10 in this exemplary embodiment.
  • the smart speaker 10 includes a processor 11 , a random access memory (RAM) 12 , a read only memory (ROM) 13 , a communication interface (hereinafter, expressed as a communication I/F) 14 , a speaker 15 , and a microphone 16 .
  • RAM random access memory
  • ROM read only memory
  • I/F communication interface
  • the processor 11 implements a process for inputting and outputting a speech by loading an appropriate one of various programs stored in the ROM 13 or the like into the RAM 12 and by running the program. Examples of the process include a process for generating speech data for outputting a speech from the speaker 15 and a process for performing speech recognition of a printing request speech collected through the microphone 16 and converting the speech to request information.
  • the RAM 12 is a memory used as the work memory or the like of the processor 11 .
  • the ROM 13 is a memory storing the various programs and the like to be run by the processor 11 .
  • the communication I/F 14 transmits and receives various pieces of information to and from the server 20 via the communication network 80 .
  • the speaker 15 outputs the speech based on the speech data generated by the processor 11 to the outside.
  • the microphone 16 collects a speech given outside the microphone 16 .
  • FIG. 3 is a diagram illustrating an example hardware configuration of the server 20 in this exemplary embodiment.
  • the server 20 includes a processor 21 , a RAM 22 , a hard disk drive (HDD) 23 , a communication I/F 24 , a display device 25 , and an input device 26 .
  • a processor 21 the server 20 includes a processor 21 , a RAM 22 , a hard disk drive (HDD) 23 , a communication I/F 24 , a display device 25 , and an input device 26 .
  • HDD hard disk drive
  • the processor 21 runs various pieces of software such as the operating system (OS) and applications to implement functions (described later).
  • OS operating system
  • applications to implement functions (described later).
  • the RAM 22 is a memory used as the work memory or the like of the processor 21 .
  • the HDD 23 is, for example, a magnetic disk device storing input data for various pieces of software, output data from the various pieces of software, and the like.
  • the communication I/F 24 transmits and receives various pieces of information to and from the smart speaker 10 and the printer 40 via the communication network 80 .
  • the display device 25 is, for example, a display that displays various pieces of information.
  • the input device 26 is, for example, a keyboard or a mouse used to input information by the user.
  • FIG. 4 is a diagram illustrating an example hardware configuration of the printer 40 in this exemplary embodiment.
  • the printer 40 includes a processor 41 , a RAM 42 , a ROM 43 , a HDD 44 , an operation panel 45 , a printing unit 46 , and a communication I/F 47 .
  • the processor 41 implements a process for printing in the printing unit 46 by loading appropriate one of various programs stored in the ROM 43 or the like into the RAM 42 and by running the program.
  • the RAM 42 is a memory used as the work memory or the like of the processor 41 .
  • the ROM 43 is a memory storing the various programs and the like to be run by the processor 41 .
  • the HDD 44 is, for example, a magnetic disk device storing print data used for printing by the printing unit 46 and the like.
  • the operation panel 45 is, for example, a touch panel that displays various pieces of information and receives an input operation from the user.
  • the operation panel 45 is a user interface (UI) device.
  • the operation panel 45 is composed of a display on which various pieces of information are displayed and a location detection sheet on which a location instructed with an instruction instrument such as a finger or a stylus pen. Alternatively, a display and a keyboard may be used in place of the touch panel.
  • the printing unit 46 prints an image on the recording medium such as a paper sheet.
  • the printing unit 46 is, for example, a printer, and an electrophotographic system or an inkjet system may be used.
  • an image is formed by transferring toner adhered to a photoconductor onto the recording medium.
  • an image is formed by discharging ink onto the recording medium.
  • the communication I/F 47 transmits and receives various pieces of information to and from the server 20 via the communication network 80 .
  • FIGS. 5 to 8 are each a diagram for explaining example outline operations in this exemplary embodiment. These figures illustrate a PC 30 and a document storage 50 that are omitted in FIG. 1 and a page analyzer 60 assumed to be included in the server 20 and thus not illustrated in FIG. 1 on occasions.
  • FIG. 5 illustrates example outline operations performed by the printing system 1 in response to a printing request from the PC 30 .
  • the apparatus is not limited to this.
  • the operation panel 45 included in the printer 40 or a mobile information terminal (not illustrated) may be used.
  • the printing request is an example of an image forming instruction to form a processed image on the recording medium and may also be referred to as a printing instruction.
  • the PC 30 transmits a printing request to the server 20 (step S 101 ).
  • the server 20 acquires document data D describing the recipe for pork and cabbage sauteed with spicy miso from the document storage 50 (step S 102 ) and requests the page analyzer 60 to analyze the pages of the document data D (step S 103 ).
  • the page analyzer 60 generates a page analysis result R from the document data D, and the server 20 then acquires the page analysis result R (step S 104 ) and transmits a printing instruction regarding the document data D to the printer 40 on the basis of the page analysis result R (step S 105 ).
  • the page analysis result R indicates that the ingredients are on the first and second pages, and thus the printer 40 prints a printed material P corresponding to the first and second pages of the document data D in accordance with the printing request.
  • the server 20 thereafter transmits a printing result response to the PC 30 (step S 106 ), and the PC 30 notifies the user U of printing completion by using an indicator.
  • the series of steps until printing is started.
  • the series of steps is started like the case of the printing request from the PC 30 . If the smart speaker 10 transmits the printing request in response to a speech of the user U, and the occurrence of a speech given by mistake by the user U or wrongly performed speech recognition causes the execution of printing not intended by the user U, thus resulting in a waste of supplies. The occurrence is assumed to cause the user U to refrain from using a printing service, and thus it becomes difficult to promote the use of the printing system 1 .
  • FIGS. 6 A and 6 B each illustrate first example outline operations performed by the printing system 1 in response to a printing request from a corresponding one of the PC 30 and the smart speaker 10 .
  • FIG. 6 A corresponds to FIG. 5 but is simplified for convenience of explanation.
  • FIG. 6 B is also simplified like FIG. 6 A . The same holds true for FIGS. 7 A, 7 B, and 8 (described later).
  • FIG. 6 B when speaking to the smart speaker 10 , the user U typically utters a phrase to start using the speech assistant function of the smart speaker 10 ; however, the utterance is not illustrated in FIG. 6 B .
  • FIGS. 7 A, 7 B, and 8 described later.
  • FIGS. 6 A and 6 B do not illustrate the server 20 but include communications directly performed between the printer 40 and the PC 30 and between the printer 40 and the smart speaker 10 and communications performed between the printer 40 and the PC 30 and between the printer 40 and the smart speaker 10 via the server 20 .
  • the printer 40 performs processing
  • the server 20 may perform the processing. The same holds true for FIGS. 7 A, 7 B, and 8 (described later).
  • the printer 40 receives the document data D appropriate for the printing request (see FIG. 5 ), forms an image represented by the document data D on the recording medium in receiving order, and discharges a printed material P (step S 112 ).
  • the smart speaker 10 in response to the user U giving a speech V 21 “Print the page for ingredients for the recipe for pork and cabbage sauteed with spicy miso”, the smart speaker 10 produces a speech V 22 “Accepted. The print data will be accumulated in the printer”.
  • the smart speaker 10 then transmits a printing request according to the user U's speech input (step S 121 ).
  • the printer 40 receives the document data D appropriate for the printing request (see FIG. 5 ) and accumulates the received document data D in the HDD 44 (step S 122 ). Specifically, if the smart speaker 10 transmits the printing request, simply receiving the printing request does not cause the printed material P to be discharged, unlike the case of the printing request from the PC 30 .
  • the smart speaker 10 produces a speech V 23 “To discharge the printed material, operate the printer”.
  • the printer 40 prints, on the recording medium, the image represented by the document data D accumulated in the HDD 44 (step S 123 ) and discharges the printed material P (step S 124 ).
  • the printing request is transmitted from the PC 30 in response to the input other than the user U's speech input, the image represented by the document data D appropriate for the printing request is printed immediately, and the printed material P is discharged.
  • the printing request is transmitted from the smart speaker 10 in response to the user U's speech input, the document data D is accumulated in the printer 40 , and waiting for a printed-material discharge request is performed.
  • the accumulated document data D is printed, and the printed material P is discharged.
  • a printed-material discharge request made through, for example, operation of the PC 30 other than the user U's speech is required in addition to the printing request triggered by the user U's speech.
  • the printing request from the smart speaker 10 transmitted in response to the user U's speech input is an example of a first instruction
  • the printing request from the PC 30 transmitted in response to the input other than the user U's speech input is an example of a second instruction.
  • the printed-material discharge request is transmitted from the operation panel 45 in this exemplary embodiment; however, the disclosure is not limited to this. Any device that transmits a printed-material discharge request in response to input other than the speech input may be used, and, for example, the PC 30 , a mobile information terminal (not illustrated), or the like may be used. In other words, the printed-material discharge request referred to here may be a request to print accumulated data.
  • the server 20 acquires the document data D from the document storage 50 and transmits the document data D to the printer 40 in this exemplary embodiment; however, the disclosure is not limited to this.
  • the smart speaker 10 may acquire the document data D from the document storage 50 and transmit the acquired document data D to the printer 40 together with the printing request.
  • the printed-material discharge request is transmitted to confirm the intention with the user U and is useful from the viewpoint of preventing a waste of supplies.
  • the user U is required to operate an apparatus other than the smart speaker 10 again, and it is difficult to promote the use of the printing system 1 from the viewpoint of user-friendliness. Nevertheless, a probability that a speech given by mistake or wrongly performed speech recognition of concern occurs two times in succession is considered to be not high.
  • a configuration for accepting the printed-material discharge request from the smart speaker 10 may be used to promote the use of the printing system 1 .
  • the configuration for accepting the printed-material discharge request from the smart speaker 10 is used, the intention of the user U is vocally confirmed.
  • FIGS. 7 A and 7 B each illustrate second example outline operations performed by the printing system 1 in response to a printing request from the smart speaker 10 to discharge a corresponding one of cases where the printed material P has 12 sheets and where the printed material P has three sheets.
  • steps are the same as those in FIG. 6 A described above, and thus description thereof is omitted.
  • a threshold for the sheet count of a printed material is predetermined. If the printed-material sheet count according to the printing request from the smart speaker 10 is lower than the threshold, the printing is performed immediately. In contrast, if the printed-material sheet count is higher than or equal to the threshold, the printing is not performed immediately, and document data D is accumulated in the HDD 44 .
  • the threshold in the second example outline operations is five sheets.
  • the smart speaker 10 transmits a printing request according to the user U's speech input (step S 131 ).
  • the printer 40 acquires document data D appropriate for the printing request (see FIG. 5 ) and verifies a sheet count in the printing (step S 132 ). That is, the printer 40 verifies that the sheet count is 12 and is not lower than the threshold of five sheets. In this case, the printer 40 does not perform the printing immediately and accumulates the document data D (see FIG. 5 ) in the HDD 44 (step S 133 ).
  • the smart speaker 10 In response to the notification of the accumulation of the document data D from the printer 40 , the smart speaker 10 produces a speech V 32 “The print data has been accumulated in the printer. To discharge the printed material, operate the printer”.
  • the accumulated document data D is printed on the recording medium (step S 134 ), and the printed material P is discharged (step S 135 ).
  • step S 141 After the smart speaker 10 transmits the printing request (step S 141 ) in response to a speech V 41 by the user U “Print the next year calendar from January to March”, the printer 40 verifies that the sheet count is three and lower than the threshold of five sheets (step S 142 ), performs the printing immediately without accumulation, and discharges the printed material P (step S 143 ).
  • the smart speaker 10 In response to receiving the notification of the discharge of the printed material P from the printer 40 , the smart speaker 10 produces a speech V 42 “Printed” and thus notifies the user U to that effect.
  • the sheet count of the recording medium according to the printing request is compared with the predetermined threshold. If the sheet count is higher than or equal to the threshold, document data is accumulated without performing the immediate printing, and waiting for a printed-material discharge request is performed (see FIG. 7 A). In contrast, if the sheet count is lower than the threshold, the printing is performed immediately without the accumulation (see FIG. 7 B ). User-friendliness may thereby be improved, and the use of the printing system 1 may be promoted.
  • the printing request may result in printing involved with a smaller sheet count of the printed material P.
  • the immediate printing having a small influence of unnecessary printing may thereby be performed, while the immediate printing having a relatively large influence of the unnecessary printing is reduced. A waste amount of supplies may thereby be reduced.
  • the threshold may be set to allow the user to change the threshold freely.
  • one sheet may be set as the threshold to naturally cause the accumulation, like the first example outline operations.
  • a threshold having a value considerably larger than a typical printed sheet count, for example, 100 sheets may be set as the threshold to naturally cause the immediate printing. Causing the user to decide the threshold may lead to improvement in the user-friendliness to the user.
  • the printed-material sheet count is used for the threshold in the second example outline operations; however, the disclosure is not limited to this, and a page count may be used for the threshold. Whether the sheet count or the page count is used for the threshold depends on whether to perform the immediate printing in duplex printing. Accordingly, if the sheet count is used for the threshold, the smart speaker 10 may inquire of the user U whether to perform duplex printing or the like.
  • the printer 40 makes a comparison with the threshold; however, the disclosure is not limited to this, and the server 20 may make the comparison.
  • FIG. 8 illustrates third example outline operations performed by the printing system 1 in response to a printing request from the smart speaker 10 .
  • steps are the same as those in FIG. 6 A described above, and thus description thereof is omitted.
  • a threshold for the sheet count of a printed material is predetermined. If the printed-material sheet count according to the printing request from the smart speaker 10 is lower than a first threshold, printing is performed immediately. In contrast, if the printed-material sheet count is higher than or equal to the first threshold and is lower than a second threshold, whether to perform the printing immediately is inquired of the user U. If the printed-material sheet count is higher than or equal to the second threshold, document data D is accumulated in the HDD 44 without inquiring of the user U.
  • the following description is provided on the assumption that the first threshold in the third example outline operations is lower than the second threshold and is five sheets and that the second threshold is ten sheets.
  • the smart speaker 10 transmits a printing request according to the user U's speech input (step S 151 ).
  • the printer 40 verifies the printed-material sheet count according to the printing request (step S 152 ).
  • the printer 40 After verifying that the sheet count is nine, that is, the sheet count is not lower than the first threshold, is higher than the first threshold, and is lower than the second threshold, the printer 40 notifies the user U of the printed-material sheet count and thereby inquires whether to perform printing immediately (step S 153 ).
  • the inquiry to the user U is made by directing the inquiry to a notification destination, for example, a mail address acquired from user information included in the printing request from the smart speaker 10 ; however, the inquiry may be made by using the smart speaker 10 .
  • the printer 40 After the user U makes a discharge request in response to the inquiry mail (step S 154 ), the printer 40 performs the printing on the recording medium and discharges the printed material P (step S 155 ). Thereafter, the smart speaker 10 produces a speech V 52 “Printed” and thus notifies the user U to that effect.
  • the printed-material discharge request may be transmitted not only by replying to the inquiry mail but also by answering the inquiry in such a manner that the user U selects one of items “Execute printing” and “Cancel printing” in the body of the inquiry mail.
  • a report indicating the completion of the printing may be transmitted to the mail address of the inquiry mail.
  • the steps in which the printing is performed immediately in response to the sheet count lower than the first threshold and the steps in which the accumulation is performed in response to the sheet count higher than or equal to the second threshold are the same as those in the second example outline operations described above (see FIG. 7 A for printing the accumulated data and FIG. 7 B for the immediate printing), and thus description thereof is omitted.
  • FIG. 9 is a block diagram illustrating an example functional configuration of the server 20 or the printer 40 in this exemplary embodiment. Any one of the server 20 and the printer 40 may have the following example functional configuration.
  • each of the server 20 and the printer 40 includes a transmission/reception unit 51 , a determination unit 52 , an accumulation unit 53 , a printing start controller 54 , and a notification unit 55 .
  • the transmission/reception unit 51 receives information such as the printing request from the smart speaker 10 and the document data D and also transmits the information to the smart speaker 10 .
  • the transmission/reception unit 51 receives information such as the document data D and the printing request from the PC 30 and also transmits the information to the PC 30 .
  • the transmission/reception unit 51 transmits and receives the information to and from the printer 40 . If the printer 40 includes the transmission/reception unit 51 , the transmission/reception unit 51 transmits and receives the information to and from the server 20 .
  • the transmission/reception unit 51 is an example of a receiving unit.
  • the determination unit 52 determines whether the printing request received by the transmission/reception unit 51 has been transmitted from the smart speaker 10 or the PC 30 . It is conceivable that the determination is performed in the following manners. The determination is performed on the basis of information included in the printing request and indicating that the printing request is transmitted from the smart speaker 10 (or information indicating that the printing request is not transmitted from the smart speaker 10 ). If the information is not included in the printing request, the printer 40 identifies the transmission source of the printing request.
  • the determination unit 52 also performs the determination by using information regarding a printed-material sheet count according to the printing request, that is, by using the document data D appropriate for the printing request.
  • the determination unit 52 performs the determination by using printing settings information indicating, for example, monochrome printing.
  • printing settings information indicating, for example, monochrome printing.
  • the printing unit 46 of the printer 40 has the printing settings information.
  • the determination unit 52 acquires the printing settings information from the printing unit 46 to perform the determination.
  • the determination unit 52 is an example of a restriction unit.
  • the accumulation unit 53 accumulates the document data D appropriate for the printing request when the document data D is not printed immediately.
  • the document data D accumulated by the accumulation unit 53 may be image data resulting from document rasterization or may be document data before the rasterization.
  • the accumulation unit 53 is the HDD 44 of the printer 40 (see FIG. 4 ). If the server 20 includes the accumulation unit 53 , the accumulation unit 53 is the HDD 23 or the like of the server 20 (see FIG. 3 ).
  • the accumulation unit 53 is an example of a storage unit.
  • the printing start controller 54 performs control as to whether to perform printing immediately in response to the transmission/reception unit 51 receiving the document data D appropriate for the printing request or to temporarily accumulate the document data D in the accumulation unit 53 and then perform printing in response to a printed-material discharge request. If the server 20 includes the printing start controller 54 , the printing start controller 54 instructs the printer 40 to start the printing. If the printer 40 includes the printing start controller 54 , the printing start controller 54 instructs the printing unit 46 (see FIG. 4 ) to start the printing.
  • the notification unit 55 notifies the user U of the inquiry mail described above notifying the printed-material sheet count according to the printing request and inquiring whether to perform the printing immediately.
  • the transmission/reception unit 51 receives a reply from the user U to the inquiry mail.
  • the notification unit 55 stores a table having the user information and a destination that are connected with each other, the address or the notification destination of the inquiry mail from the notification unit 55 is identified by using the table.
  • the notification unit 55 may also inquire of the user U by using the smart speaker 10 .
  • the smart speaker 10 in this case is an example of an apparatus that transmits the first instruction.
  • FIGS. 10 to 14 are flowcharts for explaining first to fourth example operations of this exemplary embodiment, and some of the figures also correspond to the foregoing example outline operations (see FIGS. 6 A to 8 ).
  • FIGS. 10 to 14 include mutually common steps, and thus description thereof is omitted on occasions.
  • FIG. 10 is a flowchart illustrating the first example operations of the server 20 or the printer 40 in this exemplary embodiment, and some of the steps therein correspond to those in the foregoing first example outline operations (see FIG. 6 ).
  • the transmission/reception unit 51 receives a printing request (step S 201 )
  • the determination unit 52 determines whether the printing request is transmitted from the smart speaker 10 or the PC 30 (step S 202 ).
  • the printing start controller 54 instructs the printing unit 46 of the printer 40 to start printing.
  • the printing start instruction is given for document data D that is received by the transmission/reception unit 51 and that is considered to be appropriate for the printing request.
  • the printing unit 46 of the printer 40 prints the document data D on the recording medium in accordance with the printing start instruction (step S 203 ) and discharges a printed material P (step S 204 ). Specifically, the printing is performed immediately. The process is thereby terminated.
  • the accumulation unit 53 (see FIG. 9 ) accumulates the document data D received by the transmission/reception unit 51 (step S 205 ). Specifically, the document data D is not printed immediately and is temporarily accumulated in the accumulation unit 53 .
  • the transmission/reception unit 51 determines whether the discharging of the printed material P is requested from the user U (step S 206 ).
  • step S 203 the printing start controller 54 instructs the printing unit 46 of the printer 40 to start printing of the accumulated data.
  • the printing unit 46 prints the accumulated data on the recording medium (step S 203 ) and discharges the printed material P (step S 204 ).
  • the printing unit 46 performs the printing in response to the discharge request after the accumulation, and then the process is terminated.
  • Wait time may be predetermined, and after the elapse of the predetermined time, the printing start controller 54 may perform a cancellation process for cancelling the printing request. If the cancellation process is executed, the smart speaker 10 notifies to that effect.
  • FIG. 11 is a flowchart illustrating the second example operations of the server 20 or the printer 40 in this exemplary embodiment and corresponds to the foregoing second example outline operations (see FIG. 7 ). Since steps S 301 to S 304 , S 307 , and S 308 are respectively common to steps S 201 to S 206 (see FIG. 10 ) in the first example operations, and thus description thereof is omitted on occasions.
  • the determination unit 52 acquires the sheet count of the printed material P in printing the document data D appropriate for the printing request on the recording medium and also acquires the predetermined threshold (step S 305 ).
  • the determination unit 52 acquires the sheet count by checking the document data D by itself. Alternatively, if the sheet count is added to the document data D, the determination unit 52 acquires the sheet count from the added information in the document data D.
  • the threshold referred to here is an example of a threshold included in a predetermined condition
  • the sheet count referred to here is an example of a sheet count of a recording medium in image forming on the recording medium.
  • the determination unit 52 makes a comparison between the sheet count and the threshold that are acquired and determines whether the sheet count is lower than the threshold (step S 306 ). If the sheet count is lower than the threshold (Yes in step S 306 ), the process proceeds to step S 303 .
  • the document data D is printed on the recording medium (step S 303 ), and the printed material P is discharged (step S 304 ).
  • step S 306 If the sheet count is not lower than the threshold (No in step S 306 ), the process proceeds to step S 307 . Specifically, the document data D is accumulated (step S 307 ). Waiting is performed until the discharge of the printed material P is requested from the user U (No in step S 308 ). In response to the discharge request (Yes in step S 308 ), the process proceeds to step S 303 . The accumulated data is printed on the recording medium (step S 303 ), and the printed material P is discharged (step S 304 ).
  • the case where the sheet count is lower than the threshold (Yes in step S 306 ) is an example of satisfaction of the predetermined condition.
  • the printing is performed immediately.
  • this is not user-friendly to a user U who often performs large-volume printing having a high printed-material sheet count through a printing request from the smart speaker 10 .
  • the printing request is regarded as a printing request involved with a high printed-material sheet count, and the document data D is accumulated every printing request without performing the immediate printing.
  • the printing is not performed unless the user U performs an additional operation for a printed-material discharge request every time.
  • the printing may be performed immediately if the sheet count is higher than or equal to the threshold.
  • FIG. 12 is a flowchart illustrating a modification of the second example operations of the server 20 or the printer 40 in this exemplary embodiment.
  • FIG. 12 illustrates steps common to those in the second example operations illustrated in FIG. 11 , and thus the description thereof is omitted on occasions. To clearly discriminate the steps in FIG. 12 from the second example operations illustrated in FIG. 11 , FIG. 12 has step numbers in FIG. 11 each followed by “a”.
  • the determination unit 52 makes a comparison between the sheet count and the threshold that are acquired and determines whether the sheet count is higher than or equal to the threshold (step S 306 a ). If the sheet count is higher than or equal to the threshold (Yes in step S 306 a ), the process proceeds to step S 303 a .
  • the document data D is printed on the recording medium (step S 303 a ), and the printed material P is discharged (step S 304 a ).
  • step S 307 a If the sheet count is lower than the threshold (No in step S 306 a ), the process proceeds to step S 307 a . Specifically, the document data D is accumulated (step S 307 a ). Waiting is performed until the discharge of the printed material P is requested from the user U (No in step S 308 a ). In response to the discharge request (Yes in step S 308 a ), the process proceeds to step S 303 a . The accumulated data is printed on the recording medium (step S 303 a ), and the printed material P is discharged (step S 304 a ).
  • the case where the sheet count is higher than or equal to the threshold (Yes in step S 306 a ) is an example of the satisfaction of the predetermined condition.
  • a conceivable way of preventing a waste of the supplies caused by the execution of large-volume printing not intended by the user U is, for example, adding another condition for performing the immediate printing.
  • printing settings information used in the fourth example operations is used as the condition. Specifically, control is performed to allow large-volume printing in the case of monochrome printing. Control in which the smart speaker 10 inquires of the user U by notifying the user U of the sheet count of a printed material may also be used.
  • FIG. 13 is a flowchart illustrating the third example operations of the server 20 or the printer 40 in this exemplary embodiment and corresponds to the foregoing third example outline operations (see FIG. 8 ). Since steps S 401 to S 404 , S 408 , and S 409 are respectively common to steps S 201 to S 206 (see FIG. 10 ) in the first example operations, and thus description thereof is omitted on occasions.
  • the determination unit 52 acquires a printed-material sheet count according to the printing request, a predetermined first threshold, and a predetermined second threshold (step S 405 ).
  • the first threshold has a value lower than that of the second threshold.
  • the first threshold and the second threshold referred to here are respective examples of a first threshold and a second threshold.
  • the determination unit 52 determines whether the acquired sheet count is: lower than the first threshold; higher than or equal to the first threshold and also lower than the second threshold; or higher than or equal to the second threshold. A step based on the determination result is then performed. Specifically, the determination unit 52 makes a comparison between the sheet count and the first threshold that are acquired and determines whether the sheet count is lower than the first threshold (step S 406 ). If the sheet count is lower than the first threshold (Yes in step S 406 ), the printing is performed immediately (steps S 403 and S 404 ).
  • the determination unit 52 determines whether the sheet count is lower than the second threshold (step S 407 ).
  • step S 407 If the sheet count is higher than or equal to the second threshold (No in step S 407 ), the document data D is temporarily stored in the accumulation unit 53 without being printed immediately, and waiting for a discharge request is performed (steps S 408 and S 409 ).
  • the notification unit 55 notifies the user U of the printed-material sheet count and inquiries whether to execute or cancel the printing (step S 410 ).
  • the inquiry referred to here is an example of inquiring of the user whether to allow image forming on the recording medium without performing the restriction.
  • the printed-material sheet count referred to here is an example of information regarding the sheet count of the recording medium in the image forming on the recording medium.
  • the inquiry may be made by using the inquiry mail or the smart speaker 10 .
  • the transmission/reception unit 51 determines whether a printing cancellation reply is received from the user U as a reply to the inquiry (step S 411 ). If a printing cancellation reply is received (Yes in step S 411 ), print data, that is, the document data D is deleted (step S 412 ), and then the process is terminated.
  • step S 411 If a printing cancellation reply is not received (No in step S 411 ), that is, if a printing execution reply is received, the printing is performed immediately (steps S 403 and S 404 ).
  • FIG. 14 is a flowchart illustrating fourth example operations of the server 20 or the printer 40 in this exemplary embodiment.
  • a process is executed by using printing settings information. Since steps S 501 to S 504 , S 507 , and S 508 are respectively common to steps S 201 to S 206 (see FIG. 10 ) in the first example operations, and thus description thereof is omitted on occasions.
  • the printing settings information is settings information to be used when the printing unit 46 performs printing.
  • the printing settings information is information indicating whether the printing is monochrome printing or color printing.
  • the information indicating whether the printing is monochrome printing or color printing referred to here is an example of an image forming setting for the image forming on the recording medium.
  • the determination unit 52 determines whether the printing is monochrome printing (step S 506 ). If the printing is monochrome printing (Yes in step S 506 ), the printing is performed immediately (steps S 503 and S 504 ). If the printing is not monochrome printing (No in step S 506 ), the printing is not performed immediately, the document data D is temporarily accumulated in the accumulation unit 53 , and waiting for a discharge request is performed (steps S 507 and S 508 ).
  • the immediate printing in the monochrome printing in which the supplies are less consumed than in color printing is performed regardless of the printed-material sheet count.
  • An influence of a consumption amount in unnecessary printing may thereby be reduced, and user-friendliness may also be improved.
  • the monochrome printing (Yes in step S 506 ) is an example of the satisfaction of the predetermined condition.
  • the settings information indicating whether the printing is monochrome printing or color printing is used as the printing settings information; however, the disclosure is not limited to this.
  • settings information indicating whether printing is duplex printing, the count of a printed document page per recording medium page, or the like may be set.
  • processor refers to hardware in a broad sense.
  • Examples of the processor include general processors (e.g., CPU: Central Processing Unit) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, and programmable logic device).
  • processor is broad enough to encompass one processor or plural processors in collaboration which are located physically apart from each other but may work cooperatively.
  • the order of operations of the processor is not limited to one described in the embodiments above, and may be changed.
  • the processes executed by the server 20 in this exemplary embodiment are provided as a program such as application software.
  • the program implementing this exemplary embodiment is regarded as a program causing a computer to execute a process including: receiving a first instruction given in response to speech input by a user and a second instruction given in response to input other than the speech input by the user, the first instruction and the second instruction each serving as an image forming instruction to form a processed image on a recording medium; performing restriction of image forming in which the image is to be formed on the recording medium, the restriction being performed in response to receiving the first instruction in the receiving; and storing the image subjected to the restriction of the image forming on the recording medium, the restriction being performed in the performing of the restriction.
  • the program implementing this exemplary embodiment may be provided not only through a communication medium but also in such a manner as to be stored in a recording medium such as a compact disc (CD)-ROM.
  • a recording medium such as a compact disc (CD)-ROM.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • General Health & Medical Sciences (AREA)
  • Accessory Devices And Overall Control Thereof (AREA)
  • Facsimiles In General (AREA)
  • User Interface Of Digital Computer (AREA)
US17/645,359 2021-07-28 2021-12-21 Printing system, information processing apparatus, and non-transitory computer readable medium for restricting image forming for speech input Active US11899991B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021123753A JP2023019219A (ja) 2021-07-28 2021-07-28 印刷システム、情報処理装置及びプログラム
JP2021-123753 2021-07-28

Publications (2)

Publication Number Publication Date
US20230030024A1 US20230030024A1 (en) 2023-02-02
US11899991B2 true US11899991B2 (en) 2024-02-13

Family

ID=85039069

Family Applications (1)

Application Number Title Priority Date Filing Date
US17/645,359 Active US11899991B2 (en) 2021-07-28 2021-12-21 Printing system, information processing apparatus, and non-transitory computer readable medium for restricting image forming for speech input

Country Status (2)

Country Link
US (1) US11899991B2 (ja)
JP (1) JP2023019219A (ja)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024113934A (ja) 2023-02-10 2024-08-23 日本電気株式会社 監視システム、監視装置及び監視方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160037009A1 (en) * 2014-08-04 2016-02-04 Canon Kabushiki Kaisha Job processing apparatus, method for controlling job processing apparatus, and storage medium
JP2019083497A (ja) 2017-11-01 2019-05-30 コニカミノルタ株式会社 画像処理装置およびその動作制御方法
US20200249883A1 (en) * 2019-02-04 2020-08-06 Konica Minolta, Inc. Image forming apparatus, image forming system, and information processing method
US20210092243A1 (en) * 2019-09-24 2021-03-25 Konica Minolta, Inc. Voice operation system, voice operation method, and program
US20220399018A1 (en) * 2021-06-15 2022-12-15 Fujifilm Business Innovation Corp. Information processing apparatus and non-transitory computer readable medium storing program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160037009A1 (en) * 2014-08-04 2016-02-04 Canon Kabushiki Kaisha Job processing apparatus, method for controlling job processing apparatus, and storage medium
JP2019083497A (ja) 2017-11-01 2019-05-30 コニカミノルタ株式会社 画像処理装置およびその動作制御方法
US10606531B2 (en) 2017-11-01 2020-03-31 Konica Minolta, Inc. Image processing device, and operation control method thereof
US20200249883A1 (en) * 2019-02-04 2020-08-06 Konica Minolta, Inc. Image forming apparatus, image forming system, and information processing method
US20210092243A1 (en) * 2019-09-24 2021-03-25 Konica Minolta, Inc. Voice operation system, voice operation method, and program
US20220399018A1 (en) * 2021-06-15 2022-12-15 Fujifilm Business Innovation Corp. Information processing apparatus and non-transitory computer readable medium storing program

Also Published As

Publication number Publication date
US20230030024A1 (en) 2023-02-02
JP2023019219A (ja) 2023-02-09

Similar Documents

Publication Publication Date Title
US20060082802A1 (en) Printing apparatus, setting method in the apparatus, and program
US11036443B2 (en) Image forming apparatus having test printing function, control method for the image forming apparatus, storage medium, and image forming system
US8780365B2 (en) Printing system with dynamic sample page preview
US10956095B2 (en) Server system that improves availability of a plurality of printers, print controller, information processing apparatus, and print service system
JP2009107332A (ja) 印刷の計数のシステム及び方法
JP2008119833A (ja) 画像形成装置
US11899991B2 (en) Printing system, information processing apparatus, and non-transitory computer readable medium for restricting image forming for speech input
US20150022862A1 (en) Printing apparatus, printing method, and recording medium
US20190286391A1 (en) Information processing terminal, method of controlling the same, storage medium, and image forming apparatus
JP2018099840A (ja) 画像形成装置、給紙制御方法、及びプログラム
US20110078286A1 (en) Information processing apparatus, a computer-readable storage medium recorded with a data management program, and data management system
US11836556B2 (en) Image forming apparatus, image forming method, and storage medium
US10606531B2 (en) Image processing device, and operation control method thereof
US8237979B2 (en) System and method of utilizing tab attributes as job ticket attributes for printing
US20220399018A1 (en) Information processing apparatus and non-transitory computer readable medium storing program
US20070236716A1 (en) Concurrent IPDS and non-IPDS print processing
US10248364B2 (en) Method and system for print device problem capture
US11659108B2 (en) Printing system, information processing apparatus, and non-transitory computer readable medium
US6826629B2 (en) Apparatus and method for enhancing learning ability and behavior for a computer peripheral device
US12124897B2 (en) Image forming apparatus that effectively suppresses formation of an image
US20240037360A1 (en) Image forming apparatus
US20100306331A1 (en) Printer, information processing system, information processing method, and computer-readable recording medium having recorded program
US11650530B2 (en) System, system control method, and storage medium for receiving input to improve a defect of a printed image
US6888647B2 (en) Proofing with watermark information created by a raster imaging processor
US11244215B2 (en) Methods and systems for printing a document having pages with different margins

Legal Events

Date Code Title Description
AS Assignment

Owner name: FUJIFILM BUSINESS INNOVATION CORP., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YABUSAKI, RYOTO;REEL/FRAME:058447/0033

Effective date: 20211118

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE