US20110249025A1 - Image processing apparatus - Google Patents

Image processing apparatus Download PDF

Info

Publication number
US20110249025A1
US20110249025A1 US13/079,938 US201113079938A US2011249025A1 US 20110249025 A1 US20110249025 A1 US 20110249025A1 US 201113079938 A US201113079938 A US 201113079938A US 2011249025 A1 US2011249025 A1 US 2011249025A1
Authority
US
United States
Prior art keywords
image
unit
display
menu
displayed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/079,938
Other languages
English (en)
Inventor
Daisuke MITANI
Yuki Taniyasu
Takeshi Yoshiura
Koji Shimada
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Omron Corp
Original Assignee
Omron Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Omron Corp filed Critical Omron Corp
Assigned to OMRON CORPORATION reassignment OMRON CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SHIMADA, KOJI, YOSHIURA, TAKESHI, TANIYASU, YUKI, MITANI, DAISUKE
Publication of US20110249025A1 publication Critical patent/US20110249025A1/en
Priority to US14/494,770 priority Critical patent/US9728168B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37—Details of the operation on graphic patterns
    • G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/32—Indexing scheme for image data processing or generation, in general involving image mosaicing
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/14—Solving problems related to the presentation of information to be displayed
    • G09G2340/145—Solving problems related to the presentation of information to be displayed related to small screens
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user

Definitions

  • the present invention relates to an image processing apparatus, and in particular to an image processing apparatus that controls display of a processing target image and display of a menu related to image processing functions on the same screen.
  • a so-called visual sensor is used as an apparatus for optically detecting defects in half-finished products in the manufacturing process, in finished products before shipping, and the like, and for optically measuring the size of such defects.
  • an image of a workpiece (object) is captured, and inspection and measurement are carried out by performing various types of image processing on the captured image.
  • an image processing apparatus is used to process the captured input image that has been output from the imaging apparatus included in the visual sensor.
  • a user displays the input image on a monitor, and sets values for various items related to inspection and measurement while checking the displayed input image.
  • a function for displaying an image serving as the processing target and an image processing menu on the same screen is proposed in Patent Document 1,for example.
  • Patent Document 1 Japanese Unexamined Patent Application No. H07-160456
  • Patent Document 1 discloses a display method for dividing a display screen into a work area in which the processing target image is displayed and a display area in which the image processing menu is displayed. As long as the screen is sufficiently large, the visibility of the processing target image will not suffer even if the work area and the image processing menu display area are displayed on the same screen at the same time.
  • the screen size is limited in the case of, for example, a mobile display device to be carried around a manufacturing site or the like, and therefore when the area for displaying the processing target image and the image processing menu display area are displayed on the same screen at the same time as in Patent Document 1, the areas will inevitably be small. For this reason, the user cannot sufficiently check the processing target image when selecting an item from the menu while checking the processing target image, and thus operation of such a display is difficult.
  • An embodiment of the invention provides an image processing apparatus for processing an image of a target object while displaying the image of the target object on a display unit for inspection of the target object, the image processing apparatus including: a target image display unit that displays the image of the target object on the display unit; an image selection unit that, in accordance with a selection operation, selects all or part of the image of the target object displayed on the display unit; and a menu display unit that displays a menu image so as to be overlapped with the image of the target object in a translucent state, the menu image being made up of a plurality of parts that are partial images for displaying information or receiving an input operation, wherein the menu display unit includes a display switching unit that, in accordance with an external switching instruction, switches the menu image displayed on the display unit such that the size of an area occupied by the menu image on the image of the target object is different.
  • the display switching unit performs switching such that the number of parts displayed in the menu image on the display unit is different.
  • the display switching unit switches between display and non-display for all of the parts of the menu image on the display unit.
  • the display switching unit switches between display and non-display of the entirety of the menu image on the display unit.
  • the image processing apparatus further includes: an instruction unit that is operated to give the switching instruction, wherein the instruction unit is fixedly displayed at a predetermined position on the screen of the display unit.
  • the display unit and the image processing apparatus are integrally configured so as to be portable.
  • a menu image made up of a plurality of parts that are partial images for displaying information or receiving an input operation is displayed overlapped with the image of the target object in a translucent state, and switching can be performed in accordance with an external switching instruction so as to vary the size of the area occupied by the menu image on the display unit.
  • FIG. 1 is a schematic diagram showing an overall configuration of a visual sensor system according to an embodiment
  • FIG. 2 is a block configuration diagram of the visual sensor system according to the embodiment
  • FIG. 3 is a diagram schematically showing data exchanged between a display setting unit and the visual sensor according to the embodiment
  • FIG. 4 is a diagram showing an example of a configuration for performing image synthesis processing according to the
  • FIG. 5 is a flowchart of image processing in an adjustment mode according to the embodiment.
  • FIGS. 6A and 6B are diagrams showing examples of display screens according to the embodiment.
  • FIGS. 7A and 7B are diagrams showing examples of display screens according to the embodiment.
  • FIGS. 8A and 8B are diagrams showing examples of display screens according to the embodiment.
  • FIGS. 9A and 9B are diagrams showing examples of display screens according to the embodiment.
  • FIGS. 10A to 10C are diagrams showing examples of display screens according to the embodiment.
  • FIGS. 11A and 11B are diagrams showing examples of display screens according to the embodiment.
  • FIG. 12 is a diagram showing an example of a display screen according to the embodiment.
  • FIG. 13 is a diagram illustrating how the visual sensor according to the embodiment is attached
  • FIG. 14 is a diagram illustrating how a plurality of visual sensors according to the embodiment are attached
  • FIG. 15 is a schematic diagram showing an overall configuration of a visual sensor system according to another embodiment.
  • FIG. 16 is a hardware configuration diagram of an image processing apparatus of the visual sensor system according to the other embodiment.
  • an image processing apparatus is described below as a display setting unit integrally including a screen for display, there is no limitation to this.
  • the screen for display may be provided separately.
  • the image processing apparatus is provided separately from a visual sensor having an imaging unit for obtaining an input image, the image processing apparatus may be built into the visual sensor.
  • FIG. 1 is a schematic diagram showing an overall configuration of a visual sensor system including an image processing apparatus according to the present embodiment.
  • FIG. 2 shows a configuration of a display setting unit and a visual sensor according to the present embodiment.
  • FIG. 3 schematically shows data exchanged between the display setting unit and the visual sensor according to the present embodiment.
  • a visual sensor 200 and a display setting unit 201 corresponding to the image processing apparatus are connected by a transmission cable 202 so as to be able to communicate with each other in accordance with a predetermined protocol.
  • An IO cable 203 connects the visual sensor 200 and a PLC (Programmable Logic Controller) 400 so as to be able to communicable with each other.
  • the PLC 400 performs overall control of the visual sensor system 1 by receiving signals from another apparatus and transmitting signals to the other apparatus.
  • a plurality of visual sensors 200 may be connected to the display setting unit 201 via transmission cable 202 and a hub (not shown).
  • a user can control image processing and image capture processing by transmitting data for image processing and image capture processing to visual sensor 200 via display setting unit 201 .
  • Display setting unit 201 receives image processing results from visual sensor 200 and displays them.
  • Visual sensor 200 is powered from an external power supply (not shown) via IO cable 203 .
  • Visual sensor system 1 is incorporated in a production line, for example. Visual sensor system 1 executes processing such as character recognition and imperfection inspection (hereinafter, also referred to as “inspection processing”) based on an image obtained by imaging an inspection target (the later-described “workpiece 2 ”).
  • inspection processing processing such as character recognition and imperfection inspection
  • Visual sensor 200 includes an imaging unit 212 and a controller unit 213 , and imaging unit 212 has an illumination unit 211 and an imaging lens 221 .
  • a microcomputer is built into the controller unit 213 .
  • the casing of visual sensor 200 is provided with an attachment unit 214 for attaching visual sensor 200 to a support member (not shown).
  • Display setting unit 201 has an LCD (Liquid Crystal Display) touch panel 204 that includes a LCD integrated with a touch panel for receiving input of an operation instruction due to the LCD screen being touched by a finger or a special-purpose pen.
  • Display setting unit 201 receives image data captured by imaging unit 212 and displays the image data on LCD touch panel 204 , and also receives input of an instruction given from a user operation from LCD touch panel 204 , and transmits the instruction to controller unit 213 of visual sensor 200 .
  • LCD Liquid Crystal Display
  • the communication data includes data that is transmitted from visual sensor 200 to display setting unit 201 , namely current value data 500 indicating the current values of various types of parameters related to inspection processing, inspection result data 502 , and an input image that imaging unit 212 obtains by capturing an image of the workpiece 2 .
  • the communication data also includes data transmitted from display setting unit 201 to visual sensor 200 , namely setting value data 501 that has been set for the various parameters related to inspection processing.
  • Visual sensor 200 includes illumination unit 211 , imaging unit 212 for capturing an image of workpiece 2 , and controller unit 213 .
  • Imaging unit 212 has imaging lens 221 and camera 222 .
  • Illumination unit 211 includes an illumination control system 223 that has an illumination lens 224 and an LED (Light Emitting Diode) 225 serving as the light source.
  • illumination control system 223 that has an illumination lens 224 and an LED (Light Emitting Diode) 225 serving as the light source.
  • LED Light Emitting Diode
  • Controller unit 213 includes an indicator light control unit 227 that controls an indicator light (not shown) such as a lamp, CPU 226 for controlling visual sensor 200 , power supply system 228 for supplying power to various units, an external device communication system 229 that is connected to transmission cable 202 , an input/output system 230 for inputting and outputting data from and to an external device, and a memory 231 for storing various types of data such as current value data 500 for the various parameters related to images, inspection results, and image processing.
  • an indicator light control unit 227 controls an indicator light (not shown) such as a lamp
  • CPU 226 for controlling visual sensor 200
  • power supply system 228 for supplying power to various units
  • an external device communication system 229 that is connected to transmission cable 202
  • an input/output system 230 for inputting and outputting data from and to an external device
  • a memory 231 for storing various types of data such as current value data 500 for the various parameters related to images, inspection results, and image processing.
  • Display setting unit 201 includes power supply unit 240 for supplying power to various units, operation unit 241 such as a touch panel on which an operation is performed to input an external instruction, LCD 242 , LCD control unit 243 that controls LCD 242 , display image control unit 244 that controls the display of images on LCD 242 via LCD control unit 243 , an image storage unit 245 for storing images, an image control unit 246 , and a transmission unit 247 .
  • Display setting unit 201 has a microcomputer providing the functionality of LCD control unit 243 , display image control unit 244 , image control unit 246 , and the like.
  • Transmission unit 247 is connected to transmission cable 202 and includes a switch 248 for performing input switching.
  • a plurality of visual sensors 200 can be connected to display setting unit 201 via transmission cable 202 .
  • Transmission unit 247 has a plurality of input ports for communicating with a plurality of visual sensors 200 .
  • Switch 248 selects one of the input ports in accordance with a command from the microcomputer. This enables display setting unit 201 to communicate with visual sensor 200 that is connected to the selected input port.
  • Display setting unit 201 has been made compact so as to be capable of being carried by a user who patrols a manufacturing line at a manufacturing site or the like, and therefore the screen size of LCD 242 has also been reduced.
  • LCD 242 displays images based on a control signal from LCD control unit 243 .
  • LCD control unit 243 Based on an image signal from display image control unit 244 , LCD control unit 243 generates a control signal for controlling display processing performed by LCD 242 , and outputs the control signal to LCD 242 .
  • Operation unit 241 includes, for example, switches provided on the outer side of the casing of display setting unit 201 , and a tablet (not shown) that covers the surface of LCD 242 .
  • LCD 242 and the tablet comprise a touch panel.
  • the user inputs various types of instructions (or commands) to display setting unit 201 via the switches and the touch panel.
  • Display image control unit 244 generates a synthesized image 303 based on an instruction signal 304 from operation unit 241 , an image 306 sent from image control unit 246 , an input image 300 received from visual sensor 200 via transmission unit 247 , and current value data 500 , and outputs synthesized image 303 to LCD control unit 243 .
  • Display image control unit 244 also receives an input of values based on instruction signal 304 from operation unit 241 , and outputs the values to transmission unit 247 as setting value data 501 .
  • Setting value data 501 are transmitted to visual sensor 200 via transmission unit 247 .
  • Image control unit 246 stores the input image received from visual sensor 200 in image storage unit 245 .
  • Image control unit 246 also reads out the image stored in image storage unit 245 , and outputs the readout image to display image control unit 244 .
  • a display setting screen is displayed on LCD 242 of display setting unit 201 in order to display current value data 500 related to items from inspection processing and to allow the user to input the setting value data 501 .
  • the following is a detailed description of a method for generating the display setting screen.
  • FIG. 4 shows an example of the configuration of display image control unit 244 according to the present embodiment.
  • display image control unit 244 includes a menu image signal generation unit 251 , a synthesis unit 252 , and a storage unit 253 .
  • the display setting screen is assumed to be made up of a plurality of setting screens in a hierarchy.
  • Menu image signal generation unit 251 generates menu images 302 that are used in the setting screens.
  • Menu images 302 are made up of a plurality of UI (User Interface) parts, which are partial images for displaying information such as various types of parameter values related to image processing for inspection processing and for receiving a user input operation.
  • the parameter values are adjustable for each image processing item, and the UI parts include, for example, icons and checkboxes for selecting processing items whose parameter values are to be adjusted among the image processing items, and textboxes and slide bars for the input of parameter values.
  • menu image 302 of the next rank in the hierarchy for setting a parameter value for the processing item corresponding to the designated UI part is generated, and a synthesized image 303 generated using that menu image 302 is displayed.
  • Menu image signal generation unit 251 generates a menu image signal based on information 301 related to the type and location of the UI part read out from storage unit 253 , instruction signal 304 output from operation unit 241 , and current value data 500 read out from memory 231 of visual sensor 200 , and outputs the generated menu image 302 to synthesis unit 252 .
  • Synthesis unit 252 receives an input of images 300 or 306 sent in units of frames and menu image 302 output from menu image signal generation unit 251 .
  • Synthesis unit 252 synthesizes menu image 302 in units of frames so as to be superimposed on images 300 or 306 , and outputs synthesized images 303 that have been synthesized in units of frames.
  • Menu image 302 sent to synthesis unit 252 corresponds to an input image received from visual sensor 200 that was obtained by imaging workpiece 2 , or a captured image of workpiece 2 that was read out from image storage unit 245 of image control unit 246 .
  • synthesis unit 252 outputs images 300 or 306 as they are if menu image 302 has not been sent. Accordingly, in this case, synthesized images 303 correspond to images 300 or 306 .
  • LCD control unit 243 receives an input of the synthesized image 303 from display image control unit 244 , generates a control signal for displaying the synthesized image 303 , and controls LCD 242 using the generated control signal. Accordingly, synthesized image 303 is displayed on the screen of LCD 242 while being updated in units of frame.
  • menu image signal generation unit 251 and synthesis unit 252 of the present embodiment variably set parameter values indicating the transparency of each pixel of menu image 302 when synthesis is performed.
  • the parameter values are, for example, ⁇ (alpha) values in a blend processing related to image transparency processing.
  • a pixel becomes opaque if the parameter value is set to the maximum value, becomes transparent if the parameter value is set to “0”, and becomes translucent if the parameter value is set to an intermediate value therebetween. Since the pixels of menu image 302 to be displayed by LCD 242 are set to be translucent, menu image 302 is displayed superimposed on image 300 in a translucent state. Accordingly, the user can check the current values of the various parameters related to inspection processing and set such values while checking image 300 displayed under menu image 302 .
  • Visual sensor system 1 of the present embodiment has various operating modes, including an adjustment mode in which the values of the various parameters related to inspection processing are set by being adjusted, and an operation mode in which the workpieces 2 on the manufacturing line are subjected to inspection processing. Images (including synthesized images) are displayed by display setting unit 201 in both the adjustment mode and the operation mode. Although a description of image processing in the adjustment mode is provided below, the switching of menu images described below can be similarly applied in the operation mode as well.
  • FIG. 5 shows a flowchart of image processing performed by display setting unit 201 in the adjustment mode according to the present embodiment.
  • the following describes an image processing procedure of the present embodiment with reference to FIG. 5 .
  • the image 300 may be replaced with the image 306 in the following description.
  • synthesized image 303 generated by menu image 302 of the highest rank in the hierarchy, being superimposed on image 300 is displayed on LCD 242 (step S 3 ).
  • menu image signal generation unit 251 receives an input of instruction signal 304 corresponding to the selected item (step S 9 ), and generates and outputs menu image 302 of the next rank in accordance with the received instruction signal 304 (step S 11 ).
  • Synthesis unit 252 generates synthesized image 303 by superimposing menu image 302 of the next rank onto image 300 , and outputs the synthesized image 303 (step S 12 ). Accordingly, LCD 242 displays synthesized image 303 in accordance with a control signal generated by LCD control unit 243 (step S 13 ).
  • the user inputs a setting value for any of the various parameters by using operation unit 241 and a UI part in the synthesized image 303 .
  • Instruction signal 304 related to the setting value that was input is sent to menu image signal generation unit 251 , and thereafter menu image signal generation unit 251 generates and outputs menu image 302 in accordance with instruction signal 304 . Accordingly, synthesized image 303 on LCD 242 is updated to a synthesized image 303 in which a value, data, or the like is displayed in the UI part based on instruction signal 304 , and updated synthesized image 303 is displayed (step S 15 ). Note that the setting value that was input and determined is stored as setting value data 501 in a memory area (not shown) associated with menu image signal generation unit 251 .
  • Menu image signal generation unit 251 determines whether instruction signal 304 instructing a switch between menu image 302 that occupies a large area in synthesized image 303 and menu image 302 that occupies a small area in synthesized image 303 , has been sent via operation unit 241 (step S 17 ). This switching of menu image 302 will be described later.
  • step S 17 If it has been determined that instruction signal 304 for switching menu image 302 has not been sent (NO in step S 17 ), processing moves to the later-described step S 21 , and if it has been determined that instruction signal 304 has been sent (YES in step S 17 ), display switching processing is performed (step S 19 ).
  • menu image signal generation unit 251 operates so as to store instruction signal 304 . Accordingly, in the display switching processing, it is possible to determine, based on stored instruction signal 304 , whether the occupied area of menu image 302 currently synthesized in synthesized image 303 is large or small.
  • operation unit 241 the user performs a setting end operation if the user desires to end the setting of the parameter value using the UI part in displayed menu image 302 , or the user performs an operation for selecting an item in menu image 302 .
  • Instruction signal 304 indicating the operation content is output to menu image signal generation unit 251 .
  • menu image signal generation unit 251 determines that setting is to be ended based on instruction signal 304 (YES in step S 21 )
  • menu image signal generation unit 251 reads out and outputs setting value data 501 from the memory area. Accordingly, setting value data 501 is transmitted to visual sensor 200 via transmission unit 247 (step S 25 ).
  • CPU 226 of visual sensor 200 stores the received setting value data 501 in memory 231 as the current value data 500 . Thereafter, in inspection processing using a captured image obtained by imaging unit 212 , processing is executed using current value data 500 that was read out from memory 231 .
  • menu image signal generation unit 251 determines that an item was selected based on instruction signal 304 (NO in step S 21 , and furthermore YES in step S 23 ), processing returns to step S 9 , and subsequent processing is performed in a similar manner for the selected item.
  • menu image signal generation unit 251 determines, based on instruction signal 304 , that the end of setting has not been instructed, and further an item has not been selected (NO in step S 21 , and NO in step S 23 ), processing returns to step S 15 , and processing for inputting a setting value in the currently displayed menu image 302 continues.
  • menu image 302 is displayed synthesized with image 300 , which is an enlarged image of the surface (characters) of the workpiece 2 .
  • FIGS. 6A and 6B show setting screens for setting a threshold value for a good/poor determination in inspection processing.
  • the image 300 is displayed over the entirety of the screen of LCD 242 , and an inspection area frame 402 indicating the inspection range is set to the entirety of image 300 by default.
  • a model area frame 401 input by the user using operation unit 241 is displayed as a graphic in image 300 .
  • Model area frame 401 indicates the area of a partial image that is to serve as a reference (model) for inspection processing.
  • Menu image 302 displayed in FIG. 6A is made up of UI parts such as character string information display units 601 and 602 , common buttons 701 to 703 , a determine button 704 , and a cancel button 705 .
  • the character string information display unit 601 is always arranged at the top of the screen and displays information such as the content of setting items and the setting screen being displayed, setting values, and user guidance.
  • the common buttons 701 to 703 are always arranged at the bottom of the screen and are displayed for providing functions common to each of the menu images 302 . Since the UI parts constituting menu image 302 are transparent images, the menu can be operated while checking the image 300 .
  • Common button 701 is an example of an icon and is operated in order to input an instruction for switching menu image 302 .
  • Common button 701 is displayed fixed at a predetermined position (the bottom left of the screen in the present embodiment) in all of the screens that are displayed by switching, and therefore the user is not likely to lose sight of common button 701 even if the screen is switched.
  • Common button 702 is operated in order to change how image 300 is displayed (e.g., enlarged or reduced).
  • Common button 703 is operated in order to execute screen capturing.
  • Determine button 704 and cancel button 705 are displayed at the bottom of the screen and are operated in order to determine/cancel setting value data 501 that was input via menu image 302 . If the determine operation has been performed, setting values that were input via menu image 302 are determined and stored as setting value data 501 in the memory area associated with menu image signal generation unit 251 , and the setting screen is changed to a higher ranking screen. On the other hand, if the cancel operation has been performed, setting values that were input via menu image 302 are canceled, and the setting screen is changed to a higher ranking screen.
  • UI parts 602 to 605 in FIG. 6A are display units for displaying threshold values (correlation values with respect to a model and a captured image, and the type of determination) indicated by current value data 500 for performing inspection processing using the partial image (model) inside model area frame 401 , and slide bars and text boxes for the numerical input of threshold values that are operated via operation unit 241 for setting the correlation value.
  • common button 701 is displayed in synthesized image 303 , and menu image 302 can be switched by operating common button 701 , and the same follows for all synthesized images 303 .
  • switching menu image 302 enables changing the number of UI parts in menu image 302 superimposed on image 300 , that is to say, enables changing the amount of area occupied by menu image 302 superimposed on image 300 . Accordingly, by switching to a menu image 302 that occupies less area, the user can more easily check the entire area of image 300 and make designations.
  • a configuration is possible in which by enlarging/reducing the UI parts in displayed menu image 302 by operating common button 701 , the size of the area occupied by menu image 302 superimposed on image 300 is changed while maintaining the same number of displayed UI parts.
  • the operation unit for instructing switching of menu image 302 is not limited to being common button 701 that is displayed.
  • An operation switch provided on the casing of display setting unit 201 or the like may be used instead of common button 701 . In this case, displaying and not displaying menu image 302 superimposed on image 300 is switched in conjunction with the operation of that switch.
  • a configuration is possible in which, when menu image 302 has been switched to occupy a small area, the transparency of common button 701 is increased, or the position of common button 701 can be changed by a so-called drag-and-drop operation. Also, a configuration is possible in which common button 701 is not displayed, and switching to the screen in which menu image 302 is displayed is performed by so-called double-tapping the touch panel made up of LCD 242 and the tablet. This enables the user to check the entire region of synthesized image 303 and to make designations without being hindered by common button 701 .
  • FIG. 7A shows a common button 706 that is operated in order to display various types of setting item selection buttons for model area editing. Specific examples of the selection buttons displayed when common button 706 has been operated will be described later.
  • model area frame 401 becomes easier to edit.
  • the entirety of image 300 can be checked by hiding the UI parts of menu image 302 through operation of common button 701 , thus facilitating the selection of an area. Also, since menu image 302 is displayed superimposed on image 300 in a translucent state, a portion of image 300 that is overlapped with the UI parts of menu image 302 can also be selected as model area frame 401 .
  • FIGS. 8A and 8B show examples of display screens for setting parameter values related to color extraction in image processing.
  • menu image 302 displayed superimposed on image 300 includes UI parts 606 to 611 for selecting the color of an area to be extracted from image 300 .
  • a common button 707 that is operated in order to instruct the end of the setting of parameter values related to color extraction.
  • UI part 606 shows checkboxes for selecting colors that are to be extracted.
  • UI part 608 indicates a color palette for color selection.
  • the color palette for color selection is provided with UI parts 610 that can slide in the horizontal direction of the screen and UI parts 611 that can slide in the vertical direction of the screen. Sliding UI parts 610 enables setting the degree of hue, and sliding UI parts 611 enables setting the degree of saturation.
  • operating UI parts 609 slidingers
  • UI part 607 segment bar
  • the character string information display unit 601 displayed at the top of the screen displays values (H: hue, S: saturation, and V: value) that are set by sliding the UI parts described above, and these values change in conjunction with the sliding.
  • Image control unit 244 extracts areas including the designated colors indicated by UI setting values 305 from image 300 , and generates an image 306 in which only the extracted color area portions remain. The generated image 306 is sent to synthesis unit 252 in place of image 300 .
  • menu image 302 is displayed superimposed on image 306 obtained using the parameter values set via the UI parts, the user can set parameter values as well as check the result of image processing performed using the set parameter values.
  • FIGS. 9 to 12 show other screens displayed in the adjustment mode. Since common button 701 is displayed in these screens as well, menu image 302 can be easily switched between occupying a large area and occupying a small area.
  • FIG. 9A shows a high ranking menu image 302 in the adjustment mode.
  • UI part 612 at the left end of menu image 302 shows an item menu showing functions of display setting unit 201 .
  • selection buttons for “Camera adjustment”, “Trigger adjustment”, and “Alignment correction”, which are setting items for imaging are displayed on the right side of the screen in the order in which setting needs to be performed.
  • FIG. 9B shows an example of a display in the case where “Inspection” in the operation item menu of UI part 612 has been selected, in which a list of functions used for inspection are displayed on the right side of the screen in a menu format.
  • menu image 302 shown in FIG. 10A is displayed.
  • UI part 614 in FIG. 10A is for displaying a number indicating the focus value in image 300 (in FIG. 10A , the value 85 ), and a corresponding bar graph.
  • the focus value shows the degree to which the focal point of imaging unit 212 coincides with the imaging subject such as a workpiece, and the focus value changes in conjunction with focus adjustment operations performed by visual sensor 200 . Note that since the focus value correlates with the quantity of edges that appear in the input image, the focus value can be calculated based on, for example, color deviation included in the input image.
  • FIG. 10B shows an example of menu image 302 displayed if “Alignment correction” has been selected in the subordinate function menu shown in FIG. 9A .
  • character string information display unit 601 shows whether processing for correcting the alignment of imaging unit 212 is selected, and the fact that it is the alignment correction setting.
  • FIG. 10B If “Alignment correction setting” was selected in FIG. 10B , menu image 302 shown in FIG. 10C is displayed. In FIG. 10C , UI part 709 for selecting the execution of teach processing for alignment correction is displayed. In teach processing, processing for registering model area frame 401 and inspection area frame 402 that have been set is performed (i.e., processing for storage in a predetermined storage area of display setting unit 201 , or processing for transmission to visual sensor 200 and storage in a predetermined storage area).
  • a setting item selection button 7061 is displayed as shown in FIG. 11A .
  • “Edit model area” is selected, menu image 302 shown in FIG. 11B is displayed, and the model area to be used in alignment correction processing can be set.
  • the model area frames 401 and 405 have been set in FIG. 11B .
  • the position and size of the set model area is detected and displayed in character string information display unit 601 .
  • the position and size of model area frame 401 and 405 on image 300 can be changed by operating the UI part 613 .
  • FIG. 12 shows an example of menu image 302 displayed if “Edge position” was selected in the function menu shown in FIG. 9B .
  • An image edge level is set in the screen shown in FIG. 12 .
  • UI parts 614 and 615 for setting the level according to which edges are to be extracted from image 300 , as well as an edge graphic 403 are displayed in FIG. 12 .
  • edge graphic 403 the edge level in inspection area frame 402 is detected, position in image 300 is plotted on the horizontal axis of the graph, and edge level is plotted on the vertical axis.
  • Edge graphic 403 is generated by image control unit 246 performing edge detection based on the brightness component level of each pixel in image 300 .
  • the generated edge graphic 403 is displayed superimposed on image 300 .
  • UI part 615 (slider) is displayed in association with edge graphic 403 .
  • the user can determine a desired edge level threshold value while referencing edge graphic 403 .
  • the detected edge position is shown by a cross mark 404 .
  • the set threshold value is numerically displayed in the numerical value input box of UI part 614 while being sequentially updated in conjunction with the slide operation.
  • menu image 302 including translucent UI parts is displayed superimposed on image 300 , and in such a screen, switching of the UI parts of menu image 302 can be performed by operating common button 701 .
  • FIG. 13 shows an example of how visual sensor 200 is attached.
  • FIG. 14 shows a state in which visual sensors 200 are respectively attached to conveying lines of belt conveyors or the like, which are a plurality of conveying mechanisms 6 (the arrow in the figure indicates the conveying direction), as viewed from above the conveying lines.
  • visual sensor 200 corresponding to each line is attached to a support member (not shown) via attachment unit 214 such that the imaging range of camera 222 is aligned with the conveying line.
  • illumination light is irradiated on the conveying line of conveying mechanism 6 , thus providing illumination in the imaging range.
  • Visual sensors 200 provided for the conveying lines exchange inspection processing result information, information for inspection processing including the current value data 500 , and the like with each other via transmission cable 202 .
  • imaging function and the image processing function for inspection processing are provided integrally in visual sensor 200 in the above-described embodiment, these functions may be provided separately and independently as shown in the present embodiment.
  • a visual sensor system 1 As shown in FIG. 15 , in a visual sensor system 1 according to another embodiment that is incorporated in an FA production/manufacturing line or the like, workpieces 2 that are objects to be subjected to measurement are conveyed in the arrow direction in FIG. 15 by a conveying mechanism 6 such as a belt conveyor, and the workpieces 2 are successively imaged by an imaging apparatus 8 in order to perform inspection processing on the workpieces 2 .
  • Image data obtained by imaging apparatus 8 hereinafter, also referred to as “input images” are transmitted to an image processing apparatus 100 . Note that it is possible to further provide an illumination mechanism that emits light onto the workpieces 2 that are imaged by imaging apparatus 8 .
  • a photoelectric sensor 4 made up of two parts disposed on respective sides of conveying mechanism 6 detects the fact that a workpiece 2 has arrived in the imaging range of the imaging apparatus 8 .
  • photoelectric sensor 4 includes a photoreception unit 4 a and a photoemission unit 4 b disposed on the same optical axis.
  • the photoreception unit 4 a detects the fact that light emitted from the photoemission unit 4 b is blocked by workpiece 2 , thus detecting the arrival of workpiece 2 .
  • a detection signal (hereinafter, also referred to as a “trigger signal”) from photoelectric sensor 4 is output to a PLC 5 .
  • PLC 5 receives the trigger signal from photoelectric sensor 4 or the like, and performs control of the conveying mechanism 6 .
  • Visual sensor system 1 in FIG. 15 further includes image processing apparatus 100 , a display 102 , and a keyboard 104 .
  • Image processing apparatus 100 is connected to PLC 5 , imaging apparatus 8 , display 102 , and keyboard 104 .
  • Image processing apparatus 100 has various types of operating modes, namely an operation mode for executing inspection processing on the workpieces 2 , and the above-described adjustment mode.
  • image processing apparatus 100 gives an imaging command to imaging apparatus 8 upon receiving the trigger signal from photoelectric sensor 4 via PLC 5 .
  • imaging apparatus 8 transmits an input image obtained by capturing an image of the workpiece 2 to image processing apparatus 100 .
  • a configuration is possible in which imaging apparatus 8 is caused to continuously perform imaging, and image processing apparatus 100 obtains only necessary input images in response to receiving the trigger signal.
  • Imaging apparatus 8 includes, for example, an optical system such as a lens, and an imaging element partitioned into a plurality of pixels, such as a CCD (Charged Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor. Imaging apparatus 8 is assumed to be attached such that its installation location, which determines the imaging range, can be changed manually.
  • an optical system such as a lens
  • an imaging element partitioned into a plurality of pixels such as a CCD (Charged Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor.
  • CCD Charge Coupled Device
  • CMOS Complementary Metal Oxide Semiconductor
  • Image processing apparatus 100 is a computer having a general-purpose architecture, and provides various types of functions by executing a pre-installed program.
  • FIG. 16 is a schematic configuration diagram showing image processing apparatus 100 according to this other.
  • image processing apparatus 100 includes a CPU 110 , which is an arithmetic processing unit, a memory 112 and a hard disk 114 , which are storage units, a camera interface 116 , an input interface 118 , a display controller 120 , a PLC interface 122 , a communication interface 124 , and a data reader/writer 126 . These units are connected via a bus 128 such that data can be exchanged therebetween.
  • a bus 128 such that data can be exchanged therebetween.
  • CPU 110 performs various types of computation for processing in the operation mode and the above-described adjustment mode by deploying programs (code) stored in hard disk 114 to memory 112 and executing the programs in a predetermined sequence.
  • Camera interface 116 mediates the transmission of data between the CPU 110 and imaging apparatus 8 . More specifically, camera interface 116 includes an image buffer 116 a that can be connected to one or more imaging apparatuses 8 and temporarily accumulates image data from imaging apparatuses 8 . When at least one frame of input image data has been accumulated in image buffer 116 a, camera interface 116 transfers the accumulated data to memory 112 .
  • Memory 112 stores image data in units of image files. In the case of performing processing on an input image, CPU 110 reads out an image file from memory 112 .
  • Camera interface 116 gives an imaging command to imaging apparatus 8 in accordance with an internal command issued by CPU 110 .
  • Input interface 118 mediates the transmission of data between CPU 110 and input apparatuses such as keyboard 104 , a mouse 103 , and a touch panel (not shown). Specifically, input interface 118 receives an operation command given by the user operating an input apparatus.
  • Display controller 120 is connected to the display 102 , which is a typical example of a display apparatus, and notifies the user of, for example, results of image processing performed by CPU 110 .
  • PLC interface 122 mediates the transmission of data between CPU 110 and PLC 5 . More specifically, PLC interface 122 transmits, to CPU 110 , information regarding the state of the production line controlled by PLC 5 , information regarding the workpiece, and the like.
  • Communication interface 124 mediates the transmission of data between CPU 110 and another personal computer, a server apparatus, or the like, which are not shown.
  • Communication interface 124 is typically an Ethernet (registered trademark) interface, a USB (Universal Serial Bus) interface, or the like. Note that as will be described later, as an alternative to the embodiment in which a program stored on memory card 106 is installed in image processing apparatus 100 , an embodiment is possible in which a program downloaded from a distribution server (not shown) or the like via communication interface 124 is installed in image processing apparatus 100 .
  • Data reader/writer 126 mediates transmission of data between CPU 110 and memory card 106 , which is a storage medium.
  • display 102 corresponds to LCD 242 in FIG. 2 , and the above-described functions of display setting unit 201 in the adjustment mode are executed based on control performed by CPU 110 of image processing apparatus 100 . Accordingly, even with the configuration shown in FIGS. 15 and 16 , parameter values for inspection processing can be set while menu image 302 is displayed superimposed on processing target image 300 in a translucent state, and menu image 302 can be switched by operating common button 701 . This enables more easy operation with respect to the setting of parameter values while checking image 300 .
  • the embodiments provides image processing apparatus that can display an image without impairing visibility, even in the case of a screen having a limited size.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
US13/079,938 2010-04-07 2011-04-05 Image processing apparatus Abandoned US20110249025A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/494,770 US9728168B2 (en) 2010-04-07 2014-09-24 Image processing apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010-088859 2010-04-07
JP2010088859A JP5411049B2 (ja) 2010-04-07 2010-04-07 画像処理装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/494,770 Continuation US9728168B2 (en) 2010-04-07 2014-09-24 Image processing apparatus

Publications (1)

Publication Number Publication Date
US20110249025A1 true US20110249025A1 (en) 2011-10-13

Family

ID=44201942

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/079,938 Abandoned US20110249025A1 (en) 2010-04-07 2011-04-05 Image processing apparatus
US14/494,770 Active US9728168B2 (en) 2010-04-07 2014-09-24 Image processing apparatus

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/494,770 Active US9728168B2 (en) 2010-04-07 2014-09-24 Image processing apparatus

Country Status (5)

Country Link
US (2) US20110249025A1 (es)
EP (1) EP2375381B1 (es)
JP (1) JP5411049B2 (es)
CN (2) CN104202517A (es)
ES (1) ES2396215T3 (es)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD716841S1 (en) 2012-09-07 2014-11-04 Covidien Lp Display screen with annotate file icon
USD717340S1 (en) 2012-09-07 2014-11-11 Covidien Lp Display screen with enteral feeding icon
USD735343S1 (en) 2012-09-07 2015-07-28 Covidien Lp Console
US9198835B2 (en) 2012-09-07 2015-12-01 Covidien Lp Catheter with imaging assembly with placement aid and related methods therefor
US9433339B2 (en) 2010-09-08 2016-09-06 Covidien Lp Catheter with imaging assembly and console with reference library and related methods therefor
US9517184B2 (en) 2012-09-07 2016-12-13 Covidien Lp Feeding tube with insufflation device and related methods therefor
CN111192377A (zh) * 2020-01-08 2020-05-22 中国银联股份有限公司 一种图像处理方法及装置
US10852944B2 (en) * 2016-09-13 2020-12-01 Samsung Electronics Co., Ltd. Method for displaying soft key and electronic device thereof
CN113973189A (zh) * 2020-07-24 2022-01-25 荣耀终端有限公司 显示内容的切换方法、装置、终端及存储介质

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6267418B2 (ja) * 2012-09-25 2018-01-24 任天堂株式会社 情報処理装置、情報処理システム、情報処理方法、及び情報処理プログラム
JP6298270B2 (ja) * 2013-10-23 2018-03-20 株式会社キーエンス 光電センサ
CN103927774A (zh) * 2014-04-28 2014-07-16 宇龙计算机通信科技(深圳)有限公司 一种可控图片生成处理方法及系统
JP6834843B2 (ja) * 2017-08-10 2021-02-24 オムロン株式会社 画像処理システム、設定支援装置および設定支援プログラム
JP6495989B1 (ja) * 2017-10-02 2019-04-03 株式会社アマダホールディングス プログラム作成装置、溶接システム、及びプログラム作成方法
CN109618210B (zh) * 2018-11-08 2022-03-15 北京微播视界科技有限公司 视频画面调整方法、装置、计算机设备和可读存储介质
JP7315371B2 (ja) * 2019-05-07 2023-07-26 シャープ株式会社 表示制御装置、それを備えた画像形成装置および表示制御方法
CN112825040B (zh) * 2019-11-21 2024-01-30 腾讯科技（深圳）有限公司 用户界面的显示方法、装置、设备及存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6421460B1 (en) * 1999-05-06 2002-07-16 Adobe Systems Incorporated Blending colors in the presence of transparency
US20030112262A1 (en) * 1999-06-14 2003-06-19 Lycos, Inc. A Virginia Corporation Media resource manager/player
US20050250549A1 (en) * 2001-08-10 2005-11-10 Fujitsu Limited Portable terminal
JP2006084657A (ja) * 2004-09-15 2006-03-30 Canon Inc 表示装置
US20090083665A1 (en) * 2007-02-28 2009-03-26 Nokia Corporation Multi-state unified pie user interface
US20090295976A1 (en) * 2008-05-29 2009-12-03 Kyung Dong Choi Terminal and method of controlling the same
US20090315848A1 (en) * 2008-06-24 2009-12-24 Lg Electronics Inc. Mobile terminal capable of sensing proximity touch

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07160456A (ja) 1993-12-06 1995-06-23 Dainippon Screen Mfg Co Ltd 画像処理装置
JP3277428B2 (ja) * 1994-02-04 2002-04-22 ソニー株式会社 コントロールシステム
JP2001149679A (ja) 1999-11-25 2001-06-05 Juki Corp 刺繍縫いデータ作成装置、刺繍縫いデータ作成装置の制御方法、および刺繍縫いデータ作成装置の制御プログラムを格納したコンピュータ読取可能な記憶媒体
US20040100486A1 (en) * 2001-02-07 2004-05-27 Andrea Flamini Method and system for image editing using a limited input device in a video environment
US6697079B2 (en) * 2001-03-15 2004-02-24 Apple Computer, Inc. Color palette providing cross-platform consistency
US9092841B2 (en) * 2004-06-09 2015-07-28 Cognex Technology And Investment Llc Method and apparatus for visual detection and inspection of objects
JP3669698B2 (ja) * 2002-09-20 2005-07-13 日東電工株式会社 印刷物の検査方法及び検査装置
US7233316B2 (en) * 2003-05-01 2007-06-19 Thomson Licensing Multimedia user interface
EP1671483B1 (en) * 2003-10-06 2014-04-09 Disney Enterprises, Inc. System and method of playback and feature control for video players
JP4684595B2 (ja) * 2004-08-05 2011-05-18 ソニー株式会社 画像表示装置
US7636449B2 (en) * 2004-11-12 2009-12-22 Cognex Technology And Investment Corporation System and method for assigning analysis parameters to vision detector using a graphical interface
US7551766B2 (en) * 2005-04-01 2009-06-23 Acushnet Company Apparatus and method for inspecting golf balls using threshold analysis
JP4815927B2 (ja) * 2005-07-27 2011-11-16 ソニー株式会社 表示装置、メニュー表示方法、メニュー表示方法のプログラム及びメニュー表示方法のプログラムを記録した記録媒体
US7954064B2 (en) * 2005-10-27 2011-05-31 Apple Inc. Multiple dashboards
US7864178B2 (en) * 2005-11-09 2011-01-04 National Instruments Corporation Creating machine vision inspections using a state diagram representation
JP2007287135A (ja) * 2006-03-20 2007-11-01 Denso Corp 画像表示制御装置および画像表示制御装置用のプログラム
JP4747970B2 (ja) * 2006-07-04 2011-08-17 オムロン株式会社 画像処理装置
JP5247445B2 (ja) * 2006-07-28 2013-07-24 株式会社Ａｃｃｅｓｓ 端末装置、コンテンツ表示方法、およびコンテンツ表示プログラム
US8243326B2 (en) * 2006-09-11 2012-08-14 Electronics For Imaging, Inc. Methods and apparatus for color profile editing
JP5109340B2 (ja) * 2006-11-08 2012-12-26 オムロン株式会社 画像処理装置、画像表示方法、画像表示方法をコンピュータに実行させるためのプログラムおよびそのプログラムを記録した記録媒体
KR101391689B1 (ko) * 2006-12-28 2014-05-07 삼성전자주식회사 이동가능한 메뉴세트를 이용한 메뉴 제공방법 및 이를적용한 멀티미디어 기기
JP2008294705A (ja) * 2007-05-24 2008-12-04 Nikon Corp 表示装置および撮像装置
JP2009116377A (ja) 2007-11-01 2009-05-28 Keyence Corp 画像処理コントローラ用のプログラム作成装置
JP5028253B2 (ja) * 2007-12-28 2012-09-19 株式会社エルモ社 撮像装置
US8638338B2 (en) * 2008-02-11 2014-01-28 Apple Inc. Adjusting color attribute of an image in a non-uniform way
JP4221445B1 (ja) * 2008-06-11 2009-02-12 株式会社ベイビッグ テレビ電話端末、テレビ電話端末制御方法及びプログラム
JP2010016693A (ja) * 2008-07-04 2010-01-21 Nikon Corp 電子カメラ
JP5203858B2 (ja) * 2008-09-01 2013-06-05 富士フイルム株式会社 医用画像表示装置、医用画像表示方法、並びに医用画像表示プログラム
CN101872600B (zh) * 2009-04-24 2014-07-23 深圳Tcl新技术有限公司 一种显示装置及其图像显示方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6421460B1 (en) * 1999-05-06 2002-07-16 Adobe Systems Incorporated Blending colors in the presence of transparency
US20030112262A1 (en) * 1999-06-14 2003-06-19 Lycos, Inc. A Virginia Corporation Media resource manager/player
US20050250549A1 (en) * 2001-08-10 2005-11-10 Fujitsu Limited Portable terminal
JP2006084657A (ja) * 2004-09-15 2006-03-30 Canon Inc 表示装置
US20090083665A1 (en) * 2007-02-28 2009-03-26 Nokia Corporation Multi-state unified pie user interface
US20090295976A1 (en) * 2008-05-29 2009-12-03 Kyung Dong Choi Terminal and method of controlling the same
US20090315848A1 (en) * 2008-06-24 2009-12-24 Lg Electronics Inc. Mobile terminal capable of sensing proximity touch

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9433339B2 (en) 2010-09-08 2016-09-06 Covidien Lp Catheter with imaging assembly and console with reference library and related methods therefor
US9538908B2 (en) 2010-09-08 2017-01-10 Covidien Lp Catheter with imaging assembly
US9585813B2 (en) 2010-09-08 2017-03-07 Covidien Lp Feeding tube system with imaging assembly and console
US10272016B2 (en) 2010-09-08 2019-04-30 Kpr U.S., Llc Catheter with imaging assembly
USD716841S1 (en) 2012-09-07 2014-11-04 Covidien Lp Display screen with annotate file icon
USD717340S1 (en) 2012-09-07 2014-11-11 Covidien Lp Display screen with enteral feeding icon
USD735343S1 (en) 2012-09-07 2015-07-28 Covidien Lp Console
US9198835B2 (en) 2012-09-07 2015-12-01 Covidien Lp Catheter with imaging assembly with placement aid and related methods therefor
US9517184B2 (en) 2012-09-07 2016-12-13 Covidien Lp Feeding tube with insufflation device and related methods therefor
US10852944B2 (en) * 2016-09-13 2020-12-01 Samsung Electronics Co., Ltd. Method for displaying soft key and electronic device thereof
CN111192377A (zh) * 2020-01-08 2020-05-22 中国银联股份有限公司 一种图像处理方法及装置
CN113973189A (zh) * 2020-07-24 2022-01-25 荣耀终端有限公司 显示内容的切换方法、装置、终端及存储介质

Also Published As

Publication number Publication date
EP2375381B1 (en) 2012-11-21
ES2396215T3 (es) 2013-02-20
JP5411049B2 (ja) 2014-02-12
CN102214066A (zh) 2011-10-12
CN104202517A (zh) 2014-12-10
EP2375381A1 (en) 2011-10-12
US20150062172A1 (en) 2015-03-05
CN102214066B (zh) 2014-09-10
JP2011221712A (ja) 2011-11-04
US9728168B2 (en) 2017-08-08

Similar Documents

Publication Publication Date Title
US9728168B2 (en) Image processing apparatus
US11625876B2 (en) Presentation system and display device for use in the presentation system
CN107077258B (zh) 投射型影像显示装置以及影像显示方法
US20070058140A1 (en) Projection image display apparatus and multi-projection system
JP5645444B2 (ja) 画像表示システムおよびその制御方法
JP4283317B2 (ja) プロジェクタシステム
JP4770197B2 (ja) プレゼンテーション制御装置およびプログラム
CN103324282B (zh) 输入用户接口装置、投影装置、命令确定方法
EP2133774A1 (en) Projector system
JP2014197762A (ja) 画像処理システムおよび画像処理プログラム
JP2011108251A (ja) プレゼンテーション制御装置及びプログラム
JP2012234149A (ja) 映像投影装置
US20110221884A1 (en) Image processing apparatus, image processing program, visual sensor system and image processing method
JP4661499B2 (ja) プレゼンテーション制御装置およびプレゼンテーションシステム
CN107454308A (zh) 显示控制设备及其控制方法和存储介质
CN106164828B (zh) 双向显示方法以及双向显示装置
JP5861743B2 (ja) 画像処理装置
JP4572758B2 (ja) 位置座標入力装置
JP2011044094A (ja) 表示装置
JP2009245366A (ja) 入力システム、指示装置および入力システムの制御プログラム
JP2013131229A (ja) 画像処理システム
US20190043398A1 (en) Device management apparatus, device managing method, and program
JP2008123034A (ja) 画像処理装置、画像表示方法、画像表示方法をコンピュータに実行させるためのプログラムおよびそのプログラムを記録した記録媒体。
JP2005339269A (ja) 画像表示装置
JP2023077055A (ja) 外観検査装置及び外観検査方法

Legal Events

Date Code Title Description
AS Assignment

Owner name: OMRON CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MITANI, DAISUKE;TANIYASU, YUKI;YOSHIURA, TAKESHI;AND OTHERS;SIGNING DATES FROM 20110516 TO 20110519;REEL/FRAME:026366/0962

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION