WO2017192496A1 - Methods and systems for detecting damage in edge regions of mobile electronic devices - Google Patents

Methods and systems for detecting damage in edge regions of mobile electronic devices Download PDF

Info

Publication number
WO2017192496A1
WO2017192496A1 PCT/US2017/030520 US2017030520W WO2017192496A1 WO 2017192496 A1 WO2017192496 A1 WO 2017192496A1 US 2017030520 W US2017030520 W US 2017030520W WO 2017192496 A1 WO2017192496 A1 WO 2017192496A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
electronic device
segments
inverted
segment
Prior art date
Application number
PCT/US2017/030520
Other languages
French (fr)
Inventor
Babak Forutanpour
Jeffrey PLOENTER
Original Assignee
ecoATM, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ecoATM, Inc. filed Critical ecoATM, Inc.
Publication of WO2017192496A1 publication Critical patent/WO2017192496A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/001Industrial image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30121CRT, LCD or plasma display

Definitions

  • the present disclosure is directed generally to methods and systems for evaluating mobile phones and other consumer electronic devices and, more particularly, to methods and systems associated with detecting damage in edge regions of such devices.
  • a mobile device e.g., a smartphone or tablet
  • pricing the mobile device, assessing the mobile device for possible repair, and evaluating the mobile device for warranty coverage may all require identification of any cracks in the mobile device's screen and other physical defects such as chipped or bent edges, etc.
  • Individualized manual inspection of mobile device screens for damage is slow, cumbersome, and can yield inconsistent results.
  • Current automated methods are often unable to reliably detect cracks in edge regions. Accordingly, there is a need for improved methods and systems for automatically detecting damage in electronic devices.
  • Figure 1 is a block diagram illustrating components of a suitable computing environment for implementing various aspects of the present technology.
  • Figure 2 is a flow diagram of a method for detecting damage in edge regions of electronic devices in accordance with an embodiment of the present technology.
  • Figure 3 is a flow diagram of selected operations in the method shown in Figure 2 along with corresponding images of an electronic device.
  • Figure 4 is an isometric view of a machine employing methods and systems configured in accordance embodiments of the present technology for recycling mobile phones and/or other electronic devices.
  • Figures 5A-5D are a series of isometric views of the machine of Figure 4 with a number of exterior panels removed to illustrate operation of the machine in accordance with an embodiment of the present technology.
  • the following disclosure describes systems and methods for automated inspection and evaluation of electronic devices.
  • at least some embodiments of the present technology enable automatic detection of damage in the edge regions of electronic devices.
  • Typical crack-detection techniques e.g., edge detectors and similar image-processing algorithms
  • edge detectors may erroneously identify the outer perimeter of a device or the edge of the device's screen as cracks.
  • Embodiments of the present technology provide an approach for detecting cracks and other defects in edge regions of an electronic device by taking advantage of the general symmetry of most electronic devices. By comparing symmetrical portions of a device against one another, damage in these edge regions can be identified.
  • an image of a mobile device can be divided to retain an upper edge portion and a lower edge portion, where the upper and lower edge portions are generally symmetrical.
  • the lower edge portion of the image can be inverted, aligned with the symmetrical upper edge portion, and then subtracted from the upper edge portion.
  • the difference between the upper edge portion and the lower edge portion can indicate the presence of a defect such as a crack or chip in one of the upper and lower edge portions.
  • identical reference numbers may identify identical, or at least generally similar, elements. To facilitate the discussion of any particular element, the most significant digit or digits of any reference number may refer to the Figure in which that element is first introduced. For example, element 110 is first introduced and discussed with reference to Figure 1 .
  • FIG. 1 illustrates an embodiment of an environment 100 in which various aspects of the present technology can be implemented.
  • the environment 100 includes an imaging device 101 configured to obtain images and/or video of an electronic device 103 (e.g., a mobile phone, tablet, notebook, etc.).
  • the imaging device 101 is in communication with a computing device 105 and a database 107 via a communications link 109.
  • the imaging device 101 includes a processing component 1 1 1 , a memory 1 13, input and output components 1 15 and 1 17, and a power component 125.
  • the imaging device 101 further includes an image sensor 127, associated optics 129, and an illumination source 131 .
  • a communication component 1 19 of the imaging device 101 includes a wired connection 223 and a wireless transceiver 121 .
  • the computing device 105 can include several components similar to components of the imaging device 101 .
  • the computing device 105 can include a processing component 133, memory 135 (which can store an operating system 137, applications 139, and data 141 ), along with input 143 and output 145 components and a power component 153.
  • a communication component 147 of the computing device 105 includes a wired connection 151 and a wireless transceiver 147.
  • FIG. 2 is a flow diagram of a routine for detecting damage in edge regions of electronic devices in accordance with an embodiment of the present technology.
  • the routine 200 is performed by the computing device 105, which is described in more detail below.
  • the routine 200 receives an image of the electronic device 103.
  • the imaging device 101 can be used to obtain one or more images of the electronic device 103.
  • the images can be included in a video of the electronic device 103.
  • the imaging device 101 can be moved relative to the electronic device 103 or vice versa to obtain different views of the electronic device 103 on the video.
  • a similar approach can be taken using still images, such as by taking a number of still images with the imaging device 101 at different orientations relative to the electronic device 103.
  • the imaging device 101 and/or the electronic device 103 can be affixed to moveable components such as a moveable platform or mounting surface.
  • the moveable components can be controlled and moved using a belt drive, rack and pinion system, or other suitable drive system coupled to an electronic controller (e.g., the computing device 105).
  • the routine 200 can obtain various images of the electronic device 103 under different conditions, for example under different lighting conditions (e.g., no lights on, all lights on, only infrared illumination, etc.), under different operating conditions (e.g., with a display of the electronic device 103 in an "off" mode, with the display in an "on” mode, with the display presenting a predetermined image, etc.).
  • the routine 200 can obtain a single image of the electronic device 103 and/or images the electronic device 103 under a single condition.
  • the image or images obtained by the imaging device 101 can be transmitted to the computing device 105, such as via the communications link 109, for analysis and evaluation.
  • the routine 200 divides the image into segments, for example dividing the image along vertical and horizontal lines into a grid-like pattern.
  • the number of segments can vary, for example two, four, six, eight, or more segments.
  • the image of the electronic device is first rotated such that a long axis of the device is substantially horizontal.
  • the image is oriented differently, for example the long axis of the device can be vertical and the image can be divided along horizontal lines into segments.
  • the segments can be substantially evenly divided such that each segment has an identical or similar height and width. Alternatively, the size of each segment may vary.
  • the routine 200 pairs corresponding symmetrical segments.
  • the routine 200 can pair a first segment that includes a portion of a first peripheral region of an electronic device with a second segment that includes a portion of a second, opposite peripheral region of the electronic device.
  • the routine 200 inverts one of the segments for each pair. For example, for a given segment, the upper segment can be inverted with respect to the horizontal axis while the lower segment is not. Conversely, for a given pair, the lower segment can be inverted with respect to the horizontal axis while the upper segment is not.
  • the routine 200 compares each inverted segment with its corresponding non-inverted segment.
  • each inverted segment can first be aligned with its corresponding non-inverted segment by overlaying the two and adjusting their relative positions until a minimum difference (e.g., a minimum sum of absolute differences) is achieved. Once in this position, a difference can be calculated (e.g., a sum of absolute differences).
  • each pair of segments e.g., an upper segment and lower segment from the same pair
  • the routine 200 evaluates the resulting comparison for evidence of defects. If the difference calculated in block 209 exceeds some predetermined threshold, then a defect can be indicated in the corresponding region of the device. For example, if a given segment includes a crack, when the given segment is subtracted from an inverted segment that does not include a crack, the resulting difference will be due principally to the presence of the crack in a given segment the its absence of the crack in the other segment. Due to the general symmetry of electronic devices such as mobile phones, comparing edges in this manner allows asymmetrical defects to be detected even in edge regions where traditional crack-detection techniques fall short.
  • routine 200 is described with positional terms such as horizontal, vertical, left, and right, this approach can be applied with the image of the electronic device in any orientation.
  • the image can be oriented such that the long axis of the electronic device is aligned along the vertical axis.
  • the routine can proceed similar to that described above, with the appropriate changes throughout.
  • Figure 3 illustrates example images of an electronic device at various stages of the routine illustrated in Figure 2.
  • Image 301 is an image of the electronic device with damage 303 in an edge region.
  • the image 301 is divided along vertical lines 305a and 305b and along horizontal lines 307a and 307b to produce a plurality of segments.
  • the image 301 includes peripheral regions of the electronic device that fall outside of the line 309, and non-peripheral regions of the electronic device that fall inside of the line 309.
  • each segment in one of the pairs includes a peripheral region of the electronic device adjacent to the edge (i.e., a peripheral region that falls outside of line 309). As illustrated, the upper left segment 31 1 a includes the damage 303 in the peripheral region.
  • each inverted lower segment is subtracted from its non-inverted corresponding segment.
  • inverted segment 31 1 b is subtracted from segment 31 1 a
  • inverted segment 313b is subtracted from segment 313a
  • inverted segment 315b is subtracted from segment 315a.
  • Each inverted segment can first be aligned with its corresponding non-inverted segment by overlaying the two and adjusting their relative positions until a minimum difference is achieved. Once in this position, a difference can be calculated (e.g., a sum of absolute differences between segment 31 1 a and inverted segment 31 1 b).
  • difference 317a the result of subtracting segment 31 1 b from segment 31 1 a
  • difference 317b the result of subtracting segment 313b from segment 313a
  • difference 317c the result of subtracting segment 315b from segment 315a.
  • resulting intensity values indicate the presence of asymmetry in the compared edge regions of the device, and accordingly indicate likely damage in the edge region. For example, the damage 303 in segment 31 1 a is clearly indicated in difference 317a.
  • the outermost peripheral regions corresponding to the perimeter of the electronic device can be discarded so as to avoid misidentifying the actual perimeter of the electronic device as damaged.
  • the leftmost edge can be discarded within a predetermined distance or number of pixels in order to exclude the physical perimeter of the electronic device.
  • the right-most segments 315a and 315b (and the calculated difference 317c)
  • the rightmost edge can be discarded within a predetermined distance or number of pixels in order to exclude the physical perimeter of the electronic device.
  • the uppermost edge can be discarded to exclude the upper perimeter (for non-inverted segments) and lower perimeter (for inverted segments) of the electronic device.
  • the imaging device 101 can be, for example, a digital camera (e.g. , having a CCD or CMOS sensor) capable of capturing still and/or moving images of the electronic device 103, and transmitting captured images over the communications link 109 to remote devices.
  • the imaging device 101 includes a camera and an associated fixture, base, or other imaging area in which the electronic device 103 is to be placed for imaging. This can provide a standard background against which the images and/or video of the electronic device 103 are obtained.
  • the imaging device 101 can be configured to move the camera and/or the associated optics in order to capture images and/or video of the electronic device 103 from various angles.
  • the imaging device 101 can also include an illumination source (e.g., LEDs, fluorescent bulbs, lamps, etc.) which can also aid in obtaining images of the electronic device 103 under uniform lighting conditions.
  • an illumination source e.g., LEDs, fluorescent bulbs, lamps, etc.
  • the electronic device 103 can be, for example, a smartphone, a tablet, a laptop, a handheld gaming device, a media player, or any such device that has a screen or other surface that may suffer cracks or similar defects.
  • a smartphone a tablet
  • a laptop a handheld gaming device
  • media player or any such device that has a screen or other surface that may suffer cracks or similar defects.
  • Such devices include, as non-limiting examples, all manner of mobile phones; smartphones; handheld devices; personal digital assistants (PDAs); MP3 or other digital music players; tablet, notebook, ultrabook and laptop computers; e-readers; all types of cameras; GPS devices; set-top boxes and other media players; VoI P phones; universal remote controls; wearable computers; and larger consumer electronic devices, such as desktop computers, TVs, projectors, DVRs, game consoles, etc.
  • PDAs personal digital assistants
  • MP3 or other digital music players tablet, notebook, ultrabook and laptop computers
  • e-readers all types of cameras
  • GPS devices set-top boxes and other media players
  • VoI P phones universal remote controls
  • wearable computers and larger consumer electronic devices, such as desktop computers, TVs, projectors, DVRs, game consoles, etc.
  • the computing device 105 can be a desktop computer or another suitable device.
  • the computing device 105 is configured to receive images of the electronic device 103 from the imaging device 101 and to automatically analyze the images to detect asymmetrical damage other defects.
  • the computing device 105 is remote from the imaging device 101 and can be in communication via the communications link 109.
  • the computing device 105 is connected to the imaging device 101 via a hardwire connection, or in certain embodiments the imaging device 101 and the computing device 105 are integrated into the same machine.
  • the computing device 105 is also in communication with the database 107 which can store data used in automatically analyzing the images of the electronic device 103.
  • the database 107 may also store the results of the automatic analysis of the images, other data about the electronic device 103, etc.
  • various devices including the imaging device 101 and the computing device 105 can exchange information with one another via the communication link 109.
  • the communication link 109 can include a publicly available network (e.g., the Internet with a web interface), a private communication link, such as an intranet or other network can also be used.
  • the imaging device 101 is connected to a host computer (not shown) that facilitates the exchange of information between the imaging device 101 , the computing device 105, remote computers, mobile devices, etc.
  • the imaging device 101 includes the processing component 1 1 1 that controls operation of the imaging device 101 in accordance with computer-readable instructions stored in memory 1 13.
  • the processing component 1 1 1 may include any logic processing unit, such as one or more central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc.
  • the processing component 1 1 1 may be a single processing unit or multiple processing units in an electronic device or distributed across multiple devices. Aspects of the present technology can be embodied in a special purpose computing device or data processor that is specifically programmed, configured, or constructed to perform one or more of the computer-executable instructions explained in detail herein.
  • aspects of the present technology can also be practiced in distributed computing environments in which functions or modules are performed by remote processing devices that are linked through a communications network, such as a local area network (LAN), wide area network (WAN), or the Internet.
  • modules can be located in both local and remote memory storage devices.
  • the processing component 1 1 1 is connected to memory 1 13, which can include a combination of temporary and/or permanent storage, and both read-only memory (ROM) and writable memory (e.g., random access memory or RAM), writable non-volatile memory such as flash memory or other solid-state memory, hard drives, removable media, magnetically or optically readable discs, nanotechnology memory, biological memory, and so forth. As used herein, memory does not include a transitory propagating signal per se.
  • the memory 213 includes data storage that contains programs, software, and information, such as an operating system and data. Imaging device 101 operating system and data can include software and databases configured to control imaging device 101 components, process images, communicate and exchange data and information with remote computers and other devices, etc.
  • the imaging device 101 further includes input components 1 15 that can receive input from user interactions and provide input to the processing component 1 1 1 , typically mediated by a hardware controller that interprets the raw signals received from the input device and communicates the information to the processing component 1 1 1 using a known communication protocol.
  • Examples of an input component 1 15 include touchpad, a keyboard (with physical or virtual keys), a pointing device (such as a mouse, dial, or eye tracking device), a touchscreen that detects contact events when it is touched by a user, a microphone that receives audio input, etc.
  • the imaging device 101 can also include various other input components 1 15 such as GPS or other location determination sensors, motion sensors, wearable input devices with accelerometers (e.g. wearable glove-type input devices), biometric sensors (e.g., fingerprint sensors), light sensors, card readers (e.g., magnetic stripe readers or memory card readers) or the like.
  • the processing component 1 1 1 is also connected to one or more various output components 1 17, e.g., directly or via a hardware controller.
  • the output devices can include a display on which text and graphics are displayed.
  • the display can be, for example, an LCD, LED, or OLED display screen, an e-ink display, a projected display (such as a heads-up display device), and/or a display integrated with a touchscreen that serves as an input device as well as an output device that provides graphical and textual visual feedback to a user.
  • the output components 1 17 can also include a speaker for playing audio signals, haptic feedback devices for tactile output such as vibration, etc. In some implementations, a speaker and microphone are implemented by a combined audio input-output device.
  • the imaging device 101 further includes one or more communication components 1 19.
  • the communication components can include, for example, a wireless transceiver 121 (e.g., one or more of a Wi-Fi transceiver; Bluetooth transceiver; near-field communication (NFC) device; wireless modem or cellular radio utilizing GSM, CDMA, 3G and/or 4G technologies; etc.) and/or a wired network connection 123 (e.g., one or more of an Ethernet port, cable modem, FireWire cable, Lightning connector, universal serial bus (USB) port, etc.).
  • a wireless transceiver 121 e.g., one or more of a Wi-Fi transceiver; Bluetooth transceiver; near-field communication (NFC) device; wireless modem or cellular radio utilizing GSM, CDMA, 3G and/or 4G technologies; etc.
  • a wired network connection 123 e.g., one or more of an Ethernet port, cable modem, FireWire cable, Lightning connector,
  • the communication components 1 19 are suitable for communication between the imaging device 101 and other local and/or remote devices, e.g., the computing device 105, directly via a wired or wireless peer-to-peer connection and/or indirectly via the communication link 109 (which can include the Internet, a public or private intranet, a local or extended Wi-Fi network, cell towers, the plain old telephone system (POTS), etc.).
  • the wireless transceiver 121 of the imaging device 101 can connect to a wireless transceiver 149 of the computing device via the wireless connection.
  • the imaging device 101 further includes power 125, which can include battery power and/or facility power for operation of the various electrical components associated with the imaging device 101 .
  • the imaging device 101 further includes the image sensor 127, optics 129, and illumination source 131 .
  • the image sensor 127 can be, for example, a CCD sensor, a CMOS sensor, or any other type of image sensor or array of sensors.
  • the image sensor 127 can be aligned with optics 129, for example one or more lenses, filters, or other optical elements configured to orient and modulate incoming light before it reaches the image sensor 127.
  • the illumination source 131 can be configured to direct illumination towards the field of view of the imaging device 101 , and can be any type of light source, for example LEDs, fluorescent bulbs, etc. In some embodiments, the illumination source 131 includes multiple different types of light sources which can be individually activated, for example infrared, ultraviolet, broadband, etc.
  • the computing device 105 includes several components similar to those in the imaging device 101 .
  • the computing device 105 includes a processing component 133 that controls operation of the computing device 105 in accordance with computer-readable instructions stored in memory 135.
  • the processing component 133 may be any logic processing unit, such as one or more central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc.
  • the processing component 133 may be a single processing unit or multiple processing units in an electronic device or distributed across multiple devices.
  • the processing component 133 is connected to memory 135, which includes data storage that contains programs, software, and information, such as an operating system 137, application programs 139, and data 141 .
  • the operating system 137 can include, for example, Windows®, Linux®, AndroidTM, iOS®, and/or an embedded real-time operating system.
  • the application programs 139 and data 141 can include software and databases configured to control computing device 105 components, process and evaluate images received from the imaging device 101 , communicate and exchange data and information with remote computers and other devices, etc.
  • the computing device 105 can include input components 143, such as a keyboard (with physical or virtual keys), a pointing device (such as a mouse, joystick, dial, or eye tracking device), a touchscreen, a microphone, and a camera for still photograph and/or video capture.
  • the computing device 105 can also include various other input components 143 such as GPS or other location determination sensors, motion sensors, wearable input devices with accelerometers (e.g. wearable glove-type input devices), biometric sensors (e.g. , fingerprint sensors), light sensors, card readers (e.g. , magnetic stripe readers or memory card readers) and the like.
  • the processing component 133 can also be connected to one or more various output components 145, e.g., directly or via a hardware controller.
  • the output devices can include a display such as an LCD, LED, or OLED display screen (such as a desktop computer screen, handheld device screen, or television screen), an e-ink display, a projected display (such as a heads-up display device), and/or a display integrated with a touchscreen that serves as an input device as well as an output device that provides graphical and textual visual feedback to the user.
  • the output devices can also include a speaker for playing audio signals, haptic feedback devices for tactile output such as vibration, etc.
  • computing device 105 further includes one or more communication components 147.
  • the communication components can include, for example, a wireless transceiver 149 (e.g., one or more of a Wi-Fi transceiver; Bluetooth transceiver; near-field communication (NFC) device; wireless modem or cellular radio utilizing GSM, CDMA, 3G and/or 4G technologies; etc.) and/or a wired network connector port 251 (e.g. , one or more of an Ethernet port, cable modem, FireWire cable, Lightning connector, universal serial bus (USB) port, etc.).
  • a wireless transceiver 149 e.g., one or more of a Wi-Fi transceiver; Bluetooth transceiver; near-field communication (NFC) device; wireless modem or cellular radio utilizing GSM, CDMA, 3G and/or 4G technologies; etc.
  • a wired network connector port 251 e.g. , one or more of an Ethernet port, cable modem, FireWire
  • the communication components 147 are suitable for communication between the computing device 105 and other local and/or remote computing devices, e.g., the imaging device 101 a via a wired or wireless peer-to-peer connection and/or indirectly via the communication link 109.
  • the wireless transceiver 149 of the computing device 105 can connect to the wireless transceiver 121 of imaging device 101
  • the wired connector port 151 of the computing device 105 can connect to the wired connector port 123 of the imaging device 101 .
  • the computing device 105 further includes power 153, which can include battery power and/or facility power for operation of the various electrical components associated with the computing device 105.
  • the computing device 105 and the imaging device 101 include other features that may be different from those described above.
  • the computing device 105 and/or the imaging device 101 include more or fewer features similar to those described above.
  • the routines described herein can be carried out using a kiosk that includes an imaging device (e.g. , the imaging device 101 ) therein.
  • the kiosk can perform some or all of the functions performed by the computing device 105 described above, for example processing and evaluating images received from the imaging device 101 .
  • the kiosk can include, for example, a processing component and memory storing instructions that, when executed by the processing component, perform operations such as the routine 200 described above.
  • Figure 4 for example, is an isometric view of a kiosk 400 for recycling and/or other processing of mobile phones and other consumer electronic devices in accordance with the present technology.
  • processing is used herein for ease of reference to generally refer to all manner of services and operations that may be performed or facilitated by the kiosk 400 on, with, or otherwise in relation to an electronic device.
  • Such services and operations can include, for example, selling, reselling, recycling, donating, exchanging, identifying, evaluating, pricing, auctioning, decommissioning, transferring data from or to, reconfiguring, refurbishing, etc., mobile phones and other electronic devices.
  • selling, reselling, recycling, donating, exchanging, identifying, evaluating, pricing, auctioning, decommissioning, transferring data from or to, reconfiguring, refurbishing, etc. mobile phones and other electronic devices.
  • Such devices include, as non-limiting examples, all manner of mobile phones, smart phones, handheld devices, PDAs, MP3 players, tablet, notebook and laptop computers, e-readers, cameras, etc.
  • the kiosk 400 can facilitate selling and/or otherwise processing larger consumer electronic devices, such as desktop computers, TVs, game consoles, etc., as well smaller electronic devices such as Google GlassTM, smart-watches, etc.
  • the kiosk 400 is a floor-standing self-service kiosk configured for use by a user 401 (e.g. , a consumer, customer, etc.) to recycle, sell, and/or perform other operations with a mobile phone or other consumer electronic device.
  • the kiosk 400 can be configured for use on a countertop or a similar raised surface.
  • the kiosk 400 is configured for use by consumers, in various embodiments the kiosk 400 and/or various portions thereof can also be used by other operators, such as a retail clerk or kiosk assistant to facilitate the selling or other processing of mobile phones and other electronic devices.
  • the kiosk 400 includes a housing 402 that is approximately the size of a conventional vending machine.
  • the housing 402 can be of conventional manufacture from, for example, sheet metal, plastic panels, etc.
  • a plurality of user interface devices are provided on a front portion of the housing 402 for providing instructions and other information to users, and/or for receiving user inputs and other information from users.
  • the kiosk 400 can include a display screen 404 (e.g., a liquid crystal display (“LCD”) or light emitting diode (“LED”) display screen, a projected display (such as a heads-up display or a head- mounted device), and so on) for providing information, prompts, etc., to users.
  • LCD liquid crystal display
  • LED light emitting diode
  • a projected display such as a heads-up display or a head- mounted device
  • the display screen 404 can include a touch screen for receiving user input and responses to displayed prompts.
  • the kiosk 400 can include a separate keyboard or keypad for this purpose.
  • the kiosk 400 can also include an ID reader or scanner 412 (e.g., a driver's license scanner), a fingerprint reader 414, and one or more cameras 416 (e.g., digital still and/or video cameras, identified individually as cameras 416a-c).
  • the kiosk 400 can additionally include output devices such as a label printer having an outlet 410, and a cash dispenser having an outlet 418.
  • the kiosk 400 can further include a speaker and/or a headphone jack for audibly communicating information to users, one or more lights for visually communicating signals or other information to users, a handset or microphone for receiving verbal input from the user, a card reader (e.g., a credit/debit card reader, loyalty card reader, etc.), a receipt or voucher printer and dispenser, as well as other user input and output devices.
  • the input devices can include a touchpad, pointing device such as a mouse, joystick, pen, game pad, motion sensor, scanner, eye direction monitoring system, etc.
  • the kiosk 400 can also include a bar code reader, QR code reader, bag/package dispenser, a digital signature pad, etc.
  • the kiosk 400 additionally includes a header 420 having a display screen 422 for displaying marketing advertisements and/or other video or graphical information to attract users to the kiosk.
  • the front portion of the housing 402 also includes an access panel or door 406 located directly beneath the display screen 404.
  • the access door is configured to automatically retract so that the user 401 can place an electronic device (e.g., a mobile phone) in an inspection area 408 for automatic inspection by the kiosk 400.
  • a sidewall portion of the housing 402 can include a number of conveniences to help users recycle or otherwise process their mobile phones.
  • the kiosk 400 includes an accessory bin 428 that is configured to receive mobile device accessories that the user wishes to recycle or otherwise dispose of. Additionally, the kiosk 400 can provide a free charging station 426 with a plurality of electrical connectors 424 for charging a wide variety of mobile phones and other consumer electronic devices.
  • Figures 5A-5D are a series of isometric views of the kiosk 400 with the housing 402 removed to illustrate selected internal components configured in accordance with an embodiment of the present technology.
  • the kiosk 400 includes a connector carrier 540 and an inspection plate 544 operably disposed behind the access door 406 ( Figure 4).
  • the connector carrier 540 is a rotatable carrousel that is configured to rotate about a generally horizontal axis and carries a plurality of electrical connectors 542 (e.g., approximately 25 connectors) distributed around an outer periphery thereof.
  • electrical connectors 542 e.g., approximately 25 connectors
  • other types of connector carrying devices can be used.
  • the connectors 542 includes a plurality of interchangeable USB connectors configured to provide power and/or exchange data with a variety of different mobile phones and/or other electronic devices.
  • the connector carrier 540 is configured to automatically rotate about its axis to position an appropriate one of the connectors 542 adjacent to an electronic device, such as a mobile phone 550, that has been placed on the inspection plate 544 for recycling.
  • the connector 542 can then be manually and/or automatically withdrawn from the connector carrier 540 and connected to a port on the mobile phone 550 for electrical analysis.
  • Such analysis can include, e.g., an evaluation of the make, model, configuration, condition, etc.
  • the inspection plate 544 is configured to translate back and forth (on, e.g., parallel mounting tracks) to move an electronic device, such as the mobile phone 550, between a first position directly behind the access door 406 and a second position between an upper chamber 530 and an opposing lower chamber 532.
  • the inspection plate 544 is transparent, or at least partially transparent (e.g., formed of glass, Plexiglas, etc.) to enable the mobile phone 550 to be photographed and/or otherwise optically evaluated from all, or at least most viewing angles (e.g., top, bottom, sides, etc.) using, e.g., one or more cameras, mirrors, etc.
  • the upper chamber 530 can translate downwardly to generally enclose the mobile phone 550 between the upper chamber 530 and the lower chamber 532.
  • the upper chamber 530 is operably coupled to a gate 538 that moves up and down in unison with the upper chamber 530.
  • the kiosk 400 includes the imaging device 101 disposed within the upper hood 530.
  • the imaging device 101 can be used as described above to facilitate visual inspection of the mobile phone 550 in order to detect the presence of asymmetrical damage to the mobile phone 550.
  • the upper chamber 530 and/or the lower chamber 532 can also include one or more magnification tools, scanners (e.g., bar code scanners, infrared scanners, etc.) or other imaging components (not shown) and an arrangement of mirrors (also not shown) to view, photograph and/or otherwise visually evaluate the mobile phone 550 from multiple perspectives.
  • one or more of the cameras and/or other imaging components discussed above can be movable to facilitate device evaluation.
  • the imaging device 101 can be affixed to a moveable mechanical component such as an arm, which in turn can be moved using a belt drive, rack and pinion system, or other suitable drive system coupled to an electronic controller (e.g. , the computing device 105).
  • the inspection area 408 can also include weight scales, heat detectors, UV readers/detectors, and the like, for further evaluation of electronic devices placed therein.
  • the kiosk 400 can further include an angled binning plate 536 for directing electronic devices from the transparent plate 544 into a collection bin 534 positioned in a lower portion of the kiosk 400.
  • the kiosk 400 can be used in a number of different ways to efficiently facilitate the recycling, selling and/or other processing of mobile phones and other consumer electronic devices.
  • a user wishing to sell a used mobile phone such as the mobile phone 550, approaches the kiosk 400 and identifies the type of device the user wishes to sell in response to prompts on the display screen 404.
  • the user may be prompted to remove any cases, stickers, or other accessories from the device so that it can be accurately evaluated.
  • the kiosk 400 may print and dispense a unique identification label (e.g., a small adhesive-backed sticker with a quick response code (“QR code”), barcode, or other machine-readable indicia, etc.) from the label outlet 410 for the user to adhere to the back of the mobile phone 550.
  • a unique identification label e.g., a small adhesive-backed sticker with a quick response code (“QR code”), barcode, or other machine-readable indicia, etc.
  • QR code quick response code
  • the door 406 retracts and opens allowing the user to place the mobile phone 550 onto the transparent plate 544 in the inspection area 408 ( Figure 5A).
  • the door 406 then closes and the transparent plate 544 moves the mobile phone 550 under the upper chamber 530 as shown in Figure 5B.
  • the upper chamber 530 then moves downwardly to generally enclose the mobile phone 550 between the upper and lower chambers 530 and 532, and the cameras and/or other imaging components in the upper and lower chambers 530 and 532 perform a visual inspection of the mobile phone 550.
  • the visual inspection of the mobile phone 550 includes performing the routine 200 ( Figure 2) to detect damage to the mobile phone 550.
  • the visual inspection includes a computer-implemented visual analysis (e.g., a three-dimensional ("3D") analysis) performed by a processing device within the kiosk (e.g., a CPU) to confirm the identification of the mobile phone 550 (e.g.
  • a processing device within the kiosk e.g., a CPU
  • the visual analysis can include computer-implemented evaluation (e.g., a digital comparison) of images of the mobile phone 550 taken from top, side and/or end view perspectives to determine length, width, and/or height (thickness) dimensions of the mobile phone 550.
  • the visual analysis can further include a computer-implemented inspection of a display screen on the mobile phone 550 to check for, e.g., cracks in the glass and/or other damage or defects in the LCD (e.g., defective pixels, etc.).
  • the upper chamber 530 returns to its upper position and the transparent plate 544 returns the mobile phone 550 to its initial position near the door 406.
  • the display screen 404 can also provide an estimated price, or an estimated range of prices, that the kiosk 400 may offer the user for the mobile phone 550 based on the visual analysis, and/or based on user input (e.g. , input regarding the type, condition, etc. of the phone 550). If the user indicates (via, e.g., input via the touch screen) that they wish to proceed with the transaction, the connector carrier 540 automatically rotates an appropriate one of the connectors 542 into position adjacent the transparent plate 544, and door 406 is again opened.
  • the user can then be instructed (via, e.g., the display screen 404) to withdraw the selected connector 542 (and its associated wire) from the carrousel 540, plug the connector 542 into the corresponding port (e.g., a USB port) on the mobile phone 550, and reposition the mobile phone 550 in the inspection area on the transparent plate 544.
  • the door 406 once again closes and the kiosk 400 (e.g. the kiosk CPU) performs an electrical inspection of the device via the connector 542 to further evaluate the condition of the phone as well as specific component and operating parameters such as the memory, carrier, etc.
  • the electrical inspection can include a determination of phone manufacturer information (e.g., a vendor identification number or VID) and product information (e.g., a product identification number or PID).
  • the kiosk 400 can perform the electrical analysis using one or more of the methods and/or systems described in detail in the commonly owned patents and patent applications identified herein and incorporated by reference in their entireties.
  • the user After the visual and electronic analysis of the mobile phone 550, the user is presented with a phone purchase price via the display screen 404. If the user declines the price (via, e.g., the touch screen), a retraction mechanism (not shown) automatically disconnects the connector 542 from the mobile phone 550, the door 406 opens, and the user can reach in and retrieve the mobile phone 550. If the user accepts the price, the door 406 remains closed and the user may be prompted to place his or her identification (e.g. , a driver's license) in the ID scanner 412 and provide a thumbprint via the fingerprint reader 414.
  • his or her identification e.g. , a driver's license
  • the kiosk 400 can be configured to transmit an image of the driver's license to a remote computer screen, and an operator at the remote computer can visually compare the picture (and/or other information) on the driver's license to an image of the person standing in front of the kiosk 400 as viewed by one or more of the cameras 416a-c ( Figure 4) to confirm that the person attempting to sell the phone 550 is in fact the person identified by the driver's license.
  • one or more of the cameras 416a-c can be movable to facilitate viewing of kiosk users, as well as other individuals in the proximity of the kiosk 400. Additionally, the person's fingerprint can be checked against records of known fraud perpetrators.
  • the transaction can be declined and the mobile phone 550 returned.
  • the transparent plate 544 moves back toward the upper and lower chambers 530 and 532. As shown in Figure 5D, however, when the upper chamber 530 is in the lower position the gate 538 permits the transparent plate 544 to slide underneath but not electronic devices carried thereon. As a result, the gate 538 knocks the mobile phone 550 off of the transparent plate 544, onto the binning plate 536 and into the bin 534.
  • the kiosk can then provide payment of the purchase price to the user. In some embodiments, payment can be made in the form of cash dispensed from the cash outlet 418.
  • the user can receive remuneration for the mobile phone 550 in various other useful ways.
  • the user can be paid via a redeemable cash voucher, a coupon, an e- certificate, a prepaid card, a wired or wireless monetary deposit to an electronic account (e.g., a bank account, credit account, loyalty account, online commerce account, mobile wallet etc.), Bitcoin, etc.
  • an electronic account e.g., a bank account, credit account, loyalty account, online commerce account, mobile wallet etc.
  • the foregoing routines are but some examples of ways in which the kiosk 400 can be used to recycle or otherwise process consumer electronic devices such as mobile phones.
  • the kiosk 400 and various embodiments thereof can also be used in a similar manner for recycling virtually any consumer electronic device, such as MP3 players, tablet computers, PDAs, and other portable devices, as well as other relatively non-portable electronic devices such as desktop computers, printers, devices for implementing games, entertainment or other digital media on CDs, DVDs, Blu-ray, etc.
  • the kiosk 400 in various embodiments thereof can similarly be used by others, such as a store clerk, to assist consumers in recycling, selling, exchanging, etc. their electronic devices.
  • the disclosed technology also includes the disclosures of U.S. patent application number 14/498,763, titled “METHODS AND SYSTEMS FOR PRICING AND PERFORMING OTHER PROCESSES ASSOCIATED WITH RECYCLING MOBI LE PHONES AND OTHER ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8024. US00, filed by the applicant on September 26, 2014; U.S. patent application number 14/500,739, titled “MAINTAINING SETS OF CABLE COMPONENTS USED FOR WI RED ANALYSIS, CHARGING, OR OTHER INTERACTION WITH PORTABLE ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8025.
  • patent application number 14/506,449 titled “SYSTEM FOR ELECTRICALLY TESTING MOBI LE DEVICES AT A CONSUMER-OPERATED KIOSK, AND ASSOCIATED DEVICES AND METHODS," attorney docket number 1 1 1220-8035.US00, filed by the applicant on October 3, 2014;
  • U.S. patent application number 14/925,357 titled “SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8027. US01 , filed by the applicant on October 28, 2015;
  • patent application number 14/925,375 titled “METHODS AND SYSTEMS FOR FACILITATING PROCESSES ASSOCIATED WITH INSURANCE SERVICES AND/OR OTHER SERVICES FOR ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8028. US01 , filed by the applicant on October 28, 2015; U.S. patent application number 14/964,963, titled “METHODS AND SYSTEMS FOR PROVI DI NG INFORMATION REGARDING COUPONS/PROMOTIONS AT KIOSKS FOR RECYCLING MOBI LE PHONES AND OTHER ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8031 . US01 , filed by the applicant on December 10, 2015; U.S.
  • patent application number 14/568,051 titled “METHODS AND SYSTEMS FOR IDENTIFYING MOBILE PHONES AND OTHER ELECTRONIC DEVICES,” attorney docket number 1 1 1220- 8033. US00, filed by the applicant on December 1 1 , 2014; U.S. patent application number 14/966,346, titled “SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES,” attorney docket number 1 1 1220- 8037. US01 , filed by the applicant on December 1 1 , 2015; U.S.
  • patent application number 14/598,469 titled “METHODS AND SYSTEMS FOR DYNAMIC PRICING AND PERFORMING OTHER PROCESSES ASSOCIATED WITH RECYCLING MOBILE PHONES AND OTHER ELECTRONIC DEVICES," attorney docket number 1 1 1220-8034. US00, filed by the applicant on January 16, 2015; U.S. patent application number 14/660,768, titled “SYSTEMS AND METHODS FOR INSPECTING MOBILE DEVICES AND OTHER CONSUMER ELECTRONIC DEVICES WITH A LASER,” attorney docket number 1 1 1220-8030. US00, filed by the applicant on March 17, 2015; U.S.
  • patent application number 14/663,331 titled “DEVICE RECYCLING SYSTEMS WITH FACIAL RECOGNITION,” attorney docket number 1 1 1220-8029. US00, filed by the applicant on March 19, 2015; U.S. provisional application number 62/169,072, titled “METHODS AND SYSTEMS FOR VISUALLY EVALUATING ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8041 . USOO, filed by the applicant on June 1 , 2015; U.S.
  • provisional application number 62/202,330 titled “METHODS AND SYSTEMS FOR INSPECTING MOBILE DEVICES AND OTHER CONSUMER ELECTRONIC DEVICES WITH ROBOTIC ACTUATION,” attorney docket number 1 1 1220- 8026. USOO, filed by the applicant on August 7, 2015; U.S. patent application number 15/057,707, titled “METHODS AND SYSTEMS FOR RECORDING INTERACTIONS WITH A SYSTEM FOR PURCHASING MOBILE PHONES AND OTHER ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8032. US01 , filed by the applicant on March 1 , 2016; U.S.
  • patent application number 14/873, 158 titled “WIRELESS-ENABLED KIOSK FOR RECYCLING CONSUMER DEVICES,” attorney docket number 1 1 1220-8022. US01 , filed by the applicant on October 1 , 2015;
  • U.S. patent application number 14/873, 145 titled “APPLICATION FOR DEVICE EVALUATION AND OTHER PROCESSES ASSOCIATED WITH DEVICE RECYCLING,” attorney docket number 1 1 1220-8023.US01 , filed by the applicant on October 1 , 2015;
  • patent application number 14/925,357 titled “SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8027.US01 , filed by the applicant on October 28, 2015;
  • U.S. patent application number 14/925,375 titled “METHODS AND SYSTEMS FOR FACILITATING PROCESSES ASSOCIATED WITH INSURANCE SERVICES AND/OR OTHER SERVICES FOR ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8028. US01 , filed by the applicant on October 28, 2015; U.S.
  • patent application number 14/934, 134 titled “METHODS AND SYSTEMS FOR EVALUATING AND RECYCLING ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8038. US01 ; and U.S. patent application number 14/967, 183, titled “SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES,” attorney docket number 1 1 1220-8048.US00, filed December 1 1 , 2015, each of which is incorporated herein by reference in its entirety. All of the patents and patent applications listed above are commonly owned by the applicant of the present application, and they along with any other patents or patent applications identified herein are incorporated herein by reference in their entireties.
  • a private network such as an intranet may likewise be used herein.
  • the network may have a client-server architecture, in which a computer is dedicated to serving other client computers, or it may have other architectures such as peer-to-peer, in which one or more computers serve simultaneously as servers and clients.
  • a database or databases coupled to the server computer(s), stores much of the web pages and content exchanged between the user computers.
  • the server computer(s), including the database(s) may employ security measures to inhibit malicious attacks on the system and preserve the integrity of the messages and data stored therein (e.g., firewall systems, message encryption and/or authentication (e.g. , using transport layer security (TLS) or secure socket layers (SSL)), password protection schemes, encryption of stored data (e.g., using trusted computing hardware), and the like).
  • TLS transport layer security
  • SSL secure socket layers
  • a display description may be in HTML, XML or WAP format, email format or any other format suitable for displaying information (including character/code-based formats, algorithm-based formats (e.g., vector generated), and bitmapped formats).
  • various communication channels such as local area networks, wide area networks, or point-to-point dial-up connections, may be used instead of the Internet.
  • the system may be conducted within a single computer environment, rather than a client/server environment.
  • the user computers may comprise any combination of hardware or software that interacts with the server computer, such as television-based systems and various other consumer products through which commercial or noncommercial transactions can be conducted.
  • the various aspects of the invention described herein can be implemented in or for any e-mail environment.
  • aspects of the invention are described in the general context of computer-executable instructions, such as routines executed by a general-purpose data processing device, e.g. , a server computer, wireless device or personal computer.
  • a general-purpose data processing device e.g. , a server computer, wireless device or personal computer.
  • PDAs personal digital assistants
  • wearable computers all manner of cellular or mobile phones (including Voice over IP (VoIP) phones), dumb terminals, media players, gaming devices, multi-processor systems, microprocessor-based or programmable consumer electronics, set-top boxes, network PCs, mini-computers, mainframe computers, and the like.
  • PDAs personal digital assistants
  • VoIP Voice over IP
  • dumb terminals media players, gaming devices, multi-processor systems, microprocessor-based or programmable consumer electronics, set-top boxes, network PCs, mini-computers, mainframe computers, and the like.
  • Input devices may include a touchpad, keyboard and/or a pointing device such as a mouse. Other input devices are possible such as a microphone, joystick, pen, game pad, scanner, digital camera, video camera, and the like.
  • the data storage devices may include any type of computer-readable media that can store data accessible by a computer, such as magnetic hard and floppy disk drives, optical disk drives, magnetic cassettes, tape drives, flash memory cards, digital video disks (DVDs), Bernoulli cartridges, RAMs, ROMs, smart cards, etc. Indeed, any medium for storing or transmitting computer-readable instructions and data may be employed, including a connection port to a network such as a local area network (LAN), wide area network (WAN) or the Internet.
  • LAN local area network
  • WAN wide area network
  • the Internet the Internet
  • aspects of the invention can be embodied in a special purpose computer or data processor that is specifically programmed, configured, or constructed to perform one or more of the computer-executable instructions explained in detail herein. While aspects of the invention, such as certain functions, are described as being performed exclusively on a single device, the invention can also be practiced in distributed environments where functions or modules are shared among disparate processing devices, which are linked through a communications network, such as a Local Area Network (LAN), Wide Area Network (WAN), or the Internet. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
  • LAN Local Area Network
  • WAN Wide Area Network
  • program modules may be located in both local and remote memory storage devices.
  • aspects of the invention may be stored or distributed on tangible computer- readable media, including magnetically or optically readable computer discs, hardwired or preprogrammed chips (e.g., EEPROM semiconductor chips), nanotechnology memory, biological memory, or other data storage media.
  • the data storage devices may include any type of computer-readable media that can store data accessible by a computer, such as magnetic hard and floppy disk drives, optical disk drives, magnetic cassettes, tape drives, flash memory cards, DVDs, Bernoulli cartridges, RAM, ROMs, smart cards, etc. Indeed, any medium for storing or transmitting computer-readable instructions and data may be employed, including a connection port to a network such as a LAN, WAN, or the Internet.
  • computer implemented instructions, data structures, screen displays, and other data under aspects of the invention may be distributed over the Internet or over other networks (including wireless networks), on a propagated signal on a propagation medium (e.g., an electromagnetic wave(s), a sound wave, etc.) over a period of time, or they may be provided on any analog or digital network (packet switched, circuit switched, or other scheme).
  • a propagation medium e.g., an electromagnetic wave(s), a sound wave, etc.
  • packet switched, circuit switched, or other scheme packet switched, circuit switched, or other scheme.
  • the terms “memory” and "computer-readable storage medium” include any combination of temporary, persistent, and/or permanent storage, e.g., ROM, writable memory such as RAM, writable non-volatile memory such as flash memory, hard drives, solid state drives, removable media, and so forth, but do not include a propagating signal per se.
  • a method for detecting damage to an electronic device comprising:
  • comparing the first portion of the image with the inverted second portion of the image includes subtracting one of the first and second portions of the image from the other of the first and second portions of the image.
  • any one of examples 1 -2 further comprising dividing the image into a grid of segments, the grid including rows of the segments parallel to a long axis of the electronic device and columns of the segments parallel to a short axis of the electronic device, wherein comparing the first portion of the image with the inverted second portion of the image includes comparing a first one of the segments with an inverted second one of the segments. 4. The method of example 3 wherein the first and second segments are within the same column of the grid.
  • comparing the first portion of the image with the inverted second portion of the image comprises:
  • comparing the first portion of the image with the inverted second portion of the image comprises calculating a sum of absolute differences between overlapping pixels of the first portion of the image and the inverted second portion of the image.
  • evaluating the condition of the electronic device comprises determining whether the calculated sum of absolute differences exceeds a predetermined threshold.
  • a method for detecting damage to an electronic device comprising:
  • each of the compared segments in the first set is in the same row of the grid as the corresponding inverted segment in the second set.
  • each of the compared segments in the first set is in the same column of the grid as the corresponding inverted segment in the second set. 16. The method of any one of examples 13-15 wherein comparing the segments in the first set to corresponding inverted segments in the second set comprises:
  • comparing the segments in the first set to corresponding inverted segments in the second set comprises calculating a sum of absolute differences between overlapping pixels of the segments in the first set and the corresponding inverted segments in the second set.
  • a computer-readable memory carrying computer-executable instructions for causing one or more processors to facilitate detecting damage to an electronic device, the computer-executable instructions comprising instructions that, when executed by the one or more processors:
  • comparing the first portion of the image with the inverted second portion of the image includes comparing a first one of the segments with an inverted second one of the segments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

Systems and methods for detecting the asymmetrical damage to electronic devices are disclosed. In one embodiment, the method includes obtaining an image of a front side of an electronic device and comparing a first portion of the image with an inverted second portion of the image. The first portion of the image includes a first edge of the electronic device and the second portion of the image includes a second, opposite edge of the electronic device. Based on the comparison, a condition of the electronic device is evaluated.

Description

METHODS AND SYSTEMS FOR DETECTING DAMAGE IN EDGE
REGIONS OF MOBILE ELECTRONIC DEVICES
TECHNICAL FIELD
[0001 ] The present disclosure is directed generally to methods and systems for evaluating mobile phones and other consumer electronic devices and, more particularly, to methods and systems associated with detecting damage in edge regions of such devices.
BACKGROUND
[0002] It is often necessary to visually evaluate a screen of a mobile device (e.g., a smartphone or tablet) to identify cracks or other defects in the mobile device. For example, pricing the mobile device, assessing the mobile device for possible repair, and evaluating the mobile device for warranty coverage may all require identification of any cracks in the mobile device's screen and other physical defects such as chipped or bent edges, etc. Individualized manual inspection of mobile device screens for damage is slow, cumbersome, and can yield inconsistent results. Current automated methods are often unable to reliably detect cracks in edge regions. Accordingly, there is a need for improved methods and systems for automatically detecting damage in electronic devices.
BRIEF DESCRIPTION OF THE DRAWINGS
[0003] Figure 1 is a block diagram illustrating components of a suitable computing environment for implementing various aspects of the present technology.
[0004] Figure 2 is a flow diagram of a method for detecting damage in edge regions of electronic devices in accordance with an embodiment of the present technology.
[0005] Figure 3 is a flow diagram of selected operations in the method shown in Figure 2 along with corresponding images of an electronic device. [0006] Figure 4 is an isometric view of a machine employing methods and systems configured in accordance embodiments of the present technology for recycling mobile phones and/or other electronic devices.
[0007] Figures 5A-5D are a series of isometric views of the machine of Figure 4 with a number of exterior panels removed to illustrate operation of the machine in accordance with an embodiment of the present technology.
DETAILED DESCRIPTION Overview
[0008] The following disclosure describes systems and methods for automated inspection and evaluation of electronic devices. In particular, at least some embodiments of the present technology enable automatic detection of damage in the edge regions of electronic devices. Typical crack-detection techniques (e.g., edge detectors and similar image-processing algorithms) are not well suited for identifying cracks or other defects near the outer borders of an electronic device. For example, conventional edge detectors may erroneously identify the outer perimeter of a device or the edge of the device's screen as cracks. Embodiments of the present technology provide an approach for detecting cracks and other defects in edge regions of an electronic device by taking advantage of the general symmetry of most electronic devices. By comparing symmetrical portions of a device against one another, damage in these edge regions can be identified. In one example, an image of a mobile device can be divided to retain an upper edge portion and a lower edge portion, where the upper and lower edge portions are generally symmetrical. The lower edge portion of the image can be inverted, aligned with the symmetrical upper edge portion, and then subtracted from the upper edge portion. The difference between the upper edge portion and the lower edge portion can indicate the presence of a defect such as a crack or chip in one of the upper and lower edge portions.
[0009] Certain details are set forth in the following description and in Figures 1-5D to provide a thorough understanding of various embodiments of the present technology. In other instances, well-known structures, materials, operations and/or systems often associated with smartphones and other handheld devices, consumer electronic devices, computer hardware, software, and network systems, etc. are not shown or described in detail in the following disclosure to avoid unnecessarily obscuring the description of the various embodiments of the technology. Those of ordinary skill in the art will recognize, however, that the present technology can be practiced without one or more of the details set forth herein, or with other structures, methods, components, and so forth. The terminology used below should be interpreted in its broadest reasonable manner, even though it is being used in conjunction with a detailed description of certain examples of embodiments of the technology. Indeed, certain terms may even be emphasized below; however, any terminology intended to be interpreted in any restricted manner will be specifically defined as such in this Detailed Description section.
[0010] The accompanying Figures depict embodiments of the present technology and are not intended to be limiting of the scope of the present technology. The sizes of various depicted elements are not necessarily drawn to scale, and these various elements may be arbitrarily enlarged to improve legibility. Component details may be abstracted in the Figures to exclude details such as the position of components and certain precise connections between such components when such details are unnecessary for a complete understanding of how to make and use the invention.
[0011 ] In the Figures, identical reference numbers may identify identical, or at least generally similar, elements. To facilitate the discussion of any particular element, the most significant digit or digits of any reference number may refer to the Figure in which that element is first introduced. For example, element 110 is first introduced and discussed with reference to Figure 1 .
Detecting Damage in Edge Regions of Electronic Devices
[0012] Figure 1 illustrates an embodiment of an environment 100 in which various aspects of the present technology can be implemented. The environment 100 includes an imaging device 101 configured to obtain images and/or video of an electronic device 103 (e.g., a mobile phone, tablet, notebook, etc.). The imaging device 101 is in communication with a computing device 105 and a database 107 via a communications link 109.
[0013] The imaging device 101 includes a processing component 1 1 1 , a memory 1 13, input and output components 1 15 and 1 17, and a power component 125. The imaging device 101 further includes an image sensor 127, associated optics 129, and an illumination source 131 . A communication component 1 19 of the imaging device 101 includes a wired connection 223 and a wireless transceiver 121 . The computing device 105 can include several components similar to components of the imaging device 101 . For example, the computing device 105 can include a processing component 133, memory 135 (which can store an operating system 137, applications 139, and data 141 ), along with input 143 and output 145 components and a power component 153. A communication component 147 of the computing device 105 includes a wired connection 151 and a wireless transceiver 147. These features of the imaging device 101 and the computing device 105 are described in more detail below in the context of a routine for detecting damage in edge regions of mobile devices in accordance with embodiments of the present technology
[0014] Figure 2 is a flow diagram of a routine for detecting damage in edge regions of electronic devices in accordance with an embodiment of the present technology. In at least some embodiments, the routine 200 is performed by the computing device 105, which is described in more detail below. In block 201 the routine 200 receives an image of the electronic device 103. For example, the imaging device 101 can be used to obtain one or more images of the electronic device 103. The images can be included in a video of the electronic device 103. For example, the imaging device 101 can be moved relative to the electronic device 103 or vice versa to obtain different views of the electronic device 103 on the video. A similar approach can be taken using still images, such as by taking a number of still images with the imaging device 101 at different orientations relative to the electronic device 103. For example, the imaging device 101 and/or the electronic device 103 can be affixed to moveable components such as a moveable platform or mounting surface. The moveable components can be controlled and moved using a belt drive, rack and pinion system, or other suitable drive system coupled to an electronic controller (e.g., the computing device 105). Furthermore, the routine 200 can obtain various images of the electronic device 103 under different conditions, for example under different lighting conditions (e.g., no lights on, all lights on, only infrared illumination, etc.), under different operating conditions (e.g., with a display of the electronic device 103 in an "off" mode, with the display in an "on" mode, with the display presenting a predetermined image, etc.). In other embodiments, the routine 200 can obtain a single image of the electronic device 103 and/or images the electronic device 103 under a single condition. With reference again to the routine 200, the image or images obtained by the imaging device 101 can be transmitted to the computing device 105, such as via the communications link 109, for analysis and evaluation.
[0015] In block 203, the routine 200 divides the image into segments, for example dividing the image along vertical and horizontal lines into a grid-like pattern. The number of segments can vary, for example two, four, six, eight, or more segments. In this embodiment, the image of the electronic device is first rotated such that a long axis of the device is substantially horizontal. In other embodiments, the image is oriented differently, for example the long axis of the device can be vertical and the image can be divided along horizontal lines into segments. The segments can be substantially evenly divided such that each segment has an identical or similar height and width. Alternatively, the size of each segment may vary.
[0016] In block 205, the routine 200 pairs corresponding symmetrical segments. For example, the routine 200 can pair a first segment that includes a portion of a first peripheral region of an electronic device with a second segment that includes a portion of a second, opposite peripheral region of the electronic device. Next, in block 207, the routine 200 inverts one of the segments for each pair. For example, for a given segment, the upper segment can be inverted with respect to the horizontal axis while the lower segment is not. Conversely, for a given pair, the lower segment can be inverted with respect to the horizontal axis while the upper segment is not. In block 209, the routine 200 compares each inverted segment with its corresponding non-inverted segment. For example, each inverted segment can first be aligned with its corresponding non-inverted segment by overlaying the two and adjusting their relative positions until a minimum difference (e.g., a minimum sum of absolute differences) is achieved. Once in this position, a difference can be calculated (e.g., a sum of absolute differences). In other embodiments, each pair of segments (e.g., an upper segment and lower segment from the same pair) can be compared in ways other than by subtraction, for example by averaged brightness values, etc.
[0017] In block 21 1 , the routine 200 evaluates the resulting comparison for evidence of defects. If the difference calculated in block 209 exceeds some predetermined threshold, then a defect can be indicated in the corresponding region of the device. For example, if a given segment includes a crack, when the given segment is subtracted from an inverted segment that does not include a crack, the resulting difference will be due principally to the presence of the crack in a given segment the its absence of the crack in the other segment. Due to the general symmetry of electronic devices such as mobile phones, comparing edges in this manner allows asymmetrical defects to be detected even in edge regions where traditional crack-detection techniques fall short.
[0018] Although the routine 200 is described with positional terms such as horizontal, vertical, left, and right, this approach can be applied with the image of the electronic device in any orientation. For example, the image can be oriented such that the long axis of the electronic device is aligned along the vertical axis. The routine can proceed similar to that described above, with the appropriate changes throughout.
[0019] Figure 3 illustrates example images of an electronic device at various stages of the routine illustrated in Figure 2. Image 301 is an image of the electronic device with damage 303 in an edge region. The image 301 is divided along vertical lines 305a and 305b and along horizontal lines 307a and 307b to produce a plurality of segments. The image 301 includes peripheral regions of the electronic device that fall outside of the line 309, and non-peripheral regions of the electronic device that fall inside of the line 309.
[0020] Next, corresponding segments are paired together. For example segments 31 1 a and 31 1 b form a first pair, segments 313a and 313b form a second pair, and segments 315a and 315b form a third pair. The remaining segments can be ignored or discarded for purposes of this analysis, although in other embodiments these remaining segments can additionally be analyzed to detect cracks or other defects. In at least some embodiments, each segment in one of the pairs includes a peripheral region of the electronic device adjacent to the edge (i.e., a peripheral region that falls outside of line 309). As illustrated, the upper left segment 31 1 a includes the damage 303 in the peripheral region.
[0021 ] Next, the lower segments 31 1 b, 313b, and 315b are inverted with respect to the horizontal axis. In other embodiments the upper segments are inverted with respect to the horizontal axis, while the lower segments are not inverted. Finally, each inverted lower segment is subtracted from its non-inverted corresponding segment. For example, inverted segment 31 1 b is subtracted from segment 31 1 a, inverted segment 313b is subtracted from segment 313a, and inverted segment 315b is subtracted from segment 315a. Each inverted segment can first be aligned with its corresponding non-inverted segment by overlaying the two and adjusting their relative positions until a minimum difference is achieved. Once in this position, a difference can be calculated (e.g., a sum of absolute differences between segment 31 1 a and inverted segment 31 1 b).
[0022] These resulting differences are illustrated as difference 317a (the result of subtracting segment 31 1 b from segment 31 1 a), difference 317b (the result of subtracting segment 313b from segment 313a), and difference 317c (the result of subtracting segment 315b from segment 315a). In these difference images, resulting intensity values indicate the presence of asymmetry in the compared edge regions of the device, and accordingly indicate likely damage in the edge region. For example, the damage 303 in segment 31 1 a is clearly indicated in difference 317a.
[0023] In evaluating the differences, the outermost peripheral regions corresponding to the perimeter of the electronic device can be discarded so as to avoid misidentifying the actual perimeter of the electronic device as damaged. For example, for the left-most segments 31 1 a and 31 1 b (and the calculated difference 317a), the leftmost edge can be discarded within a predetermined distance or number of pixels in order to exclude the physical perimeter of the electronic device. Similarly, for the right-most segments 315a and 315b (and the calculated difference 317c), the rightmost edge can be discarded within a predetermined distance or number of pixels in order to exclude the physical perimeter of the electronic device. For all segments, the uppermost edge can be discarded to exclude the upper perimeter (for non-inverted segments) and lower perimeter (for inverted segments) of the electronic device.
Computing Environment
[0024] Referring again to Figure 1 , additional details are set forth below regarding the computing environment in which the routine 200 can be performed. The imaging device 101 can be, for example, a digital camera (e.g. , having a CCD or CMOS sensor) capable of capturing still and/or moving images of the electronic device 103, and transmitting captured images over the communications link 109 to remote devices. In some embodiments, the imaging device 101 includes a camera and an associated fixture, base, or other imaging area in which the electronic device 103 is to be placed for imaging. This can provide a standard background against which the images and/or video of the electronic device 103 are obtained. The imaging device 101 can be configured to move the camera and/or the associated optics in order to capture images and/or video of the electronic device 103 from various angles. The imaging device 101 can also include an illumination source (e.g., LEDs, fluorescent bulbs, lamps, etc.) which can also aid in obtaining images of the electronic device 103 under uniform lighting conditions.
[0025] The electronic device 103 can be, for example, a smartphone, a tablet, a laptop, a handheld gaming device, a media player, or any such device that has a screen or other surface that may suffer cracks or similar defects. Although many embodiments of the present technology are described herein in the context of mobile phones, aspects of the present technology are not limited to mobile phones and generally apply to other consumer electronic devices. Such devices include, as non-limiting examples, all manner of mobile phones; smartphones; handheld devices; personal digital assistants (PDAs); MP3 or other digital music players; tablet, notebook, ultrabook and laptop computers; e-readers; all types of cameras; GPS devices; set-top boxes and other media players; VoI P phones; universal remote controls; wearable computers; and larger consumer electronic devices, such as desktop computers, TVs, projectors, DVRs, game consoles, etc.
[0026] The computing device 105 can be a desktop computer or another suitable device. The computing device 105 is configured to receive images of the electronic device 103 from the imaging device 101 and to automatically analyze the images to detect asymmetrical damage other defects. In some embodiments, the computing device 105 is remote from the imaging device 101 and can be in communication via the communications link 109. In other embodiments, the computing device 105 is connected to the imaging device 101 via a hardwire connection, or in certain embodiments the imaging device 101 and the computing device 105 are integrated into the same machine. The computing device 105 is also in communication with the database 107 which can store data used in automatically analyzing the images of the electronic device 103. The database 107 may also store the results of the automatic analysis of the images, other data about the electronic device 103, etc.
[0027] In the illustrated embodiment, various devices including the imaging device 101 and the computing device 105 can exchange information with one another via the communication link 109. Although the communication link 109 can include a publicly available network (e.g., the Internet with a web interface), a private communication link, such as an intranet or other network can also be used. Moreover, in various embodiments the imaging device 101 is connected to a host computer (not shown) that facilitates the exchange of information between the imaging device 101 , the computing device 105, remote computers, mobile devices, etc.
[0028] In the illustrated embodiment, the imaging device 101 includes the processing component 1 1 1 that controls operation of the imaging device 101 in accordance with computer-readable instructions stored in memory 1 13. The processing component 1 1 1 may include any logic processing unit, such as one or more central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The processing component 1 1 1 may be a single processing unit or multiple processing units in an electronic device or distributed across multiple devices. Aspects of the present technology can be embodied in a special purpose computing device or data processor that is specifically programmed, configured, or constructed to perform one or more of the computer-executable instructions explained in detail herein. Aspects of the present technology can also be practiced in distributed computing environments in which functions or modules are performed by remote processing devices that are linked through a communications network, such as a local area network (LAN), wide area network (WAN), or the Internet. In a distributed computing environment, modules can be located in both local and remote memory storage devices.
[0029] The processing component 1 1 1 is connected to memory 1 13, which can include a combination of temporary and/or permanent storage, and both read-only memory (ROM) and writable memory (e.g., random access memory or RAM), writable non-volatile memory such as flash memory or other solid-state memory, hard drives, removable media, magnetically or optically readable discs, nanotechnology memory, biological memory, and so forth. As used herein, memory does not include a transitory propagating signal per se. The memory 213 includes data storage that contains programs, software, and information, such as an operating system and data. Imaging device 101 operating system and data can include software and databases configured to control imaging device 101 components, process images, communicate and exchange data and information with remote computers and other devices, etc.
[0030] The imaging device 101 further includes input components 1 15 that can receive input from user interactions and provide input to the processing component 1 1 1 , typically mediated by a hardware controller that interprets the raw signals received from the input device and communicates the information to the processing component 1 1 1 using a known communication protocol. Examples of an input component 1 15 include touchpad, a keyboard (with physical or virtual keys), a pointing device (such as a mouse, dial, or eye tracking device), a touchscreen that detects contact events when it is touched by a user, a microphone that receives audio input, etc. The imaging device 101 can also include various other input components 1 15 such as GPS or other location determination sensors, motion sensors, wearable input devices with accelerometers (e.g. wearable glove-type input devices), biometric sensors (e.g., fingerprint sensors), light sensors, card readers (e.g., magnetic stripe readers or memory card readers) or the like.
[0031 ] The processing component 1 1 1 is also connected to one or more various output components 1 17, e.g., directly or via a hardware controller. The output devices can include a display on which text and graphics are displayed. The display can be, for example, an LCD, LED, or OLED display screen, an e-ink display, a projected display (such as a heads-up display device), and/or a display integrated with a touchscreen that serves as an input device as well as an output device that provides graphical and textual visual feedback to a user. The output components 1 17 can also include a speaker for playing audio signals, haptic feedback devices for tactile output such as vibration, etc. In some implementations, a speaker and microphone are implemented by a combined audio input-output device.
[0032] In the illustrated embodiment, the imaging device 101 further includes one or more communication components 1 19. The communication components can include, for example, a wireless transceiver 121 (e.g., one or more of a Wi-Fi transceiver; Bluetooth transceiver; near-field communication (NFC) device; wireless modem or cellular radio utilizing GSM, CDMA, 3G and/or 4G technologies; etc.) and/or a wired network connection 123 (e.g., one or more of an Ethernet port, cable modem, FireWire cable, Lightning connector, universal serial bus (USB) port, etc.). The communication components 1 19 are suitable for communication between the imaging device 101 and other local and/or remote devices, e.g., the computing device 105, directly via a wired or wireless peer-to-peer connection and/or indirectly via the communication link 109 (which can include the Internet, a public or private intranet, a local or extended Wi-Fi network, cell towers, the plain old telephone system (POTS), etc.). For example, the wireless transceiver 121 of the imaging device 101 can connect to a wireless transceiver 149 of the computing device via the wireless connection. The imaging device 101 further includes power 125, which can include battery power and/or facility power for operation of the various electrical components associated with the imaging device 101 .
[0033] The imaging device 101 further includes the image sensor 127, optics 129, and illumination source 131 . The image sensor 127 can be, for example, a CCD sensor, a CMOS sensor, or any other type of image sensor or array of sensors. The image sensor 127 can be aligned with optics 129, for example one or more lenses, filters, or other optical elements configured to orient and modulate incoming light before it reaches the image sensor 127. The illumination source 131 can be configured to direct illumination towards the field of view of the imaging device 101 , and can be any type of light source, for example LEDs, fluorescent bulbs, etc. In some embodiments, the illumination source 131 includes multiple different types of light sources which can be individually activated, for example infrared, ultraviolet, broadband, etc.
[0034] The computing device 105 includes several components similar to those in the imaging device 101 . In the illustrated embodiment, the computing device 105 includes a processing component 133 that controls operation of the computing device 105 in accordance with computer-readable instructions stored in memory 135. The processing component 133 may be any logic processing unit, such as one or more central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The processing component 133 may be a single processing unit or multiple processing units in an electronic device or distributed across multiple devices. The processing component 133 is connected to memory 135, which includes data storage that contains programs, software, and information, such as an operating system 137, application programs 139, and data 141 . The operating system 137 can include, for example, Windows®, Linux®, Android™, iOS®, and/or an embedded real-time operating system. The application programs 139 and data 141 can include software and databases configured to control computing device 105 components, process and evaluate images received from the imaging device 101 , communicate and exchange data and information with remote computers and other devices, etc.
[0035] The computing device 105 can include input components 143, such as a keyboard (with physical or virtual keys), a pointing device (such as a mouse, joystick, dial, or eye tracking device), a touchscreen, a microphone, and a camera for still photograph and/or video capture. The computing device 105 can also include various other input components 143 such as GPS or other location determination sensors, motion sensors, wearable input devices with accelerometers (e.g. wearable glove-type input devices), biometric sensors (e.g. , fingerprint sensors), light sensors, card readers (e.g. , magnetic stripe readers or memory card readers) and the like.
[0036] The processing component 133 can also be connected to one or more various output components 145, e.g., directly or via a hardware controller. The output devices can include a display such as an LCD, LED, or OLED display screen (such as a desktop computer screen, handheld device screen, or television screen), an e-ink display, a projected display (such as a heads-up display device), and/or a display integrated with a touchscreen that serves as an input device as well as an output device that provides graphical and textual visual feedback to the user. The output devices can also include a speaker for playing audio signals, haptic feedback devices for tactile output such as vibration, etc.
[0037] In the illustrated embodiment, computing device 105 further includes one or more communication components 147. The communication components can include, for example, a wireless transceiver 149 (e.g., one or more of a Wi-Fi transceiver; Bluetooth transceiver; near-field communication (NFC) device; wireless modem or cellular radio utilizing GSM, CDMA, 3G and/or 4G technologies; etc.) and/or a wired network connector port 251 (e.g. , one or more of an Ethernet port, cable modem, FireWire cable, Lightning connector, universal serial bus (USB) port, etc.). The communication components 147 are suitable for communication between the computing device 105 and other local and/or remote computing devices, e.g., the imaging device 101 a via a wired or wireless peer-to-peer connection and/or indirectly via the communication link 109. For example, the wireless transceiver 149 of the computing device 105 can connect to the wireless transceiver 121 of imaging device 101 , and/or the wired connector port 151 of the computing device 105 can connect to the wired connector port 123 of the imaging device 101 . The computing device 105 further includes power 153, which can include battery power and/or facility power for operation of the various electrical components associated with the computing device 105.
[0038] Unless described otherwise, the construction and operation of the various components shown in Figure 1 are of conventional design. As a result, such components need not be described in further detail herein, as they will be readily understood by those skilled in the relevant art. In other embodiments, the computing device 105 and the imaging device 101 include other features that may be different from those described above. In still further embodiments, the computing device 105 and/or the imaging device 101 include more or fewer features similar to those described above.
Kiosk Environment
[0039] In some embodiments, the routines described herein can be carried out using a kiosk that includes an imaging device (e.g. , the imaging device 101 ) therein. In some embodiments, the kiosk can perform some or all of the functions performed by the computing device 105 described above, for example processing and evaluating images received from the imaging device 101 . The kiosk can include, for example, a processing component and memory storing instructions that, when executed by the processing component, perform operations such as the routine 200 described above. Figure 4, for example, is an isometric view of a kiosk 400 for recycling and/or other processing of mobile phones and other consumer electronic devices in accordance with the present technology. The term "processing" is used herein for ease of reference to generally refer to all manner of services and operations that may be performed or facilitated by the kiosk 400 on, with, or otherwise in relation to an electronic device. Such services and operations can include, for example, selling, reselling, recycling, donating, exchanging, identifying, evaluating, pricing, auctioning, decommissioning, transferring data from or to, reconfiguring, refurbishing, etc., mobile phones and other electronic devices. Although many embodiments of the present technology are described herein in the context of mobile phones, aspects of the present technology are not limited to mobile phones and generally apply to other consumer electronic devices. Such devices include, as non-limiting examples, all manner of mobile phones, smart phones, handheld devices, PDAs, MP3 players, tablet, notebook and laptop computers, e-readers, cameras, etc. In some embodiments, it is contemplated that the kiosk 400 can facilitate selling and/or otherwise processing larger consumer electronic devices, such as desktop computers, TVs, game consoles, etc., as well smaller electronic devices such as Google Glass™, smart-watches, etc.
[0040] In the illustrated embodiment, the kiosk 400 is a floor-standing self-service kiosk configured for use by a user 401 (e.g. , a consumer, customer, etc.) to recycle, sell, and/or perform other operations with a mobile phone or other consumer electronic device. In other embodiments, the kiosk 400 can be configured for use on a countertop or a similar raised surface. Although the kiosk 400 is configured for use by consumers, in various embodiments the kiosk 400 and/or various portions thereof can also be used by other operators, such as a retail clerk or kiosk assistant to facilitate the selling or other processing of mobile phones and other electronic devices.
[0041 ] In the illustrated embodiment, the kiosk 400 includes a housing 402 that is approximately the size of a conventional vending machine. The housing 402 can be of conventional manufacture from, for example, sheet metal, plastic panels, etc. A plurality of user interface devices are provided on a front portion of the housing 402 for providing instructions and other information to users, and/or for receiving user inputs and other information from users. For example, the kiosk 400 can include a display screen 404 (e.g., a liquid crystal display ("LCD") or light emitting diode ("LED") display screen, a projected display (such as a heads-up display or a head- mounted device), and so on) for providing information, prompts, etc., to users. The display screen 404 can include a touch screen for receiving user input and responses to displayed prompts. In addition or alternatively, the kiosk 400 can include a separate keyboard or keypad for this purpose. The kiosk 400 can also include an ID reader or scanner 412 (e.g., a driver's license scanner), a fingerprint reader 414, and one or more cameras 416 (e.g., digital still and/or video cameras, identified individually as cameras 416a-c). The kiosk 400 can additionally include output devices such as a label printer having an outlet 410, and a cash dispenser having an outlet 418. Although not identified in Figure 4, the kiosk 400 can further include a speaker and/or a headphone jack for audibly communicating information to users, one or more lights for visually communicating signals or other information to users, a handset or microphone for receiving verbal input from the user, a card reader (e.g., a credit/debit card reader, loyalty card reader, etc.), a receipt or voucher printer and dispenser, as well as other user input and output devices. The input devices can include a touchpad, pointing device such as a mouse, joystick, pen, game pad, motion sensor, scanner, eye direction monitoring system, etc. Additionally the kiosk 400 can also include a bar code reader, QR code reader, bag/package dispenser, a digital signature pad, etc. In the illustrated embodiment, the kiosk 400 additionally includes a header 420 having a display screen 422 for displaying marketing advertisements and/or other video or graphical information to attract users to the kiosk. In addition to the user interface devices described above, the front portion of the housing 402 also includes an access panel or door 406 located directly beneath the display screen 404. As described in greater detail below, the access door is configured to automatically retract so that the user 401 can place an electronic device (e.g., a mobile phone) in an inspection area 408 for automatic inspection by the kiosk 400.
[0042] A sidewall portion of the housing 402 can include a number of conveniences to help users recycle or otherwise process their mobile phones. For example, in the illustrated embodiment the kiosk 400 includes an accessory bin 428 that is configured to receive mobile device accessories that the user wishes to recycle or otherwise dispose of. Additionally, the kiosk 400 can provide a free charging station 426 with a plurality of electrical connectors 424 for charging a wide variety of mobile phones and other consumer electronic devices.
[0043] Figures 5A-5D are a series of isometric views of the kiosk 400 with the housing 402 removed to illustrate selected internal components configured in accordance with an embodiment of the present technology. Referring first to Figure 5A, in the illustrated embodiment the kiosk 400 includes a connector carrier 540 and an inspection plate 544 operably disposed behind the access door 406 (Figure 4). In the illustrated embodiment, the connector carrier 540 is a rotatable carrousel that is configured to rotate about a generally horizontal axis and carries a plurality of electrical connectors 542 (e.g., approximately 25 connectors) distributed around an outer periphery thereof. In other embodiments, other types of connector carrying devices (including both fixed and movable arrangements) can be used. In some embodiments, the connectors 542 includes a plurality of interchangeable USB connectors configured to provide power and/or exchange data with a variety of different mobile phones and/or other electronic devices. In operation, the connector carrier 540 is configured to automatically rotate about its axis to position an appropriate one of the connectors 542 adjacent to an electronic device, such as a mobile phone 550, that has been placed on the inspection plate 544 for recycling. The connector 542 can then be manually and/or automatically withdrawn from the connector carrier 540 and connected to a port on the mobile phone 550 for electrical analysis. Such analysis can include, e.g., an evaluation of the make, model, configuration, condition, etc.
[0044] In the illustrated embodiment, the inspection plate 544 is configured to translate back and forth (on, e.g., parallel mounting tracks) to move an electronic device, such as the mobile phone 550, between a first position directly behind the access door 406 and a second position between an upper chamber 530 and an opposing lower chamber 532. Moreover, in this embodiment the inspection plate 544 is transparent, or at least partially transparent (e.g., formed of glass, Plexiglas, etc.) to enable the mobile phone 550 to be photographed and/or otherwise optically evaluated from all, or at least most viewing angles (e.g., top, bottom, sides, etc.) using, e.g., one or more cameras, mirrors, etc. mounted to or otherwise associated with the upper and lower chambers 530 and 532. When the mobile phone 550 is in the second position, the upper chamber 530 can translate downwardly to generally enclose the mobile phone 550 between the upper chamber 530 and the lower chamber 532. The upper chamber 530 is operably coupled to a gate 538 that moves up and down in unison with the upper chamber 530.
[0045] In some embodiments, the kiosk 400 includes the imaging device 101 disposed within the upper hood 530. The imaging device 101 can be used as described above to facilitate visual inspection of the mobile phone 550 in order to detect the presence of asymmetrical damage to the mobile phone 550. The upper chamber 530 and/or the lower chamber 532 can also include one or more magnification tools, scanners (e.g., bar code scanners, infrared scanners, etc.) or other imaging components (not shown) and an arrangement of mirrors (also not shown) to view, photograph and/or otherwise visually evaluate the mobile phone 550 from multiple perspectives. In some embodiments, one or more of the cameras and/or other imaging components discussed above can be movable to facilitate device evaluation. For example, as noted above with respect to Figure 1 , the imaging device 101 can be affixed to a moveable mechanical component such as an arm, which in turn can be moved using a belt drive, rack and pinion system, or other suitable drive system coupled to an electronic controller (e.g. , the computing device 105). The inspection area 408 can also include weight scales, heat detectors, UV readers/detectors, and the like, for further evaluation of electronic devices placed therein. The kiosk 400 can further include an angled binning plate 536 for directing electronic devices from the transparent plate 544 into a collection bin 534 positioned in a lower portion of the kiosk 400.
[0046] The kiosk 400 can be used in a number of different ways to efficiently facilitate the recycling, selling and/or other processing of mobile phones and other consumer electronic devices. Referring to Figures 4-5D together, in one embodiment a user wishing to sell a used mobile phone, such as the mobile phone 550, approaches the kiosk 400 and identifies the type of device the user wishes to sell in response to prompts on the display screen 404. Next, the user may be prompted to remove any cases, stickers, or other accessories from the device so that it can be accurately evaluated. Additionally, the kiosk 400 may print and dispense a unique identification label (e.g., a small adhesive-backed sticker with a quick response code ("QR code"), barcode, or other machine-readable indicia, etc.) from the label outlet 410 for the user to adhere to the back of the mobile phone 550. After this is done, the door 406 retracts and opens allowing the user to place the mobile phone 550 onto the transparent plate 544 in the inspection area 408 (Figure 5A). The door 406 then closes and the transparent plate 544 moves the mobile phone 550 under the upper chamber 530 as shown in Figure 5B. The upper chamber 530 then moves downwardly to generally enclose the mobile phone 550 between the upper and lower chambers 530 and 532, and the cameras and/or other imaging components in the upper and lower chambers 530 and 532 perform a visual inspection of the mobile phone 550. In one embodiment, the visual inspection of the mobile phone 550 includes performing the routine 200 (Figure 2) to detect damage to the mobile phone 550. In some embodiments, the visual inspection includes a computer-implemented visual analysis (e.g., a three-dimensional ("3D") analysis) performed by a processing device within the kiosk (e.g., a CPU) to confirm the identification of the mobile phone 550 (e.g. make, model and/or sub-model) and/or to evaluate or assess the condition and/or function of the mobile phone 550 and/or its various components and systems. For example, the visual analysis can include computer-implemented evaluation (e.g., a digital comparison) of images of the mobile phone 550 taken from top, side and/or end view perspectives to determine length, width, and/or height (thickness) dimensions of the mobile phone 550. The visual analysis can further include a computer-implemented inspection of a display screen on the mobile phone 550 to check for, e.g., cracks in the glass and/or other damage or defects in the LCD (e.g., defective pixels, etc.).
[0047] Referring next to Figure 5C, after the visual analysis is performed and the device has been identified, the upper chamber 530 returns to its upper position and the transparent plate 544 returns the mobile phone 550 to its initial position near the door 406. The display screen 404 can also provide an estimated price, or an estimated range of prices, that the kiosk 400 may offer the user for the mobile phone 550 based on the visual analysis, and/or based on user input (e.g. , input regarding the type, condition, etc. of the phone 550). If the user indicates (via, e.g., input via the touch screen) that they wish to proceed with the transaction, the connector carrier 540 automatically rotates an appropriate one of the connectors 542 into position adjacent the transparent plate 544, and door 406 is again opened. The user can then be instructed (via, e.g., the display screen 404) to withdraw the selected connector 542 (and its associated wire) from the carrousel 540, plug the connector 542 into the corresponding port (e.g., a USB port) on the mobile phone 550, and reposition the mobile phone 550 in the inspection area on the transparent plate 544. After doing so, the door 406 once again closes and the kiosk 400 (e.g. the kiosk CPU) performs an electrical inspection of the device via the connector 542 to further evaluate the condition of the phone as well as specific component and operating parameters such as the memory, carrier, etc. In addition or alternatively, in some embodiments the electrical inspection can include a determination of phone manufacturer information (e.g., a vendor identification number or VID) and product information (e.g., a product identification number or PID). In some embodiments, the kiosk 400 can perform the electrical analysis using one or more of the methods and/or systems described in detail in the commonly owned patents and patent applications identified herein and incorporated by reference in their entireties.
[0048] After the visual and electronic analysis of the mobile phone 550, the user is presented with a phone purchase price via the display screen 404. If the user declines the price (via, e.g., the touch screen), a retraction mechanism (not shown) automatically disconnects the connector 542 from the mobile phone 550, the door 406 opens, and the user can reach in and retrieve the mobile phone 550. If the user accepts the price, the door 406 remains closed and the user may be prompted to place his or her identification (e.g. , a driver's license) in the ID scanner 412 and provide a thumbprint via the fingerprint reader 414. As a fraud prevention measure, the kiosk 400 can be configured to transmit an image of the driver's license to a remote computer screen, and an operator at the remote computer can visually compare the picture (and/or other information) on the driver's license to an image of the person standing in front of the kiosk 400 as viewed by one or more of the cameras 416a-c (Figure 4) to confirm that the person attempting to sell the phone 550 is in fact the person identified by the driver's license. In some embodiments, one or more of the cameras 416a-c can be movable to facilitate viewing of kiosk users, as well as other individuals in the proximity of the kiosk 400. Additionally, the person's fingerprint can be checked against records of known fraud perpetrators. If either of these checks indicate that the person selling the phone presents a fraud risk, the transaction can be declined and the mobile phone 550 returned. After the user's identity has been verified, the transparent plate 544 moves back toward the upper and lower chambers 530 and 532. As shown in Figure 5D, however, when the upper chamber 530 is in the lower position the gate 538 permits the transparent plate 544 to slide underneath but not electronic devices carried thereon. As a result, the gate 538 knocks the mobile phone 550 off of the transparent plate 544, onto the binning plate 536 and into the bin 534. The kiosk can then provide payment of the purchase price to the user. In some embodiments, payment can be made in the form of cash dispensed from the cash outlet 418. In other embodiments, the user can receive remuneration for the mobile phone 550 in various other useful ways. For example, the user can be paid via a redeemable cash voucher, a coupon, an e- certificate, a prepaid card, a wired or wireless monetary deposit to an electronic account (e.g., a bank account, credit account, loyalty account, online commerce account, mobile wallet etc.), Bitcoin, etc.
[0049] As those of ordinary skill in the art will appreciate, the foregoing routines are but some examples of ways in which the kiosk 400 can be used to recycle or otherwise process consumer electronic devices such as mobile phones. Although the foregoing example is described in the context of mobile phones, it should be understood that the kiosk 400 and various embodiments thereof can also be used in a similar manner for recycling virtually any consumer electronic device, such as MP3 players, tablet computers, PDAs, and other portable devices, as well as other relatively non-portable electronic devices such as desktop computers, printers, devices for implementing games, entertainment or other digital media on CDs, DVDs, Blu-ray, etc. Moreover, although the foregoing example is described in the context of use by a consumer, the kiosk 400 in various embodiments thereof can similarly be used by others, such as a store clerk, to assist consumers in recycling, selling, exchanging, etc. their electronic devices.
[0050] The disclosed technology also includes the disclosures of U.S. patent application number 14/498,763, titled "METHODS AND SYSTEMS FOR PRICING AND PERFORMING OTHER PROCESSES ASSOCIATED WITH RECYCLING MOBI LE PHONES AND OTHER ELECTRONIC DEVICES," attorney docket number 1 1 1220-8024. US00, filed by the applicant on September 26, 2014; U.S. patent application number 14/500,739, titled "MAINTAINING SETS OF CABLE COMPONENTS USED FOR WI RED ANALYSIS, CHARGING, OR OTHER INTERACTION WITH PORTABLE ELECTRONIC DEVICES," attorney docket number 1 1 1220-8025. US00, filed by the applicant on September 29, 2014; U.S. patent application number 14/873, 158, titled "WIRELESS-ENABLED KIOSK FOR RECYCLING CONSUMER DEVICES," attorney docket number 1 1 1220-8022. US01 , filed by the applicant on October 1 , 2015; U.S. patent application number 14/873, 145, titled "APPLICATION FOR DEVICE EVALUATION AND OTHER PROCESSES ASSOCIATED WITH DEVICE RECYCLING," attorney docket number 1 1 1220-8023. US01 , filed by the applicant on October 1 , 2015; U.S. patent application number 14/506,449, titled "SYSTEM FOR ELECTRICALLY TESTING MOBI LE DEVICES AT A CONSUMER-OPERATED KIOSK, AND ASSOCIATED DEVICES AND METHODS," attorney docket number 1 1 1220-8035.US00, filed by the applicant on October 3, 2014; U.S. patent application number 14/925,357, titled "SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES," attorney docket number 1 1 1220-8027. US01 , filed by the applicant on October 28, 2015; U.S. patent application number 14/925,375, titled "METHODS AND SYSTEMS FOR FACILITATING PROCESSES ASSOCIATED WITH INSURANCE SERVICES AND/OR OTHER SERVICES FOR ELECTRONIC DEVICES," attorney docket number 1 1 1220-8028. US01 , filed by the applicant on October 28, 2015; U.S. patent application number 14/964,963, titled "METHODS AND SYSTEMS FOR PROVI DI NG INFORMATION REGARDING COUPONS/PROMOTIONS AT KIOSKS FOR RECYCLING MOBI LE PHONES AND OTHER ELECTRONIC DEVICES," attorney docket number 1 1 1220-8031 . US01 , filed by the applicant on December 10, 2015; U.S. patent application number 14/568,051 , titled "METHODS AND SYSTEMS FOR IDENTIFYING MOBILE PHONES AND OTHER ELECTRONIC DEVICES," attorney docket number 1 1 1220- 8033. US00, filed by the applicant on December 1 1 , 2014; U.S. patent application number 14/966,346, titled "SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES," attorney docket number 1 1 1220- 8037. US01 , filed by the applicant on December 1 1 , 2015; U.S. patent application number 14/598,469, titled "METHODS AND SYSTEMS FOR DYNAMIC PRICING AND PERFORMING OTHER PROCESSES ASSOCIATED WITH RECYCLING MOBILE PHONES AND OTHER ELECTRONIC DEVICES," attorney docket number 1 1 1220-8034. US00, filed by the applicant on January 16, 2015; U.S. patent application number 14/660,768, titled "SYSTEMS AND METHODS FOR INSPECTING MOBILE DEVICES AND OTHER CONSUMER ELECTRONIC DEVICES WITH A LASER," attorney docket number 1 1 1220-8030. US00, filed by the applicant on March 17, 2015; U.S. patent application number 14/663,331 , titled "DEVICE RECYCLING SYSTEMS WITH FACIAL RECOGNITION," attorney docket number 1 1 1220-8029. US00, filed by the applicant on March 19, 2015; U.S. provisional application number 62/169,072, titled "METHODS AND SYSTEMS FOR VISUALLY EVALUATING ELECTRONIC DEVICES," attorney docket number 1 1 1220-8041 . USOO, filed by the applicant on June 1 , 2015; U.S. provisional application number 62/202,330, titled "METHODS AND SYSTEMS FOR INSPECTING MOBILE DEVICES AND OTHER CONSUMER ELECTRONIC DEVICES WITH ROBOTIC ACTUATION," attorney docket number 1 1 1220- 8026. USOO, filed by the applicant on August 7, 2015; U.S. patent application number 15/057,707, titled "METHODS AND SYSTEMS FOR RECORDING INTERACTIONS WITH A SYSTEM FOR PURCHASING MOBILE PHONES AND OTHER ELECTRONIC DEVICES," attorney docket number 1 1 1220-8032. US01 , filed by the applicant on March 1 , 2016; U.S. patent application number 14/873, 158, titled "WIRELESS-ENABLED KIOSK FOR RECYCLING CONSUMER DEVICES," attorney docket number 1 1 1220-8022. US01 , filed by the applicant on October 1 , 2015; U.S. patent application number 14/873, 145, titled "APPLICATION FOR DEVICE EVALUATION AND OTHER PROCESSES ASSOCIATED WITH DEVICE RECYCLING," attorney docket number 1 1 1220-8023.US01 , filed by the applicant on October 1 , 2015; U.S. patent application number 14/925,357, titled "SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES," attorney docket number 1 1 1220-8027.US01 , filed by the applicant on October 28, 2015; U.S. patent application number 14/925,375, titled "METHODS AND SYSTEMS FOR FACILITATING PROCESSES ASSOCIATED WITH INSURANCE SERVICES AND/OR OTHER SERVICES FOR ELECTRONIC DEVICES," attorney docket number 1 1 1220-8028. US01 , filed by the applicant on October 28, 2015; U.S. patent application number 14/934, 134, titled "METHODS AND SYSTEMS FOR EVALUATING AND RECYCLING ELECTRONIC DEVICES," attorney docket number 1 1 1220-8038. US01 ; and U.S. patent application number 14/967, 183, titled "SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES," attorney docket number 1 1 1220-8048.US00, filed December 1 1 , 2015, each of which is incorporated herein by reference in its entirety. All of the patents and patent applications listed above are commonly owned by the applicant of the present application, and they along with any other patents or patent applications identified herein are incorporated herein by reference in their entireties.
[0051 ] While the Internet is shown, a private network, such as an intranet may likewise be used herein. The network may have a client-server architecture, in which a computer is dedicated to serving other client computers, or it may have other architectures such as peer-to-peer, in which one or more computers serve simultaneously as servers and clients. A database or databases, coupled to the server computer(s), stores much of the web pages and content exchanged between the user computers. The server computer(s), including the database(s), may employ security measures to inhibit malicious attacks on the system and preserve the integrity of the messages and data stored therein (e.g., firewall systems, message encryption and/or authentication (e.g. , using transport layer security (TLS) or secure socket layers (SSL)), password protection schemes, encryption of stored data (e.g., using trusted computing hardware), and the like).
[0052] One skilled in the relevant art will appreciate that the concepts of the invention can be used in various environments other than location based or the Internet. In general, a display description may be in HTML, XML or WAP format, email format or any other format suitable for displaying information (including character/code-based formats, algorithm-based formats (e.g., vector generated), and bitmapped formats). Also, various communication channels, such as local area networks, wide area networks, or point-to-point dial-up connections, may be used instead of the Internet. The system may be conducted within a single computer environment, rather than a client/server environment. Also, the user computers may comprise any combination of hardware or software that interacts with the server computer, such as television-based systems and various other consumer products through which commercial or noncommercial transactions can be conducted. The various aspects of the invention described herein can be implemented in or for any e-mail environment.
[0053] Although not required, aspects of the invention are described in the general context of computer-executable instructions, such as routines executed by a general-purpose data processing device, e.g. , a server computer, wireless device or personal computer. Those skilled in the relevant art will appreciate that aspects of the invention can be practiced with other communications, data processing, or computer system configurations, including Internet appliances, hand-held devices (including personal digital assistants (PDAs)), wearable computers, all manner of cellular or mobile phones (including Voice over IP (VoIP) phones), dumb terminals, media players, gaming devices, multi-processor systems, microprocessor-based or programmable consumer electronics, set-top boxes, network PCs, mini-computers, mainframe computers, and the like. Indeed, the terms "computer," "server," "host," "host system," and the like, are generally used interchangeably herein, and refer to any of the above devices and systems, as well as any data processor. Input devices may include a touchpad, keyboard and/or a pointing device such as a mouse. Other input devices are possible such as a microphone, joystick, pen, game pad, scanner, digital camera, video camera, and the like. The data storage devices may include any type of computer-readable media that can store data accessible by a computer, such as magnetic hard and floppy disk drives, optical disk drives, magnetic cassettes, tape drives, flash memory cards, digital video disks (DVDs), Bernoulli cartridges, RAMs, ROMs, smart cards, etc. Indeed, any medium for storing or transmitting computer-readable instructions and data may be employed, including a connection port to a network such as a local area network (LAN), wide area network (WAN) or the Internet.
[0054] Aspects of the invention can be embodied in a special purpose computer or data processor that is specifically programmed, configured, or constructed to perform one or more of the computer-executable instructions explained in detail herein. While aspects of the invention, such as certain functions, are described as being performed exclusively on a single device, the invention can also be practiced in distributed environments where functions or modules are shared among disparate processing devices, which are linked through a communications network, such as a Local Area Network (LAN), Wide Area Network (WAN), or the Internet. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
[0055] Aspects of the invention may be stored or distributed on tangible computer- readable media, including magnetically or optically readable computer discs, hardwired or preprogrammed chips (e.g., EEPROM semiconductor chips), nanotechnology memory, biological memory, or other data storage media. The data storage devices may include any type of computer-readable media that can store data accessible by a computer, such as magnetic hard and floppy disk drives, optical disk drives, magnetic cassettes, tape drives, flash memory cards, DVDs, Bernoulli cartridges, RAM, ROMs, smart cards, etc. Indeed, any medium for storing or transmitting computer-readable instructions and data may be employed, including a connection port to a network such as a LAN, WAN, or the Internet. Alternatively, computer implemented instructions, data structures, screen displays, and other data under aspects of the invention may be distributed over the Internet or over other networks (including wireless networks), on a propagated signal on a propagation medium (e.g., an electromagnetic wave(s), a sound wave, etc.) over a period of time, or they may be provided on any analog or digital network (packet switched, circuit switched, or other scheme). The terms "memory" and "computer-readable storage medium" include any combination of temporary, persistent, and/or permanent storage, e.g., ROM, writable memory such as RAM, writable non-volatile memory such as flash memory, hard drives, solid state drives, removable media, and so forth, but do not include a propagating signal per se.
Examples
1 . A method for detecting damage to an electronic device, the method comprising:
receiving an image of an electronic device;
comparing a first portion of the image with an inverted second portion of the image, wherein the first portion of the image shows a first peripheral region of the electronic device and the inverted second portion of the image shows an opposite second peripheral region of the electronic device; and
based on the comparison, evaluating a condition of the electronic device.
2. The method of example 1 wherein comparing the first portion of the image with the inverted second portion of the image includes subtracting one of the first and second portions of the image from the other of the first and second portions of the image.
3. The method of any one of examples 1 -2, further comprising dividing the image into a grid of segments, the grid including rows of the segments parallel to a long axis of the electronic device and columns of the segments parallel to a short axis of the electronic device, wherein comparing the first portion of the image with the inverted second portion of the image includes comparing a first one of the segments with an inverted second one of the segments. 4. The method of example 3 wherein the first and second segments are within the same column of the grid.
5. The method of example 4 wherein the first and second segments are spaced apart within the same column of the grid.
6. The method of example 3 wherein the first and second segments are within the same row of the grid.
7. The method of example 6 wherein the first and second segments are spaced apart within the same row of the grid.
8. The method of any one of examples 1-7, further comprising:
before comparing the first segment and the inverted second segment, cropping the first segment to remove a portion of the first segment showing a first edge of the electronic device adjacent to the first peripheral region of the electronic device; and
before comparing the first segment and the inverted second segment, cropping the second segment to remove a portion of the second segment showing a second edge of the electronic device adjacent to the second peripheral region of the electronic device.
9. The method of any one of examples 1-8 wherein comparing the first portion of the image with the inverted second portion of the image comprises:
moving the first portion of the image and the inverted second portion of the image into an overlapping state; and
iteratively changing a position of the first portion of the image relative to the second portion of the image in the overlapping state, a position of the second portion of the image relative to the first portion of the image in the overlapping state, or both to align the first peripheral region of the electronic device in the first portion of the image and the inverted second peripheral region of the electronic device in the second portion of the image. 10. The method of any one of examples 1-9 wherein comparing the first portion of the image with the inverted second portion of the image comprises calculating a sum of absolute differences between overlapping pixels of the first portion of the image and the inverted second portion of the image.
1 1 . The method of example 10 wherein evaluating the condition of the electronic device comprises determining whether the calculated sum of absolute differences exceeds a predetermined threshold.
12. The method of example 1 1 , further comprising receiving an identification of the electronic device, wherein the predetermined threshold is based at least in part of the received identification.
13. A method for detecting damage to an electronic device, the method comprising:
receiving an image of an electronic device;
dividing the image into a grid of segments, the grid including rows of the segments parallel to a long axis of the electronic device and columns of the segments parallel to a short axis of the electronic device, wherein a first set of the segments shows a first peripheral region of the electronic device and a second set of the segments shows an opposite second peripheral region of the electronic device; comparing segments in the first set to corresponding inverted segments in the second set; and
based on the comparisons, evaluating a condition of the electronic device.
14. The method of example 13, wherein each of the compared segments in the first set is in the same row of the grid as the corresponding inverted segment in the second set.
15. The method of any one of examples 13-14, wherein each of the compared segments in the first set is in the same column of the grid as the corresponding inverted segment in the second set. 16. The method of any one of examples 13-15 wherein comparing the segments in the first set to corresponding inverted segments in the second set comprises:
moving a given one of the segments in the first set and a corresponding segment in the second set into an overlapping state; and iteratively changing the relative position of the given segment in the first set and the corresponding segment in the second set to align the first peripheral region of the electronic device in the given segment in the first set and the inverted second peripheral region of the electronic device in the corresponding segment in the second set.
17. The method of any one of examples 13-16 wherein comparing the segments in the first set to corresponding inverted segments in the second set comprises calculating a sum of absolute differences between overlapping pixels of the segments in the first set and the corresponding inverted segments in the second set.
18. A computer-readable memory carrying computer-executable instructions for causing one or more processors to facilitate detecting damage to an electronic device, the computer-executable instructions comprising instructions that, when executed by the one or more processors:
receive an image of a front side of the electronic device;
compare a first portion of the image with an inverted second portion of the image, wherein the first portion of the image shows a first peripheral region of the electronic device and the inverted second portion of the image shows an opposite second peripheral region of the electronic device; and
based on the comparison, evaluate a condition of the electronic device.
19. The method of example 18 wherein the computer-readable instructions, when executed by the one or more processors, subtract one of the first and second portions of the image from the other of the first and second portions of the image. 20. The method of any one of examples 18-19 wherein the computer- readable instructions, when executed by the one or more processors:
divide the image into a grid of segments, the grid including rows of the segments parallel to a long axis of the electronic device and columns of the segments parallel to a short axis of the electronic device, wherein comparing the first portion of the image with the inverted second portion of the image includes comparing a first one of the segments with an inverted second one of the segments.
21 . The method of any one of examples 18-20 wherein the computer- readable instructions, when executed by the one or more processors:
move the first portion of the image and the inverted second portion of the image into an overlapping state; and
iteratively change a relative position of the first portion of the image and the second portion of the image to align the first peripheral region of the electronic device in the first portion of the image and the inverted second peripheral region of the electronic device in the second portion of the image.
22. The method of any one of examples 18-21 wherein the computer- readable instructions, when executed by the one or more processors, calculate a sum of absolute differences between overlapping pixels of the first portion of the image and the inverted second portion of the image.
[0056] The above Detailed Description of examples and embodiments of the invention is not intended to be exhaustive or to limit the invention to the precise form disclosed above. While specific examples for the invention are described above for illustrative purposes, various equivalent modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize. References throughout the foregoing description to features, advantages, or similar language do not imply that all of the features and advantages that may be realized with the present technology should be or are in any single embodiment of the invention. Rather, language referring to the features and advantages is understood to mean that a specific feature, advantage, or characteristic described in connection with an embodiment is included in at least one embodiment of the present technology. Thus, discussion of the features and advantages, and similar language, throughout this specification may, but do not necessarily, refer to the same embodiment. Furthermore, the described features, advantages, and characteristics of the present technology may be combined in any suitable manner in one or more embodiments. One skilled in the relevant art will recognize that the present technology can be practiced without one or more of the specific features or advantages of a particular embodiment. In other instances, additional features and advantages may be recognized in certain embodiments that may not be present in all embodiments of the present technology.
[0057] Any patents and applications and other references noted above, including any that may be listed in accompanying filing papers, are incorporated herein by reference. Aspects of the invention can be modified, if necessary, to employ the systems, functions, and concepts of the various references described above to provide yet further implementations of the invention.
[0058] Unless the context clearly requires otherwise, throughout the description and the claims, the words "comprise," "comprising," and the like, are to be construed in an inclusive sense, as opposed to an exclusive or exhaustive sense; that is to say, in the sense of "including, but not limited to." As used herein, the terms "connected," "coupled," or any variant thereof, means any connection or coupling, either direct or indirect, between two or more elements; the coupling or connection between the elements can be physical, logical, or a combination thereof. Additionally, the words "herein," "above," "below," and words of similar import, when used in this application, refer to this application as a whole and not to any particular portions of this application. Where the context permits, words in the above Detailed Description using the singular or plural number may also include the plural or singular number respectively. The word "or," in reference to a list of two or more items, covers all of the following interpretations of the word: any of the items in the list, all of the items in the list, and any combination of the items in the list.
[0059] The teachings of the invention provided herein can be applied to other systems, not necessarily the system described above. The elements and acts of the various examples described above can be combined to provide further implementations of the invention. Some alternative implementations of the invention may include not only additional elements to those implementations noted above, but also may include fewer elements. Further any specific numbers noted herein are only examples— alternative implementations may employ differing values or ranges.
[0060] While the above description describes various embodiments of the invention and the best mode contemplated, regardless how detailed the above text, the invention can be practiced in many ways. Details of the system may vary considerably in its specific implementation, while still being encompassed by the present disclosure. As noted above, particular terminology used when describing certain features or aspects of the invention should not be taken to imply that the terminology is being redefined herein to be restricted to any specific characteristics, features, or aspects of the invention with which that terminology is associated. In general, the terms used in the following claims should not be construed to limit the invention to the specific examples disclosed in the specification, unless the above Detailed Description section explicitly defines such terms. Accordingly, the actual scope of the invention encompasses not only the disclosed examples, but also all equivalent ways of practicing or implementing the invention under the claims.
[0061 ] From the foregoing, it will be appreciated that specific embodiments of the invention have been described herein for purposes of illustration, but that various modifications may be made without deviating from the spirit and scope of the various embodiments of the invention. Further, while various advantages associated with certain embodiments of the invention have been described above in the context of those embodiments, other embodiments may also exhibit such advantages, and not all embodiments need necessarily exhibit such advantages to fall within the scope of the invention. Accordingly, the invention is not limited, except as by the appended claims. Although certain aspects of the invention are presented below in certain claim forms, the applicant contemplates the various aspects of the invention in any number of claim forms. Accordingly, the applicant reserves the right to pursue additional claims after filing this application to pursue such additional claim forms, in either this application or in a continuing application.

Claims

CLAIMS I/We claim:
1 . A method for detecting damage to an electronic device, the method comprising:
receiving an image of an electronic device;
comparing a first portion of the image with an inverted second portion of the image, wherein the first portion of the image shows a first peripheral region of the electronic device and the inverted second portion of the image shows an opposite second peripheral region of the electronic device; and
based on the comparison, evaluating a condition of the electronic device.
2. The method of claim 1 wherein comparing the first portion of the image with the inverted second portion of the image includes subtracting one of the first and second portions of the image from the other of the first and second portions of the image.
3. The method of claim 1 , further comprising dividing the image into a grid of segments, the grid including rows of the segments parallel to a long axis of the electronic device and columns of the segments parallel to a short axis of the electronic device, wherein comparing the first portion of the image with the inverted second portion of the image includes comparing a first one of the segments with an inverted second one of the segments.
4. The method of claim 3 wherein the first and second segments are within the same column of the grid.
5. The method of claim 4 wherein the first and second segments are spaced apart within the same column of the grid.
6. The method of claim 3 wherein the first and second segments are within the same row of the grid.
7. The method of claim 6 wherein the first and second segments are spaced apart within the same row of the grid.
8. The method of claim 3, further comprising:
before comparing the first segment and the inverted second segment, cropping the first segment to remove a portion of the first segment showing a first edge of the electronic device adjacent to the first peripheral region of the electronic device; and
before comparing the first segment and the inverted second segment, cropping the second segment to remove a portion of the second segment showing a second edge of the electronic device adjacent to the second peripheral region of the electronic device.
9. The method of claim 1 wherein comparing the first portion of the image with the inverted second portion of the image comprises:
moving the first portion of the image and the inverted second portion of the image into an overlapping state; and
iteratively changing a position of the first portion of the image relative to the second portion of the image in the overlapping state, a position of the second portion of the image relative to the first portion of the image in the overlapping state, or both to align the first peripheral region of the electronic device in the first portion of the image and the inverted second peripheral region of the electronic device in the second portion of the image.
10. The method of claim 1 wherein comparing the first portion of the image with the inverted second portion of the image comprises calculating a sum of absolute differences between overlapping pixels of the first portion of the image and the inverted second portion of the image.
1 1 . The method of claim 10 wherein evaluating the condition of the electronic device comprises determining whether the calculated sum of absolute differences exceeds a predetermined threshold.
12. The method of claim 1 1 , further comprising receiving an identification of the electronic device, wherein the predetermined threshold is based at least in part of the received identification.
13. A method for detecting damage to an electronic device, the method comprising:
receiving an image of an electronic device;
dividing the image into a grid of segments, the grid including rows of the segments parallel to a long axis of the electronic device and columns of the segments parallel to a short axis of the electronic device, wherein a first set of the segments shows a first peripheral region of the electronic device and a second set of the segments shows an opposite second peripheral region of the electronic device; comparing segments in the first set to corresponding inverted segments in the second set; and
based on the comparisons, evaluating a condition of the electronic device.
14. The method of claim 13, wherein each of the compared segments in the first set is in the same row of the grid as the corresponding inverted segment in the second set.
15. The method of claim 13, wherein each of the compared segments in the first set is in the same column of the grid as the corresponding inverted segment in the second set.
16. The method of claim 13 wherein comparing the segments in the first set to corresponding inverted segments in the second set comprises:
moving a given one of the segments in the first set and a corresponding segment in the second set into an overlapping state; and iteratively changing the relative position of the given segment in the first set and the corresponding segment in the second set to align the first peripheral region of the electronic device in the given segment in the first set and the inverted second peripheral region of the electronic device in the corresponding segment in the second set.
17. The method of claim 13 wherein comparing the segments in the first set to corresponding inverted segments in the second set comprises calculating a sum of absolute differences between overlapping pixels of the segments in the first set and the corresponding inverted segments in the second set.
18. A computer-readable memory carrying computer-executable instructions for causing one or more processors to facilitate detecting damage to an electronic device, the computer-executable instructions comprising instructions that, when executed by the one or more processors:
receive an image of a front side of the electronic device;
compare a first portion of the image with an inverted second portion of the image, wherein the first portion of the image shows a first peripheral region of the electronic device and the inverted second portion of the image shows an opposite second peripheral region of the electronic device; and
based on the comparison, evaluate a condition of the electronic device.
19. The method of claim 18 wherein the computer-readable instructions, when executed by the one or more processors, subtract one of the first and second portions of the image from the other of the first and second portions of the image.
20. The method of claim 18 wherein the computer-readable instructions, when executed by the one or more processors:
divide the image into a grid of segments, the grid including rows of the segments parallel to a long axis of the electronic device and columns of the segments parallel to a short axis of the electronic device, wherein comparing the first portion of the image with the inverted second portion of the image includes comparing a first one of the segments with an inverted second one of the segments.
21 . The method of claim 18 wherein the computer-readable instructions, when executed by the one or more processors:
move the first portion of the image and the inverted second portion of the image into an overlapping state; and
iteratively change a relative position of the first portion of the image and the second portion of the image to align the first peripheral region of the electronic device in the first portion of the image and the inverted second peripheral region of the electronic device in the second portion of the image.
22. The method of claim 18 wherein the computer-readable instructions, when executed by the one or more processors, calculate a sum of absolute differences between overlapping pixels of the first portion of the image and the inverted second portion of the image.
PCT/US2017/030520 2016-05-06 2017-05-02 Methods and systems for detecting damage in edge regions of mobile electronic devices WO2017192496A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662332736P 2016-05-06 2016-05-06
US62/332,736 2016-05-06

Publications (1)

Publication Number Publication Date
WO2017192496A1 true WO2017192496A1 (en) 2017-11-09

Family

ID=59034836

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/030520 WO2017192496A1 (en) 2016-05-06 2017-05-02 Methods and systems for detecting damage in edge regions of mobile electronic devices

Country Status (1)

Country Link
WO (1) WO2017192496A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3951368A4 (en) * 2019-03-29 2022-11-30 Mintit Co., Ltd. Electronic device valuation system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2167553A (en) * 1984-11-22 1986-05-29 Hajime Industries Automatic inspection device
US20080306701A1 (en) * 2007-06-07 2008-12-11 Lei Zhong Computer-implemented methods, carrier media, and systems for detecting defects on a wafer based on multi-core architecture
WO2014075055A1 (en) * 2012-11-12 2014-05-15 Kla-Tencor Corporation Method and system for mixed mode wafer inspection

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2167553A (en) * 1984-11-22 1986-05-29 Hajime Industries Automatic inspection device
US20080306701A1 (en) * 2007-06-07 2008-12-11 Lei Zhong Computer-implemented methods, carrier media, and systems for detecting defects on a wafer based on multi-core architecture
WO2014075055A1 (en) * 2012-11-12 2014-05-15 Kla-Tencor Corporation Method and system for mixed mode wafer inspection

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3951368A4 (en) * 2019-03-29 2022-11-30 Mintit Co., Ltd. Electronic device valuation system

Similar Documents

Publication Publication Date Title
US11803954B2 (en) Methods and systems for detecting cracks in illuminated electronic device screens
CA3124343C (en) Methods and systems for detecting screen covers on electronic devices
US10127647B2 (en) Methods and systems for detecting cracks in electronic devices
US11922467B2 (en) Evaluating an electronic device using optical character recognition
US20160275460A1 (en) Systems and methods for inspecting mobile devices and other consumer electronic devices with a laser
US20160275518A1 (en) Device recycling systems with facial recognition
WO2016196175A1 (en) Methods and systems for visually evaluating electronic devices
US20160125548A1 (en) Methods and systems for facilitating processes associated with insurance services and/or other services for electronic devices
WO2016094632A1 (en) Methods and systems for identifying mobile phones and other electronic devices
US20160092849A1 (en) Methods and systems for pricing and performing other processes associated with recycling mobile phones and other electronic devices
WO2016094789A1 (en) Systems and methods for recycling consumer electronic devices
WO2017192496A1 (en) Methods and systems for detecting damage in edge regions of mobile electronic devices
WO2022040672A1 (en) Kiosk for evaluating and purchasing used electronic devices
US12033454B2 (en) Kiosk for evaluating and purchasing used electronic devices
CN219936464U (en) Device for mobile electronic equipment in self-service terminal and self-service terminal
CN218788211U (en) Self-service terminal for recycling mobile equipment
CA3192240A1 (en) Kiosk for evaluating and purchasing used electronic devices

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17729214

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17729214

Country of ref document: EP

Kind code of ref document: A1