KR102624572B1 - Method and system for acquiring information inside the device, in an electronic devices - Google Patents

Abstract

A system and method for obtaining information inside an electronic device is disclosed. According to an embodiment of the present invention, a device internal information acquisition system includes the steps of receiving a selection of 'user operation before input' from the user through the UI screen of the automated device; Recognizing the product information ID screen displayed on the display of the mobile device inserted into the input space of the automated device as 'screen ON state input' is selected as the 'user operation before input'; And it may include reading a unique ID for the mobile device from the recognized product information ID screen.

Description

Method and system for obtaining information inside the device in electronic devices {METHOD AND SYSTEM FOR ACQUIRING INFORMATION INSIDE THE DEVICE, IN AN ELECTRONIC DEVICES}

The present invention relates to a method and device for obtaining information inside electronic devices that can solve problems that occur when interconnecting with the inside of a mobile device according to new functions and security policy changes in mobile devices.

For existing mobile devices, for example, manufacturers provide an API (Application Programming Interface) for development so that mobile device app and web SW developers can access and link various information inside the mobile device for the convenience of development. there is.

Recently, as part of the policy of strengthening the personal information protection of mobile devices, functions are restricted so that specific information inside the device cannot be retrieved, or when the mechanical connection port for linking with a mobile device is removed, specific information inside the device is removed. There may be significant restrictions on importing it.

In order to maintain a mobile device, the status of the mobile device must be checked. Additionally, when selling a mobile device, you must check the mobile device's unique ID (manufacturing number, product unique number, such as serial number or IMEI number) to check the status history of the mobile device and whether it has been stolen.

As a method of checking and confirming the status of the device, the user can directly operate (touch) the screen with the unique ID on the display of the mobile device and visually check it, or the unique ID can be read through linking with the mobile device. There may be methods such as through App (Application: App) and Web SW (World wide web SW: Web SW). App is application SW that is installed and executed on mobile devices, and Web SW refers to SW that links mobile devices through communication networks (wired, wireless, etc.) such as the Internet.

When directly checking the unique ID, the user directly operates the mobile device and visually confirms it.

When reading a unique ID in conjunction with a mobile device, a specific device and App/Web SW are used, and it is often used in automated devices that replace human labor (labor).

However, if the ability to read the unique ID in conjunction with a mobile device is restricted or there is no interface to forcibly read the unique ID, a problem may arise as to how to read the unique ID. For example, in the case of a cell phone, which is one of the mobile devices, it is possible to determine whether the cell phone is stolen by checking and comparing a specific ID that can confirm theft information among the unique IDs.

In general, device internal information can be confirmed only when the user enters the user interface (mobile device screen UI: USER INTERFACE) at designated stages and reaches the screen with the unique ID.

Therefore, in checking the device's internal information, an improved model that excludes the user's manual operation and allows the user to conveniently check the device's internal information by minimizing the user's actions in the automated device is urgently needed. .

An embodiment of the present invention provides a method and system for obtaining information inside the device in electronic devices by analyzing the screen of the mobile device input to the automated device and extracting a unique ID for the mobile device. The purpose.

Additionally, an embodiment of the present invention aims to control the screen of a mobile device inputted into an automated device and enter a product information ID screen including a unique ID.

Additionally, an embodiment of the present invention aims to automatically correct the posture of a mobile device inserted into an automated device, so that the screen of the mobile device can be optimally controlled by the automated device.

Additionally, an embodiment of the present invention aims to accurately control the screen of a mobile device by utilizing spatial touch using a spatial touch HAND.

According to an embodiment of the present invention, a method for obtaining information inside a device in electronic devices includes the steps of receiving a user's selection of 'user action before input' through a UI screen of an automated device; Recognizing the product information ID screen displayed on the display of the mobile device inserted into the input space of the automated device as 'screen ON state input' is selected as the 'user operation before input'; And it may include reading a unique ID for the mobile device from the recognized product information ID screen.

In addition, according to an embodiment of the present invention, a system for obtaining information inside the device in electronic devices includes a selection unit for selecting 'user operation before input' from the user through the UI screen of the automated device; And as 'screen ON state input' is selected as the 'user action before input', the product information ID screen displayed on the display of the mobile device inserted into the input space of the automated device is recognized, and the recognized product information ID screen From, it can be configured to include a recognition unit that reads the unique ID for the mobile device.

According to an embodiment of the present invention, a method and system for obtaining information inside the device in electronic devices is provided by analyzing the screen of a mobile device input to an automated device and extracting a unique ID for the mobile device. can do.

Additionally, according to the present invention, it is possible to control the screen of a mobile device inserted into an automated device and enter the product information ID screen including a unique ID.

Additionally, according to the present invention, the posture of a mobile device inserted into an automated device can be automatically corrected so that the screen of the mobile device can be optimally controlled by the automated device.

Additionally, according to the present invention, it is possible to accurately control the screen of a mobile device by utilizing spatial touch using a spatial touch HAND.

Figure 1 is a block diagram showing the configuration of a system for obtaining information inside electronic devices in electronic devices according to an embodiment of the present invention.
Figure 2 is a diagram illustrating a unique ID of a mobile device.
Figure 3 is a diagram showing an example of obtaining a unique ID of a mobile device.
Figure 4 is a diagram illustrating an example of displaying a product information ID screen on a display of a mobile device.
Figure 5 is a diagram illustrating manipulation of a mobile device using coordinate recognition and spatial touch according to the present invention.
Figure 6 is a diagram for explaining spatial touching according to the present invention.
Figure 7 is a diagram generally explaining a method of obtaining a unique ID inside a mobile device according to the present invention.
Figure 8 is a diagram illustrating an example of obtaining a unique ID inside the mobile device by installing an APP after inserting the mobile device.
Figure 9 is a flowchart illustrating a method for obtaining information inside electronic devices, according to an embodiment of the present invention.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. However, various changes can be made to the embodiments, so the scope of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents, or substitutes for the embodiments are included in the scope of rights.

The terms used in the examples are for descriptive purposes only and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by a person of ordinary skill in the technical field to which the embodiments belong. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the present application, should not be interpreted in an ideal or excessively formal sense. No.

In addition, when describing with reference to the accompanying drawings, identical components will be assigned the same reference numerals regardless of the reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiments, if it is determined that detailed descriptions of related known technologies may unnecessarily obscure the gist of the embodiments, the detailed descriptions are omitted.

Figure 1 is a block diagram showing the configuration of a system for obtaining information inside electronic devices in electronic devices according to an embodiment of the present invention.

Referring to FIG. 1, a system 100 for acquiring information inside a device in electronic devices (hereinafter abbreviated as 'device internal information acquisition system') according to an embodiment of the present invention includes a selection unit. It may be configured to include (110) and a recognition unit (120). Additionally, depending on the embodiment, the device internal information acquisition system 100 may be configured by selectively adding a processing unit 130 and a correction unit 140.

First, the selection unit 110 receives a selection of 'user action before input' from the user through the UI screen of the automated device. In other words, the selection unit 110 may serve to allow a user approaching the automated device to select what state the mobile terminal should be in and put into the automated device through the UI screen.

'User action before input' presented on the UI screen may include 'Input with screen ON state', 'Input after installing the App', 'Install the App after input', and 'Input after unlocking the password', and there is a selection part. (110) can receive the one clicked by the user as the 'user action before input' of the user's choice.

‘Inserting the screen ON state’ may be a user action of inserting the mobile device into the automated device while displaying the product information ID screen including the unique ID on the display.

In the present invention, installation of the App on a mobile device can be selectively performed before or after inserting the mobile device into the automated device.

‘App installation and insertion’ may be a user action of inserting a mobile device into an automated device while installing the App so that the automated device can control the mobile device. Depending on the embodiment, 'app installation and insertion' refers to a user action that displays the product information ID screen directly on the display with a single click on the app and inserts the mobile device with the product information ID screen displayed into the automated device. You can.

'Installation of App after insertion' may be a user action that automatically installs an App on the inserted mobile device as the mobile device is inserted into the automated device. Depending on the embodiment, 'installing the App after insertion' may be a user action that installs the App on the mobile device that has been inserted into the automated device and subsequently displays the product information ID screen on the display by the APP.

‘Inserting after unlocking the password’ may be a user action of inserting the mobile device into the automated device while only unlocking it.

As 'screen ON state input' is selected as the 'user action before input', the recognition unit 120 recognizes the product information ID screen displayed on the display of the mobile device inserted into the input space of the automated device. In other words, the recognition unit 120 may serve to check the product information ID screen displayed on the display of the mobile device by the user who selects 'input screen ON state'.

Under the selection of 'Insert screen ON state', entry into the product information ID screen can be achieved by the user directly operating the mobile device (manually clicking the menu) and displaying the product information ID screen on the display.

The product information ID screen may be a device status screen that displays a unique ID for the mobile device, and may display internal ID information about the device, including, for example, IMEI information of the mobile device.

Afterwards, the recognition unit 120 reads the unique ID for the mobile device from the recognized product information ID screen. In other words, the recognition unit 120 can scan the product information ID screen and read the combination of letters/numbers/special symbols corresponding to the unique ID.

Through this, the device internal information acquisition system 100 can extract a unique ID for the mobile device by analyzing the screen of the mobile device inputted into the automated device.

In another embodiment, when the user selects 'Insertion after installing the App' as the 'User action before input', the device internal information acquisition system 100 remotely controls the mobile device through the installed App to produce a product. You can enter the information ID screen.

To this end, the device internal information acquisition system 100 can be configured by adding a processing unit 130.

That is, as 'Insertion after App installation' is selected as the 'User operation before input', the processing unit 130 executes the installed App on the mobile device inserted into the input space of the automated device and displays it on the display of the mobile device. The product information ID screen can be displayed.

In another embodiment, when the user selects 'Install App after insertion' as the 'User action before insertion', the device internal information acquisition system 100 recognizes that the mobile device is inserted into the automated device. , Apps can be automatically installed on inserted mobile devices. Through this, the device internal information acquisition system 100 can remotely control the mobile device through the installed App and enter the product information ID screen.

To this end, the processing unit 130 can automatically install the App on the mobile device inserted into the input space of the automated device as 'Install App after insertion' is selected as the 'user action before insertion'.

Additionally, the processing unit 130 can execute the installed App and display a product information ID screen on the display of the mobile device.

Here, the App may be a dedicated application for implementing remote control of a mobile device.

When installing an App, for example, there may be a case where guidance is provided from an automated device to a nearby user, and the user manually downloads and installs the App on the mobile device according to the provided guidance. As another example, there may be a case where an app is automatically downloaded and installed on a mobile device that has been confirmed to be inserted into an automated device.

Under the selection of 'Installation after installing the App' or 'Install the App after inserting', entering the product information ID screen is performed by the automated device remotely controlling the mobile device (automatically clicking on the menu) through the App and displaying the product information. This can be done by displaying the ID screen.

Thereafter, the recognition unit 120 may recognize the product information ID screen displayed on the display of the mobile device and read the unique ID for the mobile device from the recognized product information ID screen. That is, the recognition unit 120 can scan the product information ID screen displayed through remote control by the App and read the combination of letters/numbers/special symbols corresponding to the unique ID.

Through this, the device internal information acquisition system 100 controls the screen of the mobile device input to the automated device, enters the product information ID screen including a unique ID, analyzes the entered product information ID screen, and You can extract the unique ID for .

Depending on the embodiment, the device internal information acquisition system 100 may store the product information ID screen displayed through remote control by an App as an image and read a unique ID from the saved image.

To this end, the processing unit 130 can Screen Save the product information ID screen displayed on the display of the mobile device to generate screen save data. That is, the processing unit 130 prepares an environment in which screen storage data of relatively small images can be analyzed instead of analyzing the product information ID screen itself.

Thereafter, the recognition unit 120 may extract a unique ID for the mobile device from the screen storage data.

Through this, the device internal information acquisition system 100 can extract a unique ID from the screen save data of the product information ID screen, thereby securing the internal information of the mobile device using small processing resources. there is.

In another embodiment, when the user selects 'Password release and input' as the 'User action before input', the device internal information acquisition system 100 performs a touch operation on the mobile device to generate product information ID. You can enter the screen.

To this end, the device internal information acquisition system 100 can be configured by adding a correction unit 140.

That is, the correction unit 140 can correct the posture of the mobile device inserted into the insertion space of the automated device as 'insertion after password release' is selected as the 'user action before insertion'. In other words, the correction unit 140 is an input space provided in an automated device where the user unlocks the mobile device and can correct the mobile device to a defined posture so that the user can touch the space.

In correcting posture, the correction unit 140 can correct the posture of the mobile device so that it remains level within the insertion space and does not lean to one side.

To this end, the correction unit 140 corrects the tilt by moving at least one side of the mobile device in the same direction as one side of the input space, and tilts the correct center of the mobile device after the tilt correction and is set in the input space. Position correction can be performed by matching the center coordinates of the coordinate system.

For example, if the input space is in the form of a box with a square bottom, the correction unit 140 may perform tilt correction and position correction on the mobile device so that it is placed at the same angle and direction as the bottom surface of the input space.

For location identification and posture correction operations for mobile devices inserted into the input space, a camera that captures the mobile device from the top and images taken from the camera can be used.

The processing unit 130 may display a product information ID screen on the display of the mobile device by manipulating a spatial touch on the mobile device after correction of the posture.

Here, spatial touch may refer to an operation of automatically touching the display of a mobile device that has been corrected and placed in a specified posture in the input space, excluding manual touch by the user.

Through correction, the touch area can be set to a rectangular shape that can at least contain the mobile device inside so that it lies at the same angle and direction as the floor surface of the input space.

The processing unit 130 can set a grid-shaped coordinate system according to the light flow between the 'light source' and 'reception' arranged at predetermined intervals on the touch area.

Additionally, the processing unit 130 recognizes the change in the optical flow, calculates the XY coordinates in the coordinate system, and uses a spatial touch HAND that moves the x-side driving rail and the y-side driving rail to You can manipulate spatial touch.

In other words, the processing unit 130 converts the coordinates at which light emitted from the 'light source' flows to a 'reception' value other than the scheduled 'reception' or where the optical flow is temporarily stopped to the XY coordinates at which the optical flow has changed. You can calculate and move the spatial touch HAND to the calculated XY coordinates.

The spatial touch HAND can move to XY coordinates through the It can be manipulated.

XY coordinates may be step-by-step position values for switching to predetermined submenus for each mobile device.

Under the selection of 'Password unlocked and entered', entry into the product information ID screen can be made by displaying the product information ID screen on the display of the mobile device through spatial touch using the spatial touch HAND.

Thereafter, the recognition unit 120 may recognize the product information ID screen displayed on the display of the mobile device and read the unique ID for the mobile device from the recognized product information ID screen. That is, the recognition unit 120 can scan the product information ID screen displayed through spatial touch and read the combination of letters/numbers/special symbols corresponding to the unique ID.

Through this, the device internal information acquisition system 100 can automatically correct the posture of the mobile device inserted into the automation device to ensure optimal control of the screen of the mobile device by the automation device.

Additionally, the device internal information acquisition system 100 can accurately control the screen of the mobile device by selectively utilizing spatial touch using the spatial touch HAND.

The device internal information acquisition system 100 of the present invention can acquire internal information of a mobile device by dividing the case into a case where the user's participation activity is large and a case where the user's participation activity is small.

In cases where there are many user participation activities, the device internal information acquisition system 100 can simplify the functions that the automated device must perform.

On the other hand, in cases where the user's participation is small, the device internal information acquisition system 100 may require various devices and control technologies to process many functions because the functions of the automated device increase.

The device internal information acquisition system 100 may use a method of linking a user's operation and an imaging device as a method of obtaining a unique ID.

The method of linking the user's operation and the video device is: ⅰ) The user directly touches the UI screen (product information ID screen) where the unique ID, which is internal information, appears through the user interface (hereinafter referred to as 'UI') of the mobile device. (Press) and ii) Insert the mobile device with the product information ID screen displayed into the automated device, and then have the automated device recognize the product information ID screen and read the unique ID.

When a mobile device is inserted into an automated device, the device internal information acquisition system 100 recognizes the product information ID screen displayed on the display of the mobile device in the automated device, and automatically determines the unique ID of the mobile device from the recognized product information ID screen. You can lead with .

The device internal information acquisition system 100 includes a recognition algorithm that acquires internal information (unique ID) about the mobile device by reading graphics (barcode and QR code) and TEXT (letters, numbers) displayed on the product information ID screen. can do.

There are two ways to recognize the product information ID screen: shooting using an imaging device and scanning. Depending on the recognition method, there may be differences in the text recognition and reading process.

The scanning method is performed by carefully controlling the position and spacing between the screen of the mobile device and the imaging device.

The shooting method can be implemented by paying attention to focus, VIEW ANGLE (view area), screen distortion according to lens and distance, etc.

In particular, whether to apply additional lighting can be determined depending on the type of imaging device used and its installation location, and lighting can be appropriately applied depending on the recognition method and configuration.

The device internal information acquisition system 100 can recognize the product information ID screen as one or more still screens.

The device internal information acquisition system 100 includes a software algorithm that identifies the corresponding letter and number portion on the recognized product information ID screen and converts the identified letter/number portion into letters or numbers that can be read by an automated device. can do.

If the product information ID screen includes a barcode or QR CODE, the device internal information acquisition system 100 can read and process the unique ID of the mobile device through a dedicated reader algorithm (SW).

If the product information ID screen contains a string of only characters, the device internal information acquisition system 100 uses a character comparison and conversion algorithm (e.g., OCR: optical character) to cut out the screen of the required area from the string. Reader) can be applied to read and process the unique ID of the mobile device.

There are various ways to find a string, but since the information provided on the product information ID screen is similar depending on the manufacturer, the device internal information acquisition system 100 can easily find the necessary string through basic learning about menu images. .

The device internal information acquisition system 100 may be additionally equipped with analysis technology for arbitrary fonts because characters may be displayed in various fonts depending on the customer's cell phone string settings.

Figure 2 is a diagram illustrating a unique ID of a mobile device.

The device internal information acquisition system 100 can recognize the product information ID screen through an automated device when the product information ID screen shown in FIG. 2 is displayed on the display of the mobile device through the user's UI manipulation. In automated devices, the analysis algorithm (SW) can be used to find the string corresponding to the IMEI on the product information ID screen, and to read a unique ID consisting of actual TEXT letters and numbers from this string.

That is, the device internal information acquisition system 100 can read IMEI '358697100169755' as the unique ID of the mobile device.

Figure 3 is a diagram showing an example of obtaining a unique ID of a mobile device.

Figure 3a shows an example of a user operating a mobile device so that the product information ID screen appears and then inserting it into an automated device.

In Step 1 of FIG. 3A, it is exemplified that the user, USER, directly operates the mobile device.

Step 2 and Step 3 in FIG. 3A show an example of inserting the mobile device into the automated device with the product information ID screen displayed on the display of the mobile device according to the user's operation.

Figure 3b is a diagram showing an example in which a user downloads and executes a necessary application on a mobile device and then inserts it into an automated device.

In Step 1 of FIG. 3B, as the mobile device and the automated device are in close proximity and connected wirelessly, a necessary application is downloaded and executed on the mobile device.

Step 2 in Figure 3b shows an example of displaying the product information ID screen on the display of the mobile device with one click using the necessary application and inserting the mobile device into the automated device with the product information ID screen displayed. It is also a degree.

Depending on the embodiment, the device internal information acquisition system 100 may display a product information ID screen on the display of the mobile device by remotely controlling the mobile device using a necessary application.

Figure 3c is a diagram showing an example of when a user approaches an automated device, operates the product information ID screen to appear according to instructions from the automated device, and then inputs the product into the automated device.

In Step 1 of FIG. 3C, it is exemplified that the USER operates the mobile device to display the product information ID screen according to pre-input guidance from the automated device. Here, pre-input guidance may include voice guidance provided directly to the user, text/graphic guidance provided through the screen of an automated device, etc.

Step 2 in FIG. 3C shows an example of inserting a mobile device into an automated device with the product information ID screen displayed on the display of the mobile device. In another embodiment, the product information ID screen can be converted into a barcode form and input into an automated device, thereby preventing the product information ID screen from being leaked to the outside.

There are two ways to display the product information ID screen on the display of a mobile device: one is to use hidden functions provided by each mobile device manufacturer, and the other is to use an app.

A method of using the hidden function provided by the mobile device manufacturer can be performed by a user who has checked the information for each model of the mobile device, recognizes how to use the hidden function, and then executes the corresponding code in call mode.

Figure 4 is a diagram illustrating an example of displaying a product information ID screen on a display of a mobile device.

Figure 4a illustrates that the user inputs a previously recognized code "*#06#" in the call mode of the mobile device to run the product information ID screen.

The code "*#06#" may be, for example, a code that the user recognizes in advance, or the automated device may check the model of the mobile device and guide the user.

Figures 4b and 4c are examples of screens that execute the product information ID screen according to the input of code "*#06#".

Figure 4b is an example of a screen that displays the product information ID screen regarding IMEI and S/N by converting it into a barcode format.

Figure 4c is an example of a screen that shows the product information ID screen related to device information converted to barcode form.

The code for executing the product information ID screen may differ depending on the manufacturer and model of the mobile device.

By recognizing the code to be entered in advance, users can quickly launch the product information ID screen and obtain the unique ID of the desired mobile device.

Additionally, depending on the manufacturer, IMEI2 information may be additionally provided on the product information ID screen.

In FIG. 4C, IMEI is the unique ID of the mobile device, and IMEI2 is the ID assigned by the telecommunication company. When reading the unique ID, the device internal information acquisition system 100 can read the unique ID to suit the correct purpose.

As the barcode shown in FIG. 4b or 4c is recognized by the automated device, the device internal information acquisition system 100 analyzes the barcode to check the corresponding number arrangement and reads the unique ID or enters the IMEI among the characters specified in the barcode. The unique ID can be read by identifying the corresponding character.

The device internal information acquisition system 100 may include multi-barcode recognition and processing technology to enable reading of multiple barcodes.

In addition, the device internal information acquisition system 100 provides guidance from the automated device when the user approaches the automated device (voice guidance from the automated device to the user, text/graphic guidance provided through the screen of the automated device). etc.), according to the above guidance, a dedicated application (App) can be induced to be downloaded to the user's mobile device.

When a dedicated application downloaded from a mobile device is executed, the device internal information acquisition system 100 allows the product information ID screen to be displayed on the display of the mobile device through a minimum of user touches (1 to 2 TOUCHs). You can.

Through this, the device internal information acquisition system 100 can prevent the user from performing complicated scrolling and menu searching.

Depending on the embodiment, the device internal information acquisition system 100 may display and recognize a product information ID screen using automation technology in the automated device as the mobile device is inserted into the automated device.

In this case, the device internal information acquisition system 100 may inform the user in advance to insert the mobile device with the PASSWORD or authentication function removed before inserting the mobile device into the automated device.

The device internal information acquisition system 100 may acquire the unique ID of the mobile device as the mobile device enters the inlet of the automated device or is placed on a specific location of the automated device.

At this time, the automated device can operate the mobile device to display the product information ID screen on the display of the mobile device.

The product information ID screen can be divided into a screen that shows the unique ID for the mobile device and a screen that shows the unique ID in the form of a barcode.

The device internal information acquisition system 100 turns on the power of the mobile device or turns on the screen in a black state (screen turned off, such as in power save mode) for the mobile device inserted into the automated device (basic operation mode). It can be manipulated.

The device internal information acquisition system 100 can remotely control a mobile device that is turned on or in a basic operation mode through an automated device and display a product information ID screen on the display of the mobile device.

Alternatively, the device internal information acquisition system 100 may display the product information ID screen on the display of the mobile device by performing a spatial touch operation on the mobile device that is turned on or in the basic operation mode through an automated device.

At this time, the device internal information acquisition system 100 can stabilize the mobile device so that it does not move because the size, size, and shape of the mobile device are diverse and are located in a non-fixed state in a specific space.

After fixing the mobile device, the device internal information acquisition system 100 may match the exact center coordinates of a specific space of the automated device with the center coordinates of the mobile device.

In matching the coordinates of a mobile device, the device internal information acquisition system 100 must be able to fix at least two sides of the mobile device, and the control direction for fixing can be set to more than one direction.

That is, the device internal information acquisition system 100 is provided with a moving and fixing axis inside the automated device, and can move the mobile device to the exact center and then fix the mobile device when it is located in the exact center.

In addition, the device internal information acquisition system 100 can touch the display of the mobile device using a structure that can fix the bottom surface of the mobile device located in the center.

If the mobile device is fixed to the central coordinates, the device internal information acquisition system 100 recognizes the exact location of the mobile device fixed in a specific space and the configuration and location of user interface menu screens within the mobile device.

In order for an automated device to sequentially display the product information ID screen by directly touching the mobile device, the coordinate values for the product information ID screen must be recognized.

Most mobile devices have a matrix structure and a screen that can be moved up, down, left, and right, so the device internal information acquisition system 100 can recognize the location information of the mobile device and perform a touch function.

In order to recognize the coordinate values of the

The device internal information acquisition system 100 may calculate coordinates for each function of the screen UI on the mobile device according to the recognized coordinates.

The device internal information acquisition system 100 can display the product information ID screen by pressing the corresponding menus in order based on the calculated coordinate values.

The device internal information acquisition system 100 may calculate coordinate values based on the mobile device itself, or may calculate coordinate values based on the floor surface.

In the case of using the floor as a reference, the device internal information acquisition system 100 calculates the operation coordinates (actual coordinates required when working with the menu) by correcting the UI icon coordinates for each model of the mobile device to the coordinates of the floor where the mobile device is located. You can.

Additionally, when using the mobile device itself as a reference, the device internal information acquisition system 100 may apply motion coordinates by determining a reference point to coordinate the mobile device itself.

Figure 5 is a diagram illustrating manipulation of a mobile device using coordinate recognition and spatial touch according to the present invention.

In FIG. 5A, the device internal information acquisition system 100 may set a coordinate system in advance for the floor surface of a specific space where the mobile device will be placed.

Thereafter, as the mobile device is placed in the specific space, the device internal information acquisition system 100 may calculate coordinate values (X, Y) occupied by the mobile device based on the set coordinate system.

After confirming that the location of the mobile device is fixed, the device internal information acquisition system 100 can check the size of the floor surface occupied by the mobile device and the coordinate value at which the location is fixed in the coordinate system set through the camera. In other words, the camera can be used to calculate the coordinate values of the floor surface and recognize the location coordinate value of the mobile device.

Additionally, the device internal information acquisition system 100 can also check the degree of separation between the center c of the set coordinate system and the coordinate values of the mobile device.

In FIG. 5B, the device internal information acquisition system 100 may be equipped with a spatial touch HAND that moves the x-side driving rail and the y-side driving rail.

At this time, the device internal information acquisition system 100 may calculate the location coordinates within the screen where the menu to be touched is located, based on center c.

In FIG. 5C, the device internal information acquisition system 100 uses a fixed support to rotate the mobile device to align the center of the mobile device with the center c of the bottom surface.

Thereafter, the device internal information acquisition system 100 can spatially touch the mobile device whose central coordinates are fixed by moving the spatial touch HAND on the x-side driving rail and the y-side driving rail.

Additionally, the device internal information acquisition system 100 is configured as a touch recognition device for an air touch function and may be provided with a light source unit having light emitting and receiving functions in the X and Y axes.

The light source unit can perform interlocking control functions with mobile devices and various wired and wireless I/Fs such as USB, BT, and WIFI through coordinate calculation and data conversion functions that enable coordinate recognition with X and Y coordinate values. .

The device internal information acquisition system 100 arranges a light source with a height H and a receiver at the bottom to provide the effect of touching the surface of the mobile device using the light emitted from the light source, thereby influencing the surface of the mobile device and It can reduce shock.

Figure 6 is a diagram for explaining spatial touching at a specific height space on the LCD of a mobile device according to the present invention.

Figure 6 illustrates an embodiment in which shock damage upon touching can be reduced by touching a specific space on the LCD without directly touching the LCD surface of the mobile device using the spatial touch HAND.

In FIG. 6A, the device internal information acquisition system 100 can calculate the touch area using a spatial touch recognizer while aligning the center c of the bottom surface of the automated device with the center of the mobile device.

The device internal information acquisition system 100 can spatially touch the surface of the mobile device using a spatial touch HAND that moves over the touch area calculated by the X-axis driving rail and the Y-axis driving rail. Spatial touch HAND can move on the touch area by the X and Y axis driving rails.

Figure 6b may be a functional structure diagram for spatial touch recognition.

In FIG. 6B, the device internal information acquisition system 100 can designate a light source and reception outside the touch area and use the optical flow between the light source and reception to set a grid-type coordinate system for spatial touch.

The light source can emit light using light-emitting power provided by the control unit. The control unit can be connected wired or wirelessly to USB/BT/WIFI/NFC by the I/F linked control unit.

In reception, the emitted light can be received.

In the optical flow between the light source and the receiver, the control unit can recognize the X and Y fluctuation values that change the optical flow and calculate the X and Y coordinate values. The calculated X, Y coordinate values are transmitted to the control unit, and the control unit can control the spatial touch HAND to perform a spatial touch at the X, Y coordinate values.

Figure 7 is a diagram generally explaining a method of obtaining a unique ID inside a mobile device according to the present invention.

In step 700, the device internal information acquisition system 100 allows the user to receive usage guidance from the device (automation device).

In step 705, the device internal information acquisition system 100 receives a selection of the type of user operation before inserting the mobile device from the user who receives usage guidance.

Step 710 and below are operations when the user selects to insert the mobile device without any additional action after unlocking the password.

In step 711, the device internal information acquisition system 100 may check the coordinates of the mobile device and calculate the location for each function.

In step 712, the device internal information acquisition system 100 may power on the mobile device and display the main screen.

In step 713, the device internal information acquisition system 100 may move to the corresponding screen (product information ID screen) based on the main screen UI of the mobile device.

Step 720 and below are operations when moving to the relevant screen (product information ID screen) of the mobile device and selecting to turn the screen on.

In step 721, the device internal information acquisition system 100 can capture the corresponding screen (product information ID screen) using a camera, scanner, etc. Step 721 may be a process that follows step 713.

Step 730 and below are operations when selecting to insert the app after installing it on the mobile device.

In step 731, the device internal information acquisition system 100 can control the mobile device and move to the corresponding screen (product information ID screen) through the App.

In step 732, the device internal information acquisition system 100 may determine whether the Screen Save function is possible.

If the Screen Save function is not possible, the device internal information acquisition system 100 may proceed to the previous step 721.

On the other hand, if the Screen Save function is enabled, in step 733, the device internal information acquisition system 100 can Screen Save the screen and then transmit data about the screen.

After step 721 or step 733, in step 740, the device internal information acquisition system 100 may extract graphics, letters, and numbers corresponding to the unique ID from the corresponding screen.

In step 750, the device internal information acquisition system 100 may proceed to the next step of the process after extracting the unique ID information.

Depending on the embodiment, the device internal information acquisition system 100 allows an automated device to remotely (mirror) control a mobile device.

Existing methods were limited to a method in which the user or automated device directly touched the screen of the mobile device and moved directly to the corresponding screen, or easily accessed the Pass Shift App (an app that takes the user directly to the desired screen).

The device internal information acquisition system 100 allows the mobile device to be remotely controlled from an external mirroring system and allows the screen of the mobile device to be viewed on the mirroring system, thereby controlling the mobile device inserted into the automated device from the automated device. It can be controlled automatically through remote control mirroring SW.

Here, mirroring may refer to a function in which a mobile device controls an automated device and shares the screen of the automated device, or an automated device remotely controls the mobile device and shares the screen of the mobile device.

By applying mirroring technology, the device internal information acquisition system 100 can safely obtain the ID of a mobile device and perform various tests without the need to install a separate hardware device in the automated device.

The device internal information acquisition system 100 can reduce problems that may occur in personal security authentication through mirroring technology.

The device internal information acquisition system 100 wirelessly downloads and executes the remote control mirroring app from the automated device to the mobile device. Users can download the remote control mirroring app directly through a device that provides the Internet and run it on their mobile device before downloading it directly from the automated device.

Methods for operating a remote control mirroring app include a method in which the user enters the product information ID screen through the user interface screen of the automated device, and a method in which the automated device enters the product information ID screen regardless of the user through the automatic control SW. This can be.

The method for a user to enter the product information ID screen through the user interface screen of an automated device is to display the actual screen of the mobile device in a size that is convenient for the user to operate while viewing the user interface screen, and then directly touch the user to enter the product information ID screen. let's go

The interface method used for mirroring control can be directly connected, but can also be controlled using various wireless communication methods such as WIFI, BT, and NFC provided by mobile devices.

In the method where an automated device enters the product information ID screen independently of the user through automatic control SW, the operation center can control it with a remote control function for the automated device, or the automated device can control it through remote control mirroring software technology. can do.

When an automated device is controlling, the menu screen configuration for the mobile device must be known through learning to be able to control it.

However, even if the automated device can know the manufacturer or model of the mobile device in advance, it is impossible to check the OS version within the mobile device.

In particular, the composition of the screen menu UI may differ slightly depending on the OS version.

In this case, you can pass the intermediate process using the One Pass Shift App or apply the barcode call method.

In the present invention, in addition to using the remote control mirroring function to move to the product information ID screen and capture the screen, two methods are proposed to easily obtain the unique ID of the product information ID screen by using remote control technology. do.

Method 1 may be a method in which a user or an automated device directly copies and uses the TEXT (letters, numbers) of the unique ID on the product information ID screen of a remotely controlled mobile device using a method such as a mouse drag.

Method 2 uses the Screen Save function on the product information ID screen of the mobile device to transmit the saved screen to an automated device, and the automated device recognizes letters, numbers, and barcodes corresponding to the unique ID in the saved screen. This may be a way to extract it.

Figure 8 is a diagram illustrating an example of obtaining a unique ID inside the mobile device by installing an APP after inserting the mobile device.

The device internal information acquisition system 100 can automatically install the App on the inserted mobile device as the mobile device is inserted into the automated device after the user selects 'Install App after insertion'.

The device internal information acquisition system 100 can install the App on the mobile device that has been input into the automated device and subsequently display the product information ID screen on the display by the APP.

In Figure 8, an example of controlling a mobile device through an APP being applied in a miniATM is explained.

In ① of FIG. 8, the device internal information acquisition system 100 can link the Cloud Server and the mobile device according to the input of the mobile device into the automated device.

In ②, the device internal information acquisition system 100 can extract the App from the Cloud Server and download it to the mobile device.

In ③, the device internal information acquisition system 100 can install the downloaded App on the mobile device.

In ④, the device internal information acquisition system 100 can execute the recording function on the mobile device after obtaining user consent for executing the Device LCD screen recording function.

In ⑤, the device internal information acquisition system 100 can dump to the device internal information screen and automatically capture the internal information screen.

In ⑥, the device internal information acquisition system 100 may store the captured screen in memory.

In ⑦, the device internal information acquisition system 100 can recognize the device internal information (IMEI, etc.) by recognizing the captured screen through the OCR processing function.

In ⑧, the device internal information acquisition system 100 can convert the device internal information into TEXT and transmit it to the server.

Typically, in order to recognize the internal information of a used cell phone, a method is used to connect a specific terminal device and a USB cable so that the specific device directly links the data inside the terminal device and retrieves the information inside the terminal device.

The method of physically connecting a terminal device is to use a USB cable, and the method of connecting software is to load specific information from the terminal device through an API CODE that can forcefully read the information in a specific environment. You can.

If it is difficult to use a specific API CODE due to strengthened security regulations and if physical connection is difficult, the following method can be implemented as a way to conveniently obtain the internal information of the terminal device.

This method is a method in which the terminal device itself finds internal information, analyzes it, converts it into data so that a specific external device can receive it and recognizes it, and can be an UNCONTECT method in which the CONTECT between the customer and the specific device is minimized.

In order to implement this, an App and several functions are required. First, an App that can navigate to or move to the screen (UI Depth Page) containing the internal information of the terminal device, and second, an App that can recognize or analyze the information on the screen. It requires a function to capture the screen or cut out a specific area of the screen and save it, and thirdly, a change function to convert the saved screen information into the desired data format.

The method to easily obtain the corresponding information of the terminal device through uncontact can be easily performed by downloading and executing the app that performs the corresponding function to the terminal device in advance.

The device internal information acquisition system 100 can acquire the corresponding information of the terminal device through uncontact by performing the following procedure.

The device internal information acquisition system 100 can wirelessly link the terminal device to a specific external device to download the corresponding APP and execute it step by step.

When running, the device internal information acquisition system 100 must perform steps to allow the customer to directly use the corresponding function in accordance with the security regulations of the terminal device. The permission method can be performed by following the consent procedure on the screen of the terminal device.

The device internal information acquisition system 100 can obtain internal information desired from the corresponding terminal device (device information of the terminal, i.e. IMEI, etc.) with the minimum customer involvement (contact) and minimize mechanical interworking with a specific device. APP that performs several functions can be linked and run together.

The App function that is executed is a function that automatically moves to the settings menu of the terminal device, captures the screen of the terminal device's internal information (IMEI, etc.), and stores it in a designated storage space (memory).

The device internal information acquisition system 100 may perform a function of moving to a screen containing internal information of the terminal device.

Finally, the device internal information acquisition system 100 converts the QR code, BARCODE, and TEXT (characters) included in a specific screen (graphic screen) stored in the designated storage space into data that can be recognized by the terminal device and external devices. You can extract the desired internal information by applying the OCR analysis function.

Through this, the device internal information acquisition system 100 can send the acquired internal information to an external device.

Hereinafter, in FIG. 9, the work flow of the device internal information acquisition system 100 according to embodiments of the present invention will be described in detail.

Figure 9 is a flowchart showing a method for obtaining information inside electronic devices, according to an embodiment of the present invention.

In electronic devices according to this embodiment, a method for acquiring information inside the device may be performed by the device internal information acquisition system 100.

First, the device internal information acquisition system 100 receives a selection of 'user action before input' from the user through the UI screen of the automated device (910). Step 910 may be a process of allowing the user approaching the automated device to select what state the mobile terminal should be in and put it into the automated device through a UI screen.

'User actions before input' presented on the UI screen may include 'Input with screen ON', 'Insertion after installing the App', 'Install the App after input', and 'Insertion after unlocking the password', etc. inside the device. The information acquisition system 100 can receive the one clicked by the user as the user-selected 'user action before input' input.

‘Inserting the screen ON state’ may be a user action of inserting the mobile device into the automated device while displaying the product information ID screen including the unique ID on the display.

In the present invention, installation of the App on a mobile device can be selectively performed before or after inserting the mobile device into the automated device.

‘App installation and insertion’ may be a user action of inserting a mobile device into an automated device while installing the App so that the automated device can control the mobile device. Depending on the embodiment, 'app installation and insertion' refers to a user action that displays the product information ID screen directly on the display with a single click on the app and inserts the mobile device with the product information ID screen displayed into the automated device. You can.

'Installation of App after insertion' may be a user action that automatically installs an App on the inserted mobile device as the mobile device is inserted into the automated device. Depending on the embodiment, 'installing the App after insertion' may be a user action that installs the App on the mobile device that has been inserted into the automated device and subsequently displays the product information ID screen on the display by the APP.

‘Inserting after unlocking the password’ may be a user action of inserting the mobile device into the automated device while only unlocking it.

In addition, the device internal information acquisition system 100 displays the product information ID screen displayed on the display of the mobile device inserted into the input space of the automated device as 'screen ON state input' is selected as the 'user action before input'. Recognize (920). Step 920 may be a process of checking the product information ID screen displayed on the display of the mobile device by the user who selects 'Insert screen ON state'.

Under the selection of 'Insert screen ON state', entry into the product information ID screen can be achieved by the user directly operating the mobile device (manually clicking the menu) and displaying the product information ID screen on the display.

The product information ID screen may be a device status screen that displays a unique ID for the mobile device, and may display internal ID information about the device, including, for example, IMEI information of the mobile device.

Continuing, the device internal information acquisition system 100 reads the unique ID for the mobile device from the recognized product information ID screen (930). Step 930 may be a process of scanning the product information ID screen and reading a combination of letters/numbers/special symbols corresponding to the unique ID.

Through this, the device internal information acquisition system 100 can extract a unique ID for the mobile device by analyzing the screen of the mobile device inputted into the automated device.

In another embodiment, when the user selects 'Insertion after installing the App' as the 'User action before input', the device internal information acquisition system 100 remotely controls the mobile device through the installed App to produce a product. You can enter the information ID screen.

For this purpose, the device internal information acquisition system 100 executes the installed App on the mobile device inserted into the input space of the automated device as 'Insertion after App installation' is selected as the 'user action before input'. The product information ID screen can be displayed on the display of the mobile device.

In another embodiment, when the user selects 'Install App after insertion' as the 'User action before insertion', the device internal information acquisition system 100 recognizes that the mobile device is inserted into the automated device. , Apps can be automatically installed on inserted mobile devices. Through this, the device internal information acquisition system 100 can remotely control the mobile device through the installed App and enter the product information ID screen.

To this end, the device internal information acquisition system 100 can automatically install the App on the mobile device inserted into the input space of the automated device as 'Install App after insertion' is selected as the 'user action before insertion'. .

Additionally, the device internal information acquisition system 100 can execute the installed App and display a product information ID screen on the display of the mobile device.

Here, the App may be a dedicated application for implementing remote control of a mobile device.

When installing an App, for example, there may be a case where guidance is provided from an automated device to a nearby user, and the user manually downloads and installs the App on the mobile device according to the provided guidance. As another example, there may be a case where an app is automatically downloaded and installed on a mobile device that has been confirmed to be inserted into an automated device.

Under the selection of 'Installation after installing the App' or 'Install the App after inserting', entering the product information ID screen is performed by the automated device remotely controlling the mobile device (automatically clicking on the menu) through the App and displaying the product information. This can be done by displaying the ID screen.

Thereafter, the device internal information acquisition system 100 may recognize the product information ID screen displayed on the display of the mobile device and read the unique ID for the mobile device from the recognized product information ID screen. In other words, the device internal information acquisition system 100 can read the combination of letters/numbers/special symbols corresponding to the unique ID by scanning the product information ID screen displayed through remote control by the App.

Through this, the device internal information acquisition system 100 controls the screen of the mobile device input to the automated device, enters the product information ID screen including a unique ID, analyzes the entered product information ID screen, and You can extract the unique ID for .

Depending on the embodiment, the device internal information acquisition system 100 may store the product information ID screen displayed through remote control by an App as an image and read a unique ID from the saved image.

To this end, the device internal information acquisition system 100 can Screen Save the product information ID screen displayed on the display of the mobile device to generate screen save data. In other words, the device internal information acquisition system 100 provides an environment in which screen storage data of relatively small images can be analyzed instead of analyzing the product information ID screen itself.

Thereafter, the device internal information acquisition system 100 may extract the unique ID for the mobile device from the screen storage data.

Through this, the device internal information acquisition system 100 can extract a unique ID from the screen save data of the product information ID screen, thereby securing the internal information of the mobile device using small processing resources. there is.

In another embodiment, when the user selects 'Password release and input' as the 'User action before input', the device internal information acquisition system 100 performs a touch operation on the mobile device to generate product information ID. You can enter the screen.

To this end, the device internal information acquisition system 100 can correct the posture of the mobile device inserted into the insertion space of the automated device as 'insertion after unlocking password' is selected as the 'user action before insertion'. In other words, the device internal information acquisition system 100 can correct the mobile device to a defined posture so that the user can touch the space when the mobile device is unlocked and inserted into the input space provided in the automated device.

In posture correction, the device internal information acquisition system 100 can correct posture so that the mobile device remains level within the input space and does not lean to one side.

To this end, the device internal information acquisition system 100 corrects the tilt by moving at least one side of the mobile device in the same direction as one side of the input space, and aligns the exact center of the mobile device after the tilt correction with the input space. Position correction can be performed by matching the center coordinates of the coordinate system set in space.

For example, if the input space is in the form of a box with a square bottom, the device internal information acquisition system 100 can perform tilt correction and position correction on the mobile device so that it is placed at the same angle and direction as the bottom surface of the input space. there is.

For location identification and posture correction operations for mobile devices inserted into the input space, a camera that captures the mobile device from the top and images taken from the camera can be used.

The device internal information acquisition system 100 may display a product information ID screen on the display of the mobile device by manipulating a spatial touch on the mobile device after correction of the posture.

Here, spatial touch may refer to an operation of automatically touching the display of a mobile device that has been corrected and placed in a specified posture in the input space, excluding manual touch by the user.

The device internal information acquisition system 100 calculates a touch area including at least the mobile device after the posture correction, and designates a 'light source' from which light is emitted and a 'reception' from which the light is incident to the touch area. By using the light source unit, a grid-like coordinate system for the touch area can be set according to the light flow.

Through correction, the touch area can be set to a rectangular shape that can at least contain the mobile device inside so that it is placed at the same angle and direction as the floor surface of the input space.

The device internal information acquisition system 100 can set a grid-shaped coordinate system according to the light flow between the 'light source' and 'reception' arranged at predetermined intervals on the touch area.

In addition, the device internal information acquisition system 100 recognizes the change in the optical flow, calculates the XY coordinates in the coordinate system, and calculates the calculated Spatial touch can be manipulated for XY coordinates.

In other words, the device internal information acquisition system 100 determines the coordinates where the light emitted from the 'light source' flows to a 'reception' of a value other than the scheduled 'reception', or the optical flow is temporarily stopped, and the optical flow changes. You can calculate the XY coordinates and move the spatial touch HAND to the calculated XY coordinates.

The spatial touch HAND can move to XY coordinates through the The spatial touch can be manipulated.

XY coordinates may be step-by-step position values for switching to predetermined submenus for each mobile device.

Under the selection of 'Release password and input', entry to the product information ID screen can be made by displaying the product information ID screen on the display of the mobile device through spatial touch using the spatial touch HAND.

Thereafter, the device internal information acquisition system 100 may recognize the product information ID screen displayed on the display of the mobile device and read the unique ID for the mobile device from the recognized product information ID screen. That is, the device internal information acquisition system 100 can read the combination of letters/numbers/special symbols corresponding to the unique ID by scanning the product information ID screen displayed through spatial touch.

Through this, the device internal information acquisition system 100 can automatically correct the posture of the mobile device inserted into the automated device to ensure optimal control of the screen of the mobile device by the automated device.

Additionally, the device internal information acquisition system 100 can accurately control the screen of the mobile device by selectively utilizing spatial touch using the spatial touch HAND.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

Although the embodiments have been described with limited drawings as described above, those skilled in the art can apply various technical modifications and variations based on the above. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the following claims.

100: Device internal information acquisition system
110: selection unit 120: recognition unit
130: processing unit 140: correction unit

Claims (17)

In the device internal information acquisition method performed by the device internal information acquisition system,
A step of receiving a selection of 'user action before input' from the user through the UI screen of the automated device;
The step of receiving a selection input for 'inputting screen ON state' from the user as the 'user operation before input' - the 'inputting screen ON state' refers to the step of receiving a selection input from the user while the product information ID screen is displayed on the display of the mobile device. Indicates a user action inputted into the automated device;
After the 'screen ON state input' is selected, when the mobile device with the product information ID screen displayed on the display is located in the input space of the automated device, recognizing the product information ID screen; and
Reading a unique ID for the mobile device from the recognized product information ID screen
Method for obtaining device internal information, including. According to paragraph 1,
As 'Insertion after App installation' is selected as the 'User action before input', the installed App is executed for the mobile device inserted into the input space of the automated device, and a product information ID screen is displayed on the display of the mobile device. step;
Recognizing a product information ID screen displayed on the display; and
Reading a unique ID for the mobile device from the recognized product information ID screen
A method of obtaining device internal information further comprising: According to paragraph 1,
When 'Install App after input' is selected as the 'User action before input', installing the App on the mobile device inserted into the input space of the automated device;
Executing the installed App and displaying a product information ID screen on the display of the mobile device;
Recognizing a product information ID screen displayed on the display; and
Reading a unique ID for the mobile device from the recognized product information ID screen
A method of obtaining device internal information further comprising: According to paragraph 2 or 3,
Screen saving the product information ID screen displayed on the display of the mobile device and generating screen save data; and
Extracting a unique ID for the mobile device from the screen storage data
A method of obtaining device internal information further comprising: According to paragraph 1,
Correcting the posture of the mobile device inserted into the insertion space of the automated device as 'Password release and insertion' is selected as the 'user action before insertion';
displaying a product information ID screen on the display of the mobile device by manipulating a spatial touch on the mobile device after correcting the posture;
Recognizing a product information ID screen displayed on the display; and
Reading a unique ID for the mobile device from the recognized product information ID screen
A method of obtaining device internal information further comprising: According to clause 5,
The posture correction step is,
Compensating tilt by moving at least one side of the mobile device in the same direction as one side of the input space; and
A step of correcting the position by matching the exact center of the mobile device after the tilt correction with the center coordinates of the coordinate system set in the input space
A method of obtaining device internal information including. According to clause 6,
The step of displaying the product information ID screen on the display of the mobile device is,
calculating a touch area including at least the mobile device after the posture correction; and
Setting a grid-shaped coordinate system for the touch area according to the light flow by a 'light source' that emits light to the touch area and a light source unit that designates a 'reception' where the light is incident.
A method of obtaining device internal information including. In clause 7,
The step of displaying the product information ID screen on the display of the mobile device is,
Recognizing changes in the optical flow and calculating XY coordinates within the coordinate system; and
Manipulating a spatial touch with respect to the calculated XY coordinates by a spatial touch HAND that moves the x-side driving rail and the y-side driving rail.
A method of obtaining device internal information further comprising: Through the UI screen of the automated device, a selection unit receives the user's selection for 'user operation before input' and receives a selection input from the user for 'screen ON state input' as the 'user operation before input' - the 'screen''ON state input' indicates a user action of inserting the mobile device into the automated device while the product information ID screen is displayed on the display of the mobile device; and
After the 'screen ON state input' is selected, if the mobile device with the product information ID screen displayed on the display is located in the input space of the automated device, the product information ID screen is recognized, and the recognized product information ID Recognition unit that reads the unique ID for the mobile device from the screen
A system for obtaining information inside the device in electronic devices including. According to clause 9,
As 'Insertion after App installation' is selected as the 'User action before input', the installed App is executed for the mobile device inserted into the input space of the automated device, and a product information ID screen is displayed on the display of the mobile device. processing department
It further includes,
The recognition unit,
Recognizes the product information ID screen displayed on the display and reads a unique ID for the mobile device from the recognized product information ID screen.
A system for obtaining information inside electronic devices. According to clause 9,
As 'Install App after insertion' is selected as the 'User action before insertion', the App is installed on the mobile device inserted into the input space of the automated device, the installed App is executed, and product information is displayed on the display of the mobile device. Processor that displays the ID screen
It further includes,
The recognition unit,
Recognizes the product information ID screen displayed on the display and reads a unique ID for the mobile device from the recognized product information ID screen.
A system for obtaining information inside electronic devices. According to claim 10 or 11,
The processing unit,
Screen save the product information ID screen displayed on the display of the mobile device to generate screen save data,
The recognition unit,
From the screen storage data, extracting a unique ID for the mobile device
A system for obtaining information inside electronic devices. According to clause 9,
A correction unit that corrects the posture of the mobile device inserted into the insertion space of the automated device as 'Password release and insertion' is selected as the 'user operation before insertion'; and
A processing unit that displays a product information ID screen on the display of the mobile device by operating a spatial touch on the mobile device after correction of the posture.
It further includes,
The recognition unit,
Recognizes the product information ID screen displayed on the display and reads a unique ID for the mobile device from the recognized product information ID screen.
A system for obtaining information inside electronic devices. According to clause 13,
The correction unit,
Tilt is corrected by moving at least one side of the mobile device in the same direction as one side of the input space,
Position correction by matching the exact center of the mobile device after the tilt correction and the center coordinates of the coordinate system set in the input space
A system for obtaining information inside electronic devices. According to clause 14,
The processing unit,
Calculating a touch area including at least the mobile device after the posture correction,
In the touch area, a grid-shaped coordinate system for the touch area is set according to the light flow by a 'light source' that emits light and a light source unit that designates a 'reception' where the light is incident.
A system for obtaining information inside electronic devices. According to clause 15,
The processing unit,
Recognizing changes in the optical flow, calculating XY coordinates in the coordinate system,
By using a spatial touch HAND that moves the x-side driving rail and the y-side driving rail, the spatial touch is manipulated with respect to the calculated XY coordinates.
A system for obtaining information inside electronic devices. A computer-readable recording medium recording a program for executing the method of any one of claims 1 to 3 and 5 to 8.

Images