TW201519051A - Mobile apparatus with optical indexer, and method for indexing using the same - Google Patents

Abstract

Disclosure is to a mobile apparatus having an optical indexer, and a method for performing indexing. The mobile apparatus includes an optical indexing module for sensing a movement. A control interface is generated in simulation and displayed on the mobile apparatus as it apparatus operates as a computer mouse. In the method, the simulated control interface is initiated in the beginning. The optical indexing module is activated to perform a tracing process, in which the optical indexing module emits a light and receives, especially by the multiple sensing cells arranged in an array, the reflected light. The photo energy received by the every sensing cell within a time slot can be computed. The energy difference in the time slot is used to determine a moving direction. An indexing signal is generated by converting moving signal made by optical indexing module and control signal from the simulated control interface.

Description

Mobile device with optical indicator and indication method

The invention relates to a mobile device and an indication method with an optical indicator, in particular to a mobile device provided with an optical indicator, which is indicated by a software mode of a virtual button.

The light sensor converts the received light into an electrical signal through a sensing element such as a CMOS (Complementary Metal Oxygen Half Field Effect Transistor) or a CCD (Charge Coupled Device), and the general technique can obtain the intensity of a specific light source through such a component. (Energy), from which the distance (as a distance sensor), the change in energy over time, and even the components captured by the image can be judged.

The optical pointing device, such as a computer mouse, can use the light sensor as a judgment of the trajectory movement. When the generated light is directed to a working plane, a moving vector can be judged by the energy change and image processing received before and after. As shown in FIG. 1 , the optical mouse 10 moves on a surface 11 , and the main components of the internal circuit of the mouse case 12 are provided with a circuit board 14 except for some optical components. The circuit board 14 is provided with a controller 18 for controlling and operating the emitted and sensed light, and a light source 16 and a sensor 19.

The outer casing 12 of the optical mouse 10 has a slot 17 facing the outer surface 11. The circuit board 14 is disposed near the aperture 17, and the circuit board 14 is provided with a laser or a light emitting diode. Light source 16 of the body (LED). When this optical mouse 10 In operation, the light source 16 continuously generates emitted light and is directed toward the surface 11 at a specific angle, as indicated by a broken line in the figure, the signal of the reflected light is obtained by the sensor 19, or the image distribution of the intensity of the reflected light is obtained (for example, the sensor 19) The controller 18 can analyze the moving direction of the optical mouse 10, which can be a CMOS or CCD image sensor.

In the aforementioned technique for determining the trajectory of the optical mouse 10, the signal of the reflected light obtained by the surface 11 is quite relied upon, and therefore the performance of the optical mouse 10 will generally be different depending on the form of the surface 11.

In the purpose of ray tracing, the general technique will cause a problem of failure of judgment due to a material having a transparent surface structure or a non-reflective material, resulting in failure to trace, which may make the related device (such as an optical mouse) unable to operate smoothly.

In the prior art, if the device for ray tracing still maintains certain tracing performance on different planes, additional external positioning sensing or some complicated operations are often used in the manner of obtaining the light moving path, but these positioning Sensing or operation is only applicable to finite planar states due to sensitivity limitations, high energy consumption, and complex algorithms. These conventional light sensors are not suitable for use on all highly reflective or very low reflectivity planes.

The invention discloses an apparatus for providing an optical indicator on a mobile device having a touch display, which is different from a conventional device using a general light sensor, such as an optical mouse, which is conventionally known. The optical mouse is not suitable for all high reflection or low reflectivity planes. The optical indicator proposed in the present disclosure is provided with an array of photosensors including a plurality of sensing elements arranged in an array. The array element of the sensing element and the corresponding tracking algorithm are used to achieve the purpose of effective tracking, and the cursor control device applied thereby does not require complicated optical design, and the embodiment can be matched with spatial coherence such as laser light. (spatial coherence) A good light source, which provides good tracking ability for optical tracing devices such as optical mice. The control method of this cursor mainly uses light reflected from the surface (such as the finger skin). An image of constructive and destructive interference with light from the original emitted light as a basis for tracing identification.

According to one of the embodiments, the mobile device with the optical indicator mainly comprises an optical indicating module and a mobile device signal processing module.

The optical indicating module comprises a control unit integrating the internal circuit signal, one of the purposes of which is to generate a mobile signal; the light emitting unit provides a light source to emit light, and is emitted through a light channel on the mobile device casing; the light sensing unit comprises a plurality of The sensor elements arranged in an array form one sensor array for receiving light entering the mobile phone through the light channel; and an arithmetic unit is used to calculate the energy received by each sensor element before and after an acquisition time. The energy difference of the spatial interference formed before and after the acquisition time to determine a moving direction. The control unit then generates a mobile signal.

The mobile device signal processing module includes an interface simulation unit that generates an analog control interface, such as one or more control buttons or/and scroll wheels generated by the software simulation; and a touch display unit that generates a screen displayed on the display screen. The unit is configured to detect a touch event to generate a touch signal; and the signal processing unit can generate a control signal according to the touch signal generated by the touch display unit and the visual pattern corresponding to the control interface.

The mobile device can include a communication unit for providing a mobile device connected to a computer host for transmitting an indication signal converted by the mobile signal and the control signal.

According to still another embodiment, the method for indicating the mobile device with the optical indicator includes first starting an analog control interface through the software program, and the analog control interface can be one or more simulated on the touch display screen. The control button or/and the scroll wheel provides a user touch interface as a control; and also activates the optical indication module of the mobile device, and uses the optical indication module to perform a tracing process, such as: one of the self-optical indication modules The light emitting unit emits light and is emitted through a light passage on the casing of the mobile device; the light reflected by the external object is received by the light sensing unit, in particular, the signal received by the sensing element arranged in a plurality of arrays, thereby Calculating the light energy received by each sensor element before and after an acquisition time, can be obtained before and after the acquisition time The energy difference of the spatial interference is formed, and then the moving direction of the external object is judged according to the cumulative calculated energy difference.

The optical indicating module can generate a mobile signal according to the moving direction, and the analog control interface generates a control signal according to the touch action of the user, so that the mobile signal and the control signal can be converted into an indication signal. This indication signal can be used, for example, to control the cursor movement of the host computer.

In order to further understand the technology, method and effect of the present invention in order to achieve the intended purpose, reference should be made to the detailed description and drawings of the present invention. The drawings and the annexed drawings are intended to be illustrative and not to limit the invention.

10‧‧‧ optical mouse

11‧‧‧ surface

12‧‧‧ Mouse shell

14‧‧‧ boards

18‧‧‧ Controller

16‧‧‧Light source

19‧‧‧ Sensor

17‧‧‧ slotting

201‧‧‧ incident light

205‧‧‧ surface structure

203‧‧‧ reflected light

30‧‧‧ boards

32‧‧‧Sensor array

301‧‧‧Feeling element

34‧‧‧Light source device

303‧‧‧Scope of illumination

36‧‧‧Control circuit

40‧‧‧Mobile devices

401‧‧‧ openings

402‧‧‧Touch display screen

501‧‧‧First button

502‧‧‧Second button

503‧‧‧Roller

60‧‧‧Mobile device housing

61‧‧‧ boards

601‧‧‧Control unit

603‧‧‧Light source

605‧‧‧Sensor array

607‧‧‧Mobile device signal processing module

64‧‧‧ surface

602‧‧‧Light channel

62‧‧‧Computer host

70‧‧‧ mobile devices

701‧‧‧Interface unit

71‧‧‧Optical indicator module

711‧‧‧Control unit

712‧‧‧Lighting unit

713‧‧‧Light sensing unit

714‧‧‧ arithmetic unit

72‧‧‧Mobile device signal processing module

721‧‧‧Touch display unit

722‧‧‧Interface simulation unit

723‧‧‧Signal Processing Unit

724‧‧‧Communication unit

725‧‧‧ memory unit

726‧‧‧Power Management Unit

81‧‧‧Optical indicator module

82‧‧‧Analog Control Interface

101,102,103,104,105‧‧‧ Sensing elements

121,122,123,124,125‧‧‧ comparator

111‧‧‧Adder

112‧‧‧Gain Amplifier

113‧‧‧Calculator

Vout‧‧‧ output voltage

1111,1112,1113,1114,1115,1116‧‧‧傀儡

1121, 1122, 1123, 1124‧‧‧ sensor elements

1211, 1212, 1213, 1214, 1215, 1216‧‧‧ Sensing element combinations

Vavg‧‧‧Average voltage signal

X, Y‧‧ direction

T0‧‧‧ first time

T1‧‧‧ second time

131,132‧‧‧ sensor combination

Step S801~S813‧‧‧Instruction method step flow

Step S901~S911‧‧‧ tracing step procedure

1 shows a schematic diagram of an internal circuit of a conventional optical mouse; FIG. 2 shows a schematic diagram of a reflected light path of an incident plane and reflected light; and FIG. 3 shows a package of an optical sensor array device in the cursor control device of the present invention. Schematic diagram of a sensor array in a circuit; FIG. 4 is a schematic view showing an embodiment of a mobile device with an optical indicator; FIG. 5 is a schematic view showing an embodiment of a mobile device with an optical indicator; 6 is a schematic diagram showing an embodiment of a mobile device with an optical indicator according to the present invention; FIG. 7 is a circuit block diagram showing an embodiment of a mobile device with an optical indicator according to the present invention; and FIG. 8 is a mobile device with an optical indicator according to the present invention. Flowchart of an embodiment of the method of indicating; FIG. 9 is a flow chart showing the tracking method applied to the mobile device of the present invention; 10 is a schematic view showing an embodiment of a sensor array used in the device of the present invention; FIG. 11 is a schematic diagram showing a sensing element layout of the photosensor array device of the present invention; and FIG. 12 is a view showing the sensing elements of the photosensor array device of the present invention. One of the exemplary illustrations of the ray tracing method is performed; FIG. 13 shows a second exemplary example of performing the ray tracing method for each of the sensing elements in the photosensor array device of the present invention.

The present disclosure describes a mobile device and an indication method with an optical indicator, wherein the optical sensing technology of the optical indicator provided on the mobile device has a sensor array consisting of an array of sensing elements to form a light. The sensing unit is converted to a circuit that can determine the energy of the movement as receiving an external optical signal. One of the embodiments is for receiving light reflected from an external object surface, and determining a constructive or destructive interference image in the reflected light according to the reflected light energy received by the plurality of sensing elements, and determining the energy change by the time before and after. To determine a moving vector.

According to one of the embodiments, the back surface of the mobile device disclosed in the disclosure is provided with the sensing element of the optical indicator. For example, if it is used in the application of the computer system cursor control, the user can hold the mobile device. Moving on a plane (such as a desktop) and facing down, can sense the light reflected from the plane. The plane has a certain rough surface. After entering the optical indicator through the reflected light, it can be received by the plurality of sensing elements. The interference image is calculated, and then the energy change in a certain period of time is calculated, and the moving direction of the opposite surface can be judged. Preferably, the light source can adopt a coherent light or a spatial coherence light as a light source, thereby detecting a moving direction, and can be combined with a sensitivity compensation method. The motion recognition algorithm can also reduce noise, so the device using this technology can be applied to various states of the plane.

In an embodiment, the optical indicator in the mobile device proposed in the disclosure is A coherent light source package integration can be used. Devices using such techniques do not require the installation of additional optical lenses or specific image sensors, such as a complementary MOS field effect transistor image sensing. CMOS image sensor (CIS) does not need to install any optical components (such as lenses, mirrors, etc.) on the light path, but directly receives the reflected light source by the light sensing element, and calculates the energy change before and after a period of time. Detecting the movement of the mobile device.

In addition, the optical indicator provided in the mobile device can be matched with a light source with good spatial coherence such as laser light, and includes a plurality of sensing wafers arranged in an array and corresponding tracking. The algorithm achieves the purpose of effective tracing.

First, FIG. 2 is a schematic diagram showing that a specific light source device (not shown in the figure) generates incident light (201) to be reflected toward a plane and then reflected (203) to form a plurality of reflected light paths. Coherent light, as described herein, "coherent light" refers to a light with good spatial homology.

The plurality of optical paths shown in this figure include incident light 201 directed toward a plane having a surface structure 205, which is then reflected to form reflected light 203. Since the microscopic upper surface structure 205 is an irregular structure, the reflected light 203 forms light rays as shown schematically in different directions.

The light source device continuously generates incident light 201 to a plane, and reflects to form reflected light 203. In the process, the reflected light 203 is received through a sensor (not shown in the figure), and light constructive and destructive interference occurs in various optical paths. The pattern, where incident light from a coherent light source is used in particular, can enhance this interference effect.

When the device carrying the relevant circuit for performing the tracking method moves relative to the sensing plane (XY plane), the photo sensor receives the message of the reflected light 203 and collects according to the time slot (time slot) ( Sampling) The message data, as well as the average energy value (reflected light), and the energy difference at different times and positions. The optical indicator disclosed in the present disclosure uses an array of sensors (sensor array) to obtain the energy of different positions, and the difference from the average energy value, that is, the movement trajectory can be judged. The average value can be calculated by using the statistical average of the energy obtained by all the sensing elements, or the average value of the energy obtained by the partial sensing elements, such as the average value or column of the rows (such as the X direction of FIG. 11). The Y-direction) average is the calculation reference for the average; it is also possible to take the energy average of the peripheral or intermediate portion as the reference average.

According to one of the embodiments using the above-described sensor array, if the same dimming is used as the light source, the interference effect of the reflected light can be enhanced. The same dimming is a kind of light source with a very small phase delay in a wave envelope, wherein the laser light is a kind of dimming light, which is different from the dimming light such as sunlight or LED light.

Applying the same dimming to the optical indicator disclosed in the present disclosure, the same dimming can improve the sensitivity of the optical sensor that senses the reflected light interference. Because the same dimming has a small phase difference characteristic, compared with the spatial interference caused by the non-coherent reflected light, the same dimming will have a small phase delay phenomenon. Therefore, the use of the same dimming can enhance the spatial interference of the reflected light, and the aforementioned sensor array (for the light) can obtain the spatial interference difference of the reflected light through one plane.

The sensor array can be referred to one of the embodiments of the sensor array packaged in an integrated circuit (IC) in the optical indicator of the mobile device of the present invention shown in FIG. According to one embodiment of the invention, the sensor array and the associated controller circuit can be integrated in a semiconductor circuit, and the light source device of the light tracing device, the integrated sensor array and the controller can be packaged in the tracing device On a circuit board, therefore, the present invention does not require special optical acquisition devices, such as specific lenses and special semiconductor processes (such as CIS) to enhance sensitivity.

A sensor array 32 on a circuit board 30 within a light sensor array device is shown that can be applied to an optical indicator or a particular pointing device for use on a mobile device as disclosed in the present disclosure, the sensor array 32 includes a plurality of sensing elements 301 arranged in an array, which can be packaged in an integrated circuit by the technology of the integrated package (integrated optical sensor array on IC), including in one embodiment, simultaneously produces a controller 36 with sensor array 32 integrated with circuitry. A plurality of sensing elements 301 (especially non-傀儡 sensing elements, as shown in FIG. 11) on the sensor array 32 have a fixed pitch and a uniform relative position to receive light reflected through a particular surface/plane on average. The illumination range 303 emitted by a light source device 34 to a plane is illustrated in the figure, and then the light is reflected by the plane and then directed to the sensor array 32, wherein each of the sensing elements 301 respectively receives reflected light in different directions. After the photoelectric signal conversion, the control circuit 36 and the related circuit in the device obtain the signal, and then calculate the average value of the energy received by each of the sensing elements 301, and then calculate the difference between each sensing element 301 and the average value, and the relevant control circuit. Based on the spatial interference difference of the spatial interference formed by the reflection of a surface or a plane, the control circuit 36 determines the moving direction based on the accumulated energy difference before and after each time slot.

The photosensor array device disclosed in the above embodiments has a so-called spatial interference factor, and when light rays (especially the same dimming, but the invention is not limited to the same dimming), the surface is reflected on the surface having the irregular surface structure, and the reflection is generated in different directions. The interference caused by the reflected light, which is reflected to produce a constructive or destructive interference pattern, after which the space of the plane reflection due to the relative motion (relative motion of the device and the plane) is obtained by the sensor array. After the information, the mobile data is created on the XY plane.

In particular, in one embodiment, the carrier for applying the photosensor array device disclosed in the disclosure is a mobile device provided with an optical indicator using laser light as a light source, wherein the main circuit component is disposed on a circuit board (30). a light source device (34) for generating light incident on an incident surface, comprising a sensor array (32) having a plurality of sensing elements (301) arranged in an array, and including the aforementioned control circuit (36) The control circuit (36) is coupled to the light source device (34) and the sensor array (32) for acquiring optical signals received by the plurality of sensing pixels in the plurality of sensing elements (301), and calculating the energy state. And calculate the energy state changes before and after the acquisition time.

Figure 4 is a schematic view showing an embodiment of a mobile device with an optical indicator of the present invention. The overview shows a mobile device 40, particularly an electronic device with a touch display, such as a smart phone, a tablet computer, etc., and the sensing portion of the optical indicator is disposed on the back of the mobile device 40, as shown in the figure. There is an opening 401 which is a light path external to the optical indicator within the device 40. This optical indicator allows the mobile device 40 to operate as an optical mouse.

The embodiment of the mobile device with the optical indicator can also refer to the overview shown in FIG. 5. This example shows a mobile phone 40 with a touch display. The touch display screen 402 is displayed with an analog control interface, preferably by executing an application software, such as an APP, to start simulation on a general computer mouse. The function buttons are commonly used as left and right buttons (the first button 501, the second button 502), or may assist an analog wheel 503.

According to the actual operation mode, the user can first execute the software program that starts the simulation control interface, that is, display several control components on the display screen, such as the buttons of the general mouse, the scroll wheel, or other interfaces that can scroll up and down and left and right. The software program can also provide a user-defined control component, such as a button that needs to achieve a specific purpose when executing a certain software or game, which can be achieved by the technique of the analog control interface of the present invention.

Next, a schematic diagram of an internal design embodiment of the mobile device with the optical indicator shown in FIG. 6 can be referred to in the circuit design.

The schematic shows a mobile device housing 60. The light passage 602 on the housing 60 is an opening. Unlike a general optical indicating device, a lens or/and a mirror is required. This opening is only a contact and contact between external objects. Structure. This example is shown facing the lower surface 64, the opening being disposed at a position corresponding to the internal light source 603, so that the light source light exits the mobile device housing 60 and receives the reflected light through the opening. In the present invention, a sensor array design utilizing a plurality of sensing elements arranged in an array form can be applied to more different forms of surface 64, including human skin, clear glass, and the like.

The housing 60 is provided with a circuit board 61 for carrying the sensing chip and the circuit therein. In this example, an optical indicating module for tracking is formed, wherein the main component is used to integrate the internal circuit signal to generate a mobile signal control unit 601. , control unit 601 In order to be responsible for the role of the optical indication module in communicating with the original circuit of the mobile device, this example displays an electrically connected mobile device signal processing module 607.

On the circuit board 61, a light source 603 for transmitting the sensing light is disposed, and is electrically connected to the control unit 601. The light source 603 is preferably disposed at the center of the sensor array 605 in which the sensing elements are arranged in an array, so that the reflected light is averaged. Received by multiple sensing elements. However, the actual implementation can be adjusted according to needs.

The positional design of the aforementioned light tunnel 602 and the light source 603 is mainly based on vertical incident light and coherent light.

The sensor array 605 is electrically connected to the control unit 601, and converts the received optical signal into an energy signal. The control unit 601 (or the circuit in which the operation is performed) calculates the energy difference before and after the period of time, and can thereby determine The direction of movement.

The mobile device signal processing module 607 connected to the control unit 601 in this example can be the original circuit module in the mobile device, and can mainly be provided with a connection interface, as shown in FIG. 7, receiving the movement determined by the optical indication module. The signal, together with the mobile device signal processing module 607, provides a control signal generated by the analog control interface, and can generate an instruction for controlling the movement and execution of the cursor of the computer host 62.

In the embodiment shown in FIG. 6, it is apparent that when the user operates, the opening on the mobile device housing 60 should face the plane to be moved, and the mobile device can be directly operated by hand, and the control interface of the screen display through the mobile device is achieved. Such as the work of the mouse.

Figure 7 is a block diagram showing an embodiment of a mobile device having an optical indicator of the present invention.

The mobile device 70 mainly has two circuit modules, such as an optical indicating module 71 and a mobile device signal processing module 72, which can be connected in a specific connection relationship. The schematic diagram is described by an interface unit 701, which may be wireless or wired. The connection relationship is mainly generated by the processing signal transmitted by the optical indication module 71 to the mobile device through the interface unit 701 to generate a signal for controlling the host computer.

The main circuit of the optical indicating module 71 has a control unit 711, which integrates the circuit signals in the optical indicating module 71, and is electrically connected to other circuit units, and generates a mobile signal according to the energy change received by the light sensing unit.

The optical indicating module 71 has a light emitting unit 712, which mainly provides a light source with good spatial coherence such as laser, and an associated control circuit. The light machine generated by the light source is emitted through a light passage on the housing of the mobile device 70. The optical sensing unit 71 includes a light sensing unit 713 including a sensor array composed of a plurality of arrays of sensing elements, and a corresponding circuit. The light sensing unit 713 is configured to receive the light path into the mobile phone 70. The light is received by a plurality of sensing elements. The operation unit 714 of the optical indicating module 71 is configured to calculate the energy difference of the spatial interference formed before and after the acquisition time after calculating the energy received by each sensor element before and after the acquisition time to determine a moving direction.

According to one of the embodiments, in the operation of the optical indicating module 71, the control unit 711 can dynamically control the light energy emitted by the self-illuminating unit 712, for example, adjusting the illuminating energy according to the feedback of the receiving energy of the sensing element, or/and transmitting The pulse width is modulated to control the illumination period of the light-emitting unit 712.

For the operation principle of the optical indicating module 71, refer to Figures 12 and 13 of the present disclosure.

The main circuit component of the mobile device signal processing module 72 in the device 70 has an interface simulation unit 722, which can be a hardware or software implementation module, which simulates a control interface displayed on the display screen of the mobile device 70. The control interface is According to the need to produce a variety of simulated control elements, such as mouse buttons, scrolls and other forms of software, each control element will be compared to a defined control function, such as point selection, scrolling and other actions.

The mobile device signal processing module 72 includes a touch display unit 721, which is preferably a driving circuit for a touch display, which mainly generates a picture displayed on the display screen and detects a touch event to generate a touch signal.

The device further includes a signal processing unit 723, which is electrically connected to the touch display unit 721 and the interface analog unit 722, and can be configured according to the touch signal generated by the touch display unit 721. And corresponding to the visual graphic on the control interface, generating a control signal. That is, letting the user operate the mobile device is like operating an optical indicator.

According to the embodiment, the mobile device 70 has a communication unit 724, which can be connected to a computer host wirelessly or by wire, and includes an instruction signal for transmitting the mobile signal and the control signal to the computer host, and can be used as an instruction for controlling the cursor. The remaining circuits also have a memory unit 725 for temporarily storing operational data, or a memory for storing software programs in the mobile device 70. The power management unit 726 further manages the power of the various circuit units within the mobile device 70.

Figure 8 is a flow chart showing an embodiment of the method of indicating the mobile device of the present invention.

In this embodiment of the process, starting with step S801, a software program corresponding to the optical indicator function is started, such as a mobile application (APP) carried in the mobile device, and the software program is simulated to be displayed on the touch display. The control interface is as in step S803. The control component presented on the control interface is a screen that is simulated by the application. It can simulate the buttons and scroll wheels of the mouse, or the buttons defined by the user.

In step S805, the optical indication module in the mobile device can be activated at the same time, and the tracing process is started, as in step S807. That is, when the user operates the application, in addition to generating an analog control interface (such as one or more software-simulated function buttons or scrolling interfaces), the optical indicator module is also activated and starts to emit sensing light, and judges Movement on a surface.

In step S809, when the mobile device carrying the optical indicator is moved, the optical indication module (81) instantaneously calculates the moving direction, and the optical indicating module (81) generates the moving signal; if the step is S811, if the finger is simultaneously transmitted through the finger Touching the analog control interface 82 of the touch display screen, the mobile device signal processing module also generates a control signal according to the touch event and converts it into an indication signal (step S813), for example, when connected to the computer host, becomes a cursor control signal .

For a plurality of sensing element operation modes in the above light sensing array, reference may be made to the schematic diagram of the embodiment of calculating the energy distribution shown in FIG.

Figure 10 shows the layout of the sensor array. A plurality of sensing elements are distributed on the XY plane to form an NxM sensor array. The sensor array is in the form of a symmetrical rectangular, square, circular, elliptical, etc. Geometric shape, which can be determined according to the actual application. The sensor array includes a plurality of sensing elements 101, 102, 103, 104, 105 arranged in an array, respectively disposed along the directions X, Y, and the actual number is not limited to this schematic. The main components on the circuit board on which the sensing elements 101, 102, 103, 104, 105 are laid are also a plurality of comparators 121, 122, 123, 124, 125. Each comparator is connected with a sensing element, and the input value is an average voltage signal Vavg of the energy generated by each sensing element for comparing the sensing element sensing. The voltage signal obtained after the light can be compared to obtain the signal value of the high and low voltage. Finally, the control circuit obtains the comparison result of the adjacent two sensor values and makes a judgment of the moving direction.

For example, the comparator 121 is coupled to the sensing element 101. One of the input signals, that is, the energy signal generated by the sensing element 101, can be represented by a voltage signal, and the other input terminal is an average voltage signal Vavg, so the comparator 121 is compared. The two input signals can output a comparison result. The present invention preferably expresses the comparison result by a binary characteristic value, such as the high and low voltage signals respectively indicated by H or L in FIG.

According to the photosensor array device disclosed in the disclosure, the manner of tracking by the sensor array is characterized by the display in the constructive and destructive interference pattern formed by the light reflection (preferably the same dimming) through the plane reflection. The energy pattern determines the motion vector through changes in energy distribution at different times. The implementation method uses, for example, a non-relative view points to do movement judgment, that is, introducing energy information of the surrounding sensing elements, and comparing the average inductive energy to determine the moving direction. It is worth mentioning that this is different from the general method of judging the motion vector by using pixel information. The present invention determines the movement trajectory by using time and calculation energy changes, and the energy change can adopt a binary eigenvalue. (eg, H and L), this binary eigenvalue is a comparison of the readings of the sensing elements with the statistical average.

In the photosensor array device itself, according to one of the embodiments, the present invention is applied to an inductive wafer layout of a photosensor array device in a mobile device, the inductive wafer comprising sensing elements arranged in an array, the sensing elements may include A sensing element (called a 傀儡 sensing element) that is not active around, and a working sensing element that is disposed at a central portion and is responsible for receiving light, so that the control circuit or the related computing circuit in the device obtains energy signals of all the sensing elements. After that, only the energy signals of the non-傀儡 sensing elements are continuously used. For example, these sensing elements do not provide the energy signal as the motion vector, but can be used as a function for purely determining the optical signal. Refer to Figure 11 for a schematic diagram of the sensor layout.

This figure shows a sensing chip with a plurality of sensing elements arranged in an array. This example shows that a dummy sensor is provided on the periphery of the central sensing element to make the entire sensing wafer process more Uniformity can therefore also result in more uniform sensing of energy. The embodiment shows that the surrounding sensing elements 1111, 1112, 1113, 1114, 1115, 1116 are set as inactive sensing elements, and the sensing elements 1121, 1122, 1123, 1124 located near the middle portion are the main sensing. Inductive component of light energy.

When an array of array elements is simultaneously exposed to a reflected light, the sensing element capable of uniformly sensing the light is a sensing element that is more biased toward the central portion, and the surrounding sensing elements may have the possibility of receiving uneven energy. Therefore, when the total energy received by the entire sensing chip is added, the energy values of the signal instability may be excluded by setting the sensing elements (1111, 1112, 1113, 1114, 1115, 1116), and a reference can be obtained. The reference energy value of the value.

As shown in the figure, the circuit is provided with an adder 111 electrically connected to each of the sensing elements in the sensing chip to obtain photocurrent signals of the respective sensing elements, and can be converted into voltage values by analog digital conversion, but due to the sensing chip The photocurrent of each of the sensing elements receiving the optical signal is extremely small, and it is necessary to pass the stage of gain amplification to obtain an effective reference value, and then to calculate the energy change obtained before and after the acquisition time. According to an embodiment, the photocurrent signals are processed by the gain amplifier 112 to form an output. The output signal, such as the signal represented by the output voltage Vout, is further calculated by a calculator 113 based on the energy signal obtained effectively, and outputted as the average voltage signal Vavg.

Thereafter, the output signal (such as the output voltage Vout) and the average value (such as the average voltage signal Vavg) are output to the comparator as disclosed in FIG. 10, so that the comparator can compare the energy signal of the sensing element with a reference value (eg, The energy average of all or part of the sensing elements, thereby obtaining the energy state of the sensing element. In fact, each sensing element can represent the energy state in a digital manner with high (H) and low (L).

The flow of the indication method applied to the mobile device having the optical indicator of the present invention can be seen in FIG. 9 in accordance with the operation mode illustrated above.

First, in step S901, the light source is driven to emit light, and the reflected light from a surface enters the device through an opening of the copper, and the reflected light is received by the sensor array, as by step S903. Then, the energy received by each of the sensing elements is calculated (step S905), and the received energy of each sensing element before and after the time is recorded, and the energy difference of the spatial interference formed before and after the sampling time is obtained by the above method (step S907), and the energy difference is determined according to the energy difference. The moving direction (step S909) is used to generate a mobile signal (step S911).

After the device mobile signal is generated, it can be used as a cursor to control the connected computer host, and can also be used with the control signal generated by the analog control interface on the touch display screen to achieve the purpose of operating the optical indicator.

The flow of the indication method applied to the mobile device having the optical indicator of the present invention can be seen in FIG. 9 in accordance with the operation mode illustrated above.

First, in step S901, the circuit in the mobile device drives the light source to emit light, and the reflected light from a surface enters the device through the same opening, and the sensor array receives the reflected light on the surface of the external object, especially by multiple arrays. The arranged sensing elements are received, as by step S903. Then, the energy received by each sensing element in one sampling time is calculated (step S905), and the received energy of each sensing element before and after the sampling time is recorded, and the energy difference of the spatial interference formed before and after the sampling time is obtained by the above manner (step S907). , determining the moving direction according to the energy difference (step S909), for producing The mobile signal is generated (step S911).

In the process, the control unit can dynamically control the energy of the light source of the light-emitting unit according to the information of the energy calculation, for example, by adjusting the driving current of the light-emitting unit to control the energy of the output; and further controlling the light-sensing unit to receive the incident light. The exposure time, and the gain of the output energy signal, and then calculate the light energy received by each sensor element before and after an acquisition time. Accordingly, by adjusting the intensity/brightness of the light source and the compensation mechanism established by the adjustment of the aforementioned exposure time, the sensor array device can adapt to more surface conditions, such as different surface structures, distances from the surface, and the like.

After the device mobile signal is generated, it can be used as a cursor to control the connected computer host, and can also be used with the control signal generated by the analog control interface on the touch display screen to achieve the purpose of operating the optical indicator.

The manner of judging the moving direction by using the energy changes before and after receiving by each sensing element can be followed by referring to FIG. 12 and FIG. 13 . The main method is to calculate the energy of the received energy and a statistical value by using a comparator corresponding to each sensing element. The energy difference of the spatial interference formed before and after the acquisition time is obtained.

For the determination of performing the motion vector using the binary acquisition imaging, reference may be made to the exemplary illustration of performing ray tracing by a plurality of sensing elements in the apparatus disclosed in the present invention shown in FIG.

This example shows a combination of sensing elements 1211, 1212, 1213, 1214, 1215, 1216 with multiple arrays. This example only illustrates the sense of passing adjacent sensing elements at different times (eg, first time t0, second time t1). An example of identifying a moving vector by measuring the change in energy.

Where t0 and t1 are the two sampling times before and after, and H and L respectively represent the high and low voltage signals output by the aforementioned comparator, that is, can be regarded as the energy state (the energy state can be binary characteristic compared to the average energy being an energy state) The value indicates), mainly by determining the overall motion vector through the voltage signal transition of the time before and after. Figure 12 shows the energy changes in the individual sensing elements at two different times before and after.

For example, the sensor element combination 1211 schematically displays several (at least two) sensing elements, The left side shows that at the first time t0, the two sensing elements respectively sense two energy states of L and H; when entering the second time t1, the energy changes of the two sensing elements are converted into H and H. When L and H(t0) are converted to H and H(t1), the energy state of the sensing element is changed from L to H, indicating that the right side H is substituted to the left position, so the initial collection time can be determined. The direction of effective sensing in the middle is leftward.

The other group of sensing elements of the sensing element combination 1211 is at the first time t0, the energy state is H and L; and at the second time t1, the energy state is L and L, wherein there is a sensing element energy state by H The transition to L also indicates that the L substitute on the right is at the left position, so it can be judged that there is a leftward moving direction.

For example, if the two sensing elements on the left side of the sensing element combination 1212 have L and H at the first time t0, and the second time t1 changes to L and L, it can be seen that the H direction of the left side is L. The right substitute becomes L, so it is initially determined that there is a rightward moving vector.

Similarly, the right side of the sensing element combination 1212 has two sensing elements whose energy states are H and L at the first time t0, and then changes to H and H at the second time t1, wherein the right L passes to the left. The H substitute is converted to H, so it can be judged that there is a rightward moving vector.

In the figure, the sensing element combinations 1215 and 1216 do not have an arrow indicating the direction. It is judged that in this example, the plurality of sensing elements have no energy change during the acquisition time of the first time t0 and the second time t1, or are unable to pass the energy change therein. The moving direction, for example, the sensing element combination 1216 is L and H at the first time t0, and the energy state is changed to H and L at the second time t1, which is impossible to determine the moving direction through the energy state change. Therefore, these two aspects have no valid output signal.

When all the sensing elements of the last two times judge the direction of the respective energy changes, an overall motion vector can be determined as a whole.

Another way of judging the direction of movement is as shown in FIG. 13 is a schematic diagram of performing ray tracing on the sensing wafer in the device disclosed in the present invention. In this example, a schematic diagram of a method for identifying a motion vector by using a direction of transformation of a sensed energy state at different times, wherein X For the value that is not care, @ is the comparison of the signals sensed by t0 and t1, thereby judging the motion vector.

When the reflected light is received by the sensing chip, the plurality of sensing elements in the sensing chip generate different high and low voltage signals according to the received signal energy and the average energy at different times. In this example, the sensing signal "@" is generated. In some cases, it is still possible that some of the sensing elements have no energy change, or that there is no difference in the voltage signal. At this time, the value shown as "X" is not shown.

According to the embodiment of the figure, in the sensor element combination 131, the energy change of the adjacent sensor element is obtained by the comparator at the first time t0, and is expressed as a state "X@@", wherein "X" is an unintentional value. "@" indicates that there is a change in the high and low voltages; at the second time t1, the energy change of several adjacent sensing elements is obtained, which is expressed as the state "@@x". The energy state of each sensor element at the first time t0 and the second time t1 changes, and in this example, the display state "X@@" is changed to "@@X", and it can be judged that "@@" is shifted to the left (shift), so It can be judged that this sensor element combination 131 has a change to the left movement as indicated by the arrow in the figure.

In the sensing element combination 132, the energy change of the adjacent sensing element at the first time t0 is represented as the state "@@X", and at the second time t1, the energy state is represented as "X@@", which is visible After the time transition (t0 to t1), the state "@@" shows a tendency to shift to the right. Therefore, the invention disclosed in the present disclosure can determine the moving direction of the overall device by utilizing the energy change before and after the time.

It is worth mentioning that when the direction of movement is judged, since the invention adopts the sensor array, the slight error does not affect the result of the overall judgment. If the tracing method is applied to a computer optical mouse, the moving frequency of the general user operating the mouse is much lower than the processing speed of the control circuit, and some slowly changing reference values do not affect the overall judgment.

In summary, according to the embodiments disclosed in the disclosure, the present invention relates to a photosensor array device for use in a mobile device, which is integrated in a semiconductor package, thereby effectively suppressing internal inherent noise (intrinsic) Noise) and proposed The compensation mechanism established by dynamically adjusting the intensity or brightness of the light source and adjusting the exposure time allows the sensor array device to adapt to more sensing surfaces. In particular, the mobile device proposed in the disclosure does not need to install an additional optical lens or a specific image sensor, such as a complementary CMOS image sensor (CIS), and does not require additional The optical component receives the reflected light source directly from the light sensing element and calculates the energy change before and after the time period, thereby detecting the movement of the external object.

However, the above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Therefore, equivalent structural changes that are made by using the specification and the contents of the present invention are equally included in the present invention. Within the scope, it is combined with Chen Ming.

40‧‧‧Mobile devices

402‧‧‧Touch display screen

501‧‧‧First button

502‧‧‧Second button

503‧‧‧Roller

Claims (20)

A mobile device with an optical indicator, comprising: an optical indicating module comprising: a control unit for integrating circuit signals in the optical indicating module to generate a mobile signal; and an illuminating unit electrically connected to the control unit a light source emits light, and is emitted through a light passage of the mobile device housing; a light sensing unit is electrically connected to the control unit, and comprises a sensor array composed of a plurality of arrays of sensing elements for Receiving light entering the mobile phone through the light channel; an arithmetic unit electrically connecting the control unit to calculate the energy of the spatial interference formed before and after the acquisition time after calculating the energy received by each sensor element before and after an acquisition time The difference is to determine a moving direction; a mobile device signal processing module includes: an interface analog unit that simulates a control interface displayed on one of the display devices of the mobile device; and a touch display unit for generating the display Displaying a screen on the screen and detecting a touch event to generate a touch signal; a signal processing unit electrically connecting the touch Analog interface unit and the display unit, the touch signal according to the touch display unit and corresponding to the generated pattern on the visual control interface generates the control signal. The mobile device with an optical indicator according to claim 1, further comprising a communication unit, wherein the mobile device is connected to a computer host for transmitting an indication signal converted by the mobile signal and the control signal. The mobile device with an optical indicator according to claim 1, wherein the plurality of sensing elements arranged in the plurality of arrays in the sensor array are provided with a plurality of clicks The sensor array is configured to receive light reflected from a surface and incident through the light path. The mobile device of claim 3, wherein the plurality of sensing elements have a fixed spacing and an average relative position. A mobile device with an optical indicator as claimed in claim 4, wherein the sensor element is disposed around the sensor array. The mobile device with an optical indicator according to claim 3, wherein the light sensing unit further comprises: a plurality of comparators, wherein each comparator is connected to a sensing element for comparing the input two energy signals, One is the energy signal generated by the sensing element, and the other is a statistical average of the effective energy obtained by the plurality of sensing elements, thereby calculating the energy difference of the spatial interference formed before and after the acquisition time. The mobile device with an optical indicator according to claim 1, wherein the light path is an opening on the mobile device housing, and the opening is disposed at a position corresponding to the light source, so that the light source emits the light. The action device of the indicator receives the reflected light through the opening, so that the reflected light is received by the plurality of array elements. The mobile device with an optical indicator according to claim 7, wherein the light source is a laser with good spatial homology. The mobile device with an optical indicator according to claim 1, wherein the control interface is one or more control elements generated by the software simulation. A method for indicating a mobile device with an optical indicator includes: starting an analog control interface, displaying the analog control interface on a touch display screen of the mobile device; starting an optical indicating module of the mobile device, executing The tracing step includes: emitting light from a light emitting unit in the optical indicating module, and emitting through a light channel on the mobile device housing; A light sensing unit in the optical indicating module receives light reflected from an external object through the light channel, wherein the light sensing unit is composed of a plurality of sensing elements arranged in an array form; calculating each sensing element The light energy received before and after an acquisition time; the energy difference of the spatial interference formed before and after the acquisition time is obtained; and the relative movement direction of the mobile device and the external object is determined according to the energy difference accumulated before and after the acquisition time; A motion signal is generated by the optical indication module; a control signal is generated by the analog control interface; and the mobile signal and the control signal are converted into an indication signal. The method for indicating a mobile device with an optical indicator according to claim 10, wherein the analog control interface is generated by execution of a software program in the mobile device, and simultaneously activates the optical indication module. A method of indicating a mobile device with an optical indicator as claimed in claim 11, wherein the analog control interface comprises one or more software-implemented control elements. The method for indicating a mobile device with an optical indicator according to claim 11, wherein the step of converting the mobile signal and the control signal into the indication signal is performed by the software program. The method for indicating a mobile device with an optical indicator according to claim 10, wherein the light channel is an opening on the housing of the mobile device, and the opening is disposed at a position corresponding to a light source that emits light from the light emitting unit. Light is emitted from the cursor control device, and the reflected light is received through the opening. The method of indicating a mobile device having an optical indicator according to claim 10, wherein the light energy emitted from the light emitting unit is dynamically controlled by a control unit of the cursor control device. The method for indicating a mobile device with an optical indicator according to claim 15, wherein the plurality of sensing elements comprises a plurality of sensing elements, and the control unit adjusts the light energy according to the plurality of sensing elements. Driving power of the light unit Flowing to adjust the light energy generated by the light emitting unit; the control unit controls the duty cycle of the light emitting unit by controlling a duty cycle of the pulse width modulation control signal. The method for indicating a mobile device with an optical indicator according to claim 10, wherein the control unit controls the light sensing unit to receive light incident from the light channel, comprising dynamically adjusting an exposure time of the light sensing unit. The method for indicating a mobile device with an optical indicator according to claim 17, wherein the control unit more dynamically adjusts the gain of the energy signal output by the plurality of sensing elements. The method for indicating a mobile device with an optical indicator according to claim 18, wherein the control unit controls the signal gain of each of the sensing elements according to an energy signal fed back by a sensor array composed of the plurality of sensing elements. The method for indicating a mobile device with an optical indicator according to claim 10, wherein the light sensing unit comprises a plurality of comparators, and each of the comparators is connected with a sensing element for comparing the two energy signals input. One is the energy signal generated by the sensing element, and the other is a statistical average of the effective energy obtained by the plurality of sensing elements, thereby calculating the energy difference of the spatial interference formed before and after the acquisition time; wherein, receiving After the energy signals of the plurality of sensing elements, the control unit of the cursor control device only extracts the energy signals of all or part of the sensing elements, and calculates the statistical average.