CN106060126B - A kind of the remote auto recognition methods and system of screen of intelligent device state - Google Patents

A kind of the remote auto recognition methods and system of screen of intelligent device state Download PDF

Info

Publication number
CN106060126B
CN106060126B CN201610349430.3A CN201610349430A CN106060126B CN 106060126 B CN106060126 B CN 106060126B CN 201610349430 A CN201610349430 A CN 201610349430A CN 106060126 B CN106060126 B CN 106060126B
Authority
CN
China
Prior art keywords
screen
image
detected
smart machine
server
Prior art date
Application number
CN201610349430.3A
Other languages
Chinese (zh)
Other versions
CN106060126A (en
Inventor
孙谷飞
王恒
吕治严
吴迪
张起
李雪峰
Original Assignee
众安在线财产保险股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 众安在线财产保险股份有限公司 filed Critical 众安在线财产保险股份有限公司
Priority to CN201610349430.3A priority Critical patent/CN106060126B/en
Publication of CN106060126A publication Critical patent/CN106060126A/en
Application granted granted Critical
Publication of CN106060126B publication Critical patent/CN106060126B/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network-specific arrangements or communication protocols supporting networked applications
    • H04L67/02Network-specific arrangements or communication protocols supporting networked applications involving the use of web-based technology, e.g. hyper text transfer protocol [HTTP]
    • H04L67/025Network-specific arrangements or communication protocols supporting networked applications involving the use of web-based technology, e.g. hyper text transfer protocol [HTTP] for remote control or remote monitoring of the application

Abstract

The invention discloses a kind of remote auto recognition methods of screen of intelligent device state comprising step: will uniquely corresponding identity code is sent to server-side with smart machine to be detected;Server-side generates the identity image with timeliness according to the identity code;The identity image and random screen state detection image are combined into verification image on smart machine to be detected by full of showing in a manner of its screen;Within the timeliness phase of identity image, the screen picture of smart machine to be detected is acquired, and the screen picture is sent to server-side;Server-side identifies the screen picture, to confirm the identity of smart machine to be detected, and judges whether the screen state of smart machine to be detected is normal.In addition, the invention also discloses a kind of systems for implementing the above method.The instant screen state of the smart machine to be detected of energy remote auto identification user's statement of the present invention, whole flow process are fully automated, especially adapt on a large scale in line service.

Description

A kind of the remote auto recognition methods and system of screen of intelligent device state

Technical field

The present invention relates to a kind of recognition methods of screen of intelligent device state and system more particularly to a kind of smart machine screens The remote identification method whatsoever and system of tentiform state.

Background technique

The smart machines such as current mobile phone, plate have become essential a part in people's daily life.With The size of smart machine becomes greatly, and the probability of screen damage changes a secondary screen often cost is very big also with increase, thus Occur more and more prolonging guarantor or insurance business for screen of intelligent device.When user needs to buy such service, Service provider needs to confirm that it is normal that the screen state of the smart machine of moment user statement, which occurs, in user's buying behavior. It includes complete appearance (cannot have broken) that state, which normally defines, and display function is normal (can correctly to be shown expected from meeting Content), not phenomena such as flower screen, blank screen, flashing.For the situation sold under line, the screen state of smart machine can be with It is verified by manually checking face to face.It is promoted however as the convenience of e-commerce, more and more users' selection exists Line buys such service, for provide this in the service provider of line service for, how remotely to judge the intelligence of user's statement The instant screen state of equipment, at urgent problem to be solved.

It is above-mentioned in line service, remotely judge user state smart machine (smart machine i.e. to be detected) screen whether damage It is bad, it needs to acquire the screen picture (generalling use by way of taking pictures) of smart machine to be detected user and by the screen picture The server-side of service provider is sent to verify.But whole flow process has two at present: (1) can not judge to use Whether the screen of intelligent device image that family is sent represents the instant screen state of the smart machine to be detected of user's statement;(2) right In the screen of intelligent device image to be detected that user sends, the process of manual confirmation state is needed, can not be coped in line service Wilderness demand.For example, the remote auto recognition methods of a simple screen of intelligent device state comprises the following steps: user The photo of the unique identities identification code of the smart machine of its statement of shooting display is simultaneously sent to service provider;Service provider's base The screen state of smart machine is judged in photo and is recorded.In the method, there is following loopholes to make service provider Can not confirm whether photo that user uploads represents the instant screen state of smart machine of user's statement: user can use its sound Bright smart machine pervious photo replaces current state;User can show its statement with an other smart machine The smart machine that the identity identification information screenshot of smart machine even forges the display page it is pretended to be to state.

In view of the above-mentioned problems, need to find a kind of recognition methods of screen of intelligent device state, this method energy remote auto Identify screen of intelligent device state to be detected, and whether the screen of intelligent device image that can judge that user sends represents user's sound The instant screen state of bright smart machine to be detected, moreover it is possible to which the screen of intelligent device image automatic identification sent based on user is waited for Screen of intelligent device state is detected, so that whole flow process is fully automated, to better adapt on a large scale in line service.

Summary of the invention

An object of the present invention is to provide a kind of remote auto recognition methods of screen of intelligent device state, this method energy Remote auto identifies screen of intelligent device state to be detected, and can judge screen of intelligent device image that user sends whether generation The instant screen state of the smart machine to be detected of table user statement, moreover it is possible to which the screen of intelligent device image based on user's transmission is certainly Dynamic identification screen of intelligent device state to be detected, so that whole flow process is fully automated, to better adapt to extensive online industry Business.

According to above-mentioned purpose, the invention proposes a kind of remote auto recognition methods of screen of intelligent device state, packets Include step:

It will uniquely corresponding identity code be sent to server-side with smart machine to be detected;

Server-side generates the identity image with timeliness according to the identity code, and by the identity figure Picture and random screen state detection image are sent to smart machine to be detected, and smart machine to be detected is by the identity figure Picture and screen state detection image are combined into verification image;Or server-side is generated according to the identity code with timeliness Identity image, and by the identity image and random screen state detection image be combined into verification image after send To smart machine to be detected;

The verification image is shown into the screen in smart machine to be detected in a manner of full of screen of intelligent device to be detected On curtain;

Within the timeliness phase of identity image, the screen picture of smart machine to be detected is acquired, and by the screen picture It is sent to server-side;

Server-side identifies the screen picture, to confirm the identity of smart machine to be detected, and judges that intelligence to be detected is set Whether standby screen state is normal.

The remote auto recognition methods of screen of intelligent device state of the present invention, can be used for user and service provides Between quotient be related to screen of intelligent device state online recognition in line service.(server-side can by a server-side for this method To be provided by service provider) it is exchanged with user's progress teledata, to realize the smart machine to be detected stated user The judgement of instant screen state.This method usually requires that user runs a program, institute on the smart machine to be detected of its statement It states also to run in server-side and has corresponding program, the smart machine to be detected and the server-side pass through the program run thereon It is configured as carrying out teledata exchange according to the step in the method for the invention, to realize the intelligence to be detected for stating user The judgement of the instant screen state of energy equipment.

In above scheme, can by the setting of program, so that once the smart machine to be detected brings into operation program, Its data exchange step between server-side just can not interrupt, to guarantee data exchange only in the server-side and user's sound It is carried out immediately between bright smart machine to be detected, and then guarantees that method of the invention is set to the intelligence to be detected of user's statement The judgement of standby instant screen state.Specifically, when the smart machine to be detected and server-side of user's statement start to transport Line program carries out following the step of can not interrupting: server-side obtain with the unique corresponding identity code of smart machine to be detected, And the identity image with timeliness is generated according to the identity code;By the identity image and random screen State-detection image is combined into verification image and shows in a manner of full of its screen on smart machine to be detected;In identity In the timeliness phase of image, acquire the screen picture of smart machine to be detected, and by the screen picture be sent to server-side (usually by The image collecting device completion with the server-side data connection that user is provided for oneself using it);Server-side identifies the screen map Picture, which includes verifying to the identity image with timeliness, to confirm the identity of smart machine to be detected, and Judge whether the screen state of smart machine to be detected is normal.Since above-mentioned steps can not interrupt, it is ensured that the identity is known Other code, identity image, verification image and screen picture are corresponding with the smart machine to be detected, simultaneously because above-mentioned Step needs are completed within the timeliness phase of the identity image, therefore the judgement of screen state is instant.It does so It is advantageous in that the program once the smart machine to be detected and server-side of user's statement bring into operation, user can not be from its data Data are obtained in exchange and are used for another smart machine, to prevent user from pretending to be the to be checked of its statement with another smart machine Survey smart machine;Meanwhile it preventing user and being replaced with the pervious screen picture of smart machine to be detected of its statement currently Screen picture.

In above scheme, the verification image includes the identity image and the screen state detection image;Institute Stating screen picture is the verification image imaging, can be realized by image collecting device.By in smart machine to be detected On by full of the verification image is shown in a manner of its screen so that the screen picture may include the letter of entire screen state Breath, the information of information and the screen state detection image including the identity image.Server-side identifies the screen Image, by identify it includes the identity image information and information comparison corresponding with the identity code with Confirm the identity of smart machine to be detected, at the same by identification it includes the screen state detection image information and therewith The preceding randomly selected corresponding information comparison of screen state detection image is to judge the screen state of smart machine to be detected It is whether normal.The identity code is usually hardware information code, as IMEI (International Mobile Station Equipment Identification), Wi-Fi/ bluetooth are suitable MAC Address of orchestration etc..

About the random screen state detection image, can be examined by the server-side from pre-prepd screen state It is randomly choosed in altimetric image set.It needs to detect screen performance, this hair with a large amount of normal pictures different from conventional screen detection Only need to confirm screen function image that is whether normal, therefore only needing a process to design or suitably select in bright method ?.

About the verification image, combined by the identity image and the random screen state detection image At, be for and meanwhile verify user transmission screen of intelligent device image whether represent user statement smart machine to be detected and The considerations of its instant screen state.Wherein, the identity image is used to verify the screen of intelligent device image of user's transmission The identity of the smart machine of representative, the random screen state detection image are used to verify the screen of intelligent device of user's transmission The instant screen state for the smart machine that image represents.The identity image and the random screen state detection image Synthetic schemes be the identity image is placed on the random screen state detection image and is less than it is described with The screen state detection image of machine.It, can be to the identity in order to reinforce the uniqueness and difficult replicability of the verification image The position and size that image occurs in the random screen state detection image carry out random process, at this point, follow-up service When end identifies the screen picture, whether the position of the identity image will also verify consistent with size.

In summary, the method for the invention energy remote auto identifies screen of intelligent device state to be detected, and can sentence Whether the screen of intelligent device image that disconnected user sends represents the instant screen state of the smart machine to be detected of user's statement, together When based on user send screen of intelligent device image automatic identification screen of intelligent device state to be detected so that whole flow process is complete Full-automation, to better adapt on a large scale in line service.

In the method for the invention, the smart machine can be all intelligence for having screen, can connecting internet and set It is standby, including but not limited to smart machines such as smart phone, tablet computer, laptop, smartwatch.

Further, in the remote auto recognition methods of screen of intelligent device state of the present invention, the identity is known Other code is sent to server-side after being encrypted.

In above scheme, privacy leakage, is then forwarded to server-side after encrypting to the identity code in order to prevent, Server-side generates the identity image with timeliness according to encrypted identity code, therefore the identity image is not Including any plaintext facility information.Since Encryption Algorithm has the property that unidirectionally maps, so encrypted information still can be with Unique identification smart machine identity.

Further, in the remote auto recognition methods of screen of intelligent device state of the present invention, in the verification After image is shown on the screen of smart machine to be detected, the operation on smart machine to be detected is i.e. monitored, once it is to be checked Surveying smart machine has operation, then the verification picture failure.

In above scheme, in order to prevent screenshotss class attack (i.e. user its statement smart machine to be detected on described in Image is verified, is sent to another device after screenshotss, it is intended to the smart machine to be detected for its statement that disguises oneself as), intelligence to be detected Energy equipment is when showing the verification image, while operation has protection service routine, any operation of monitoring users at any time, and real When feedback to the server-side.After listening to operation of the user on smart machine to be detected, the server-side can be current Picture failure is verified, regenerates the identity image with timeliness, correspondingly, the verification image is refreshed.

Further, in the remote auto recognition methods of screen of intelligent device state of the present invention, the identity mark Knowing image is the coded image that can be identified by computerized algorithm.

In above scheme, the identity image can be two dimensional code, bar code etc., can be accurate after identification To it includes coding information.

Further, in the remote auto recognition methods of screen of intelligent device state of the present invention, the identity mark Know image and at least contain the first information and the second information, wherein the first information is identity corresponding with identity code letter Breath, the second information is the check information generated at random, which is also held in server-side;The screen is identified in server-side When curtain image, the check information of preservation is compared server-side with the second information identified, to confirm intelligence to be detected The identity of equipment.

In above scheme, the check information can be used for judging the timeliness of the identity image.

Further, in the remote auto recognition methods of above-mentioned screen of intelligent device state, it is saved in server-side Check information finds key value as the identity code.

Further, as an implementation, know in the remote auto of screen of intelligent device state of the present invention In other method, the timeliness of the identity image shows themselves in that after validity period, identity image is refreshed.

In above scheme, it can guarantee its timeliness by refreshing the identity image.Class is thrown again in order to prevent to attack (user attempts legal verification image duplication check previously generated on the smart machine to be detected stated with it) is hit, to each school The identity image tested in image is respectively provided with timeliness, and at regular intervals, this identity image will refresh, before Image can cease to be in force automatically.

Further, as another embodiment, in the remote auto of screen of intelligent device state of the present invention In recognition methods, the timeliness of the identity image shows themselves in that after validity period, identity image appears in check plot As the size of upper position and/or identity image is changed.

If the check plot seems to be synthesized on smart machine to be detected, smart machine to be detected can pass through It is sent simultaneously comprising location information (it reflects the relative positional relationship between identity image and screen state detection image) And/or the information of the size of identity image is to server-side, so that server-side is in the next steps to identity image Timeliness is verified.The information of the above-mentioned size comprising the position and/or identity image can be sent out after encryption It send.

In addition, alternatively embodiment, the verification image can also be synthesized by server-side, then in this mode Under, then the information of the above-mentioned size comprising the position and/or identity image is generated and stored by server-side, for subsequent The timeliness of the identity image is verified in step.

Further, in the remote auto recognition methods of screen of intelligent device state of the present invention, the screen shape State detection image is colored and/or with texture lines.

In above scheme, the server-side safeguards a screen state detection image set, the screen state detection figure As randomly selecting from this collection.Screen state detection image in the set is colored and/or with texture lines.This Outside, it is usually also equipped with higher resolution ratio, the cutting for adapting to various screen of intelligent device shows needs.A large amount of high quality Film studio photo and camera test scene photo can meet requirements above.The server-side can in conjunction with hand picking with Automatic parameter matching constantly adds the screen state detection image replaced in the set.

Further, in of the present invention or any of the above-described screen of intelligent device state remote auto recognition methods, Before the server-side identifies the screen picture, first the screen picture is calibrated.

In above scheme, the purpose of the calibration is to obtain being equivalent to from the direction perpendicular to screen of intelligent device with without abnormal The image that the image acquisition device of change obtains.It is the screen picture due to acquiring smart machine to be detected using the above scheme When be difficult to accomplish that vertical screen front acquires, and the image collecting device used generally also inevitably exist it is barrel-shaped or Pincushion distortion, if the server-side identifies that the screen picture without calibration, is difficult to be accurately identified before, and The position of identity image can not be verified.When whether the position of the identity image needs verification consistent, If the screen picture has been calibrated, and the identity image is easy for the coded image of algorithm detection, described Server-side can more be accurately determined the identity image in screen of intelligent device to be detected by respective algorithms Position can calculate the identity image in screen of intelligent device to be detected in conjunction with the resolution information of smart machine In pixel coordinate (since the check plot seems pixel coordinate, that is, verification full of screen of intelligent device to be detected Pixel coordinate in image), by being compared with the coordinate of the identity image stored when generating the verification image To that can verify, whether the identity image is effective.

Further, in the remote auto recognition methods of above-mentioned screen of intelligent device state, the calibration includes:

The display boundary for identifying screen of intelligent device to be detected, obtain the Image Acquisition plane of image collecting device relative to The projective transformation parameter of screen of intelligent device plane to be detected;

The inverse transformation of projective transformation is carried out to received screen picture based on the projective transformation parameter;

Undistorted front projection transformation is carried out to the coordinate of the screen picture after inverse transformation with obtain screen picture without abnormal Become front view.

Above scheme gives a kind of method for calibrating the screen picture, can pass through the display boundary of recognition screen (usually frame) calibrates image, obtains being equivalent to from the distortionless image in the direction perpendicular to screen of intelligent device The image that acquisition device collects.

Further, in the remote auto recognition methods of screen of intelligent device state of the present invention, server-side judgement The screen state of smart machine to be detected whether normally include:

Training set is established, the training set includes the normal screen that smart machine normally shows each screen state detection image The improper screen picture of image and the improper each screen state detection image of display of smart machine;

Using the scorer of training set training server-side;

The screen picture for deducting the identity image is compared the scorer with the normal screen image And whether scoring, the screen state to judge smart machine to be detected are normal.

Due to by screen of intelligent device quality itself (resolution ratio, color accuracy, colour gamut, brightness, contrast etc.) shadow It rings, verification image display effect in different intelligent equipment differs greatly, but whether the display effect belongs to normal model Can enclose and (represent normal screen state) can then be judged based on machine learning algorithm.Above scheme gives one kind The method judged based on machine learning algorithm.

It is a further object of the present invention to provide a kind of remote auto identifying systems of screen of intelligent device state, which can Implement the above method.

Correspondingly, according to above-mentioned purpose, implement screen of intelligent device state of the present invention the invention proposes a kind of Remote auto recognition methods system comprising: server-side, the smart machine to be detected with server-side data connection, with clothes The image collecting device of business end data connection;Wherein, described image acquisition device acquires the screen picture of smart machine to be detected, And the screen picture is sent to server-side.

In the remote auto identifying system of the screen of intelligent device state of aforementioned present invention, the usual server-side is by servicing Provider provides, and the smart machine to be detected and described image acquisition device are provided by user.The server-side generally includes Computer, the smart machine to be detected can be all smart machines for having screen, can connecting internet, including but unlimited In smart machines such as smart phone, tablet computer, laptop, smartwatch, described image acquisition device generally includes energy The subscriber terminal equipment and image collection assembly of internet are enough connected, acquired image is passed through institute by described image acquisition component It states subscriber terminal equipment and is sent to the server-side.Usually there is the server-side sum for self-operating to download to institute for user The program for system of the present invention run on smart machine to be detected is stated, the program is described to be detected including can detecte The service routine of user's operation on smart machine;Furthermore the server-side is generally also provided at least one Web portal, can be with It is webpage, computer program, application program of mobile phone etc., can be accessed by user by subscriber terminal equipment, it is correspondingly, described Subscriber terminal equipment includes the equipment for being not limited to the accessible Web portal such as computer, mobile phone;Furthermore the server-side is logical Often also there is at least one information to send service, it can be by modes such as internet or short messages to the smart machine to be detected Send image information;Furthermore the server-side is generally also provided at least a set of computer system that can run machine learning algorithm. Described image acquisition component can be camera or the camera shooting that can be taken pictures and digital photo is transferred to subscriber terminal equipment Head assembly.The smart machine to be detected and the server-side pass through the program run thereon and are configured as according to of the present invention Step in method carries out teledata exchange, to realize the instant screen state of the smart machine to be detected stated user Judgement.

Further, in the remote auto identifying system of the screen of intelligent device state of aforementioned present invention, described image is adopted Acquisition means are arranged on subscriber terminal equipment or by subscriber terminal equipment and the server-side data connections.

In above scheme, described image acquisition component and subscriber terminal equipment can be the different piece of same portion's equipment, The equipment such as the mobile phone or tablet computer that including but not limited to can surf the Internet and take pictures are also possible to two independent equipment, example If described image acquisition component and subscriber terminal equipment are digital camera and smart machine respectively.

Correspondingly, according to above-mentioned purpose, the invention also provides another kinds to implement screen of intelligent device of the present invention The system of the remote auto recognition methods of state comprising: server-side, the smart machine to be detected with server-side data connection, With the image collecting device of server-side data connection;Wherein, described image acquisition device acquires the screen of smart machine to be detected Image, and the screen picture is sent to server-side;Operation has oracle listener on the smart machine to be detected, so that: in institute It states after verification image is shown on the screen of smart machine to be detected, operation on smart machine to be detected is i.e. monitored, and one Denier smart machine to be detected has operation, then smart machine to be detected sends information so that the verification image loses to server-side Effect.

The remote auto identifying system of the screen of intelligent device state of aforementioned present invention is described to be checked compared with aforementioned schemes It surveys also to run on smart machine and has oracle listener, to prevent the screenshotss class from attacking.

The remote auto recognition methods of screen of intelligent device state of the present invention, can remote auto identification intelligence to be detected Energy device screen state, and can judge whether the screen of intelligent device image that user sends represents the intelligence to be detected that user states The instant screen state of energy equipment, while the screen of intelligent device image automatic identification smart machine to be detected sent based on user Screen state, whole flow process are fully automated, especially adapt on a large scale in line service.In addition, in some schemes, moreover it is possible to prevent The attack of screenshotss class, again the loopholes attack such as throwing class attack.

The remote auto identifying system of screen of intelligent device state of the present invention, due to implementing the above method, equally With said effect.

Detailed description of the invention

Fig. 1 is the remote auto recognition methods of screen of intelligent device state of the present invention under the first embodiment Flow diagram.

Fig. 2 is the remote auto recognition methods of screen of intelligent device state of the present invention under second of embodiment Flow diagram.

Fig. 3 be the remote auto identifying system of screen of intelligent device state of the present invention in one embodiment Structural schematic diagram.

Fig. 4 is a kind of workflow schematic diagram of system shown in Figure 3.

Fig. 5 is another workflow schematic diagram of system shown in Figure 3.

Specific embodiment

Come below in conjunction with Figure of description and specific embodiment to screen of intelligent device state of the present invention Remote auto recognition methods and system are further described in detail, but the detailed description is not constituted to limit of the invention System.

Fig. 1 shows the remote auto recognition methods of screen of intelligent device state of the present invention in the first embodiment party Process under formula.As shown in Figure 1, the remote auto recognition methods of the screen of intelligent device state comprising steps of

It will uniquely corresponding identity code be sent to server-side with smart machine to be detected;

Server-side generates the identity image with timeliness according to identity code, and by the identity image and Random screen state detection image is sent to smart machine to be detected, and smart machine to be detected is by identity image and screen State-detection image is combined into verification image;

Verification image is shown on the screen of smart machine to be detected in a manner of full of screen of intelligent device to be detected;

Within the timeliness phase of identity image, the screen picture of smart machine to be detected is acquired, and by the screen picture It is sent to server-side;

Server-side recognition screen image (including being verified to the identity image with timeliness), it is to be checked to confirm The identity of smart machine is surveyed, and judges whether the screen state of smart machine to be detected is normal.

Fig. 2 shows the remote auto recognition methods of screen of intelligent device state of the present invention in second of embodiment party Process under formula.As shown in Fig. 2, the remote auto recognition methods of the screen of intelligent device state comprising steps of

It will uniquely corresponding identity code be sent to server-side with smart machine to be detected;

Server-side generates the identity image with timeliness according to identity code, and by the identity image and Random screen state detection image is sent to smart machine to be detected after being combined into verification image;

Verification image is shown on the screen of smart machine to be detected in a manner of full of screen of intelligent device to be detected;

Within the timeliness phase of identity image, the screen picture of smart machine to be detected is acquired, and by the screen picture It is sent to server-side;

Server-side recognition screen image (including being verified to the identity image with timeliness), it is to be checked to confirm The identity of smart machine is surveyed, and judges whether the screen state of smart machine to be detected is normal.

The remote auto recognition methods of above-mentioned screen of intelligent device state between user and service provider for being related to Screen of intelligent device state online recognition in line service.This method passes through server-side (server-side is provided by service provider) It carries out teledata with user to exchange, to realize the judgement of the instant screen state for the smart machine to be detected for stating user. This method requires user to run a program (program can be downloaded at server-side) on the smart machine to be detected of its statement, takes Also operation has a corresponding program on business end, smart machine to be detected and server-side pass through the program run thereon be configured as according to Step in the above method carries out teledata exchange, to realize the instant screen shape for the smart machine to be detected stated user The judgement of state.Wherein, by the setting of program, so that once the smart machine to be detected brings into operation program, with service Data exchange step between end just can not interrupt, to guarantee data exchange only in the intelligence to be detected of server-side and user's statement It can be carried out immediately between equipment, and then guarantee that the above method is the instant screen state to the smart machine to be detected of user's statement Judgement.In addition, " acquire the screen picture of smart machine to be detected, and the screen picture is sent to server-side " is made by user The image collecting device completion with server-side data connection provided for oneself with it.In addition, verification image include identity image and Screen state detection image;Screen picture is verification image imaging, is realized by image collecting device.Server-side identification screen Curtain image, by identify it includes identity image information and information comparison corresponding with identity code with confirm to Detect smart machine identity, while by identification it includes screen state detection image information and with randomly choose before The corresponding information comparison of screen state detection image it is whether normal with the screen state for judging smart machine to be detected.Identity is known Other code is hardware information code, can be one in the MAC Address of IMEI, Wi-Fi/ Bluetooth adapter of smart machine to be detected Kind.In addition, random screen state detection image is random from pre-prepd screen state detection image set by server-side Selection.In addition, identity image and the synthetic schemes of random screen state detection image are to be placed in identity image On random screen state detection image and it is less than random screen state detection image.In some embodiments, in order to , there is identity image in random screen state detection image in the uniqueness and difficult replicability for reinforcing verification image Position and size carry out random process, at this point, when follow-up service end identifies the screen picture, the position of identity image and Whether size will also verify consistent.It should be noted that smart machine to be detected can be and all have screen, can connect interconnection The smart machines such as the smart machine of net, including but not limited to smart phone, tablet computer, laptop, smartwatch.

In some embodiments, identity code is sent to server-side after being encrypted.

In some embodiments, after on the screen that verification image is shown in smart machine to be detected, intelligence to be detected Operation in energy equipment is i.e. monitored, once smart machine to be detected has operation, then picture failure is verified, to prevent screenshotss class Attack.Wherein, smart machine to be detected is when display verifies image, while operation has protection service routine, at any time monitoring users Any operation, and Real-time Feedback is to server-side.After listening to operation of the user on smart machine to be detected, server-side meeting Current verification picture failure, the identity image with timeliness is regenerated, correspondingly, verification image is refreshed.

In some embodiments, identity image is the coded image that can be identified by computerized algorithm.Wherein, identity Mark image can be can be accurately obtained after the identifications such as two dimensional code, bar code it includes coding information.

In some embodiments, identity image contains the first information and the second information, wherein the first information be with The corresponding identity information of identity code, the second information are the check information generated at random, which is also held in clothes Business end;In server-side recognition screen image, the check information of preservation is compared server-side with the second information identified, To confirm the identity of smart machine to be detected.Wherein, check information is used to judge the timeliness of identity image simultaneously.Its In, as an implementation, it is saved in finding key value as identity code for the check information of server-side.

In some embodiments, the timeliness of identity image showed themselves in that after validity period, identity image quilt Refresh, to prevent from throwing class attack again.In other embodiments, the timeliness of identity image was showed themselves in that in validity period Afterwards, the size that identity image appears in position and/or identity image on verification image is changed.Wherein, to every Identity image in a verification image is respectively provided with timeliness, and at regular intervals, identity image appears in check plot As upper position and/or size can change at random.

In the case, if the check plot seems to be synthesized on smart machine to be detected, intelligence to be detected Equipment can comprising location information, (it reflects the phase between identity image and screen state detection image by sending simultaneously To positional relationship) and/or identity image size information to server-side so that server-side is to the identity image Timeliness verified.The information of the above-mentioned size comprising the position and/or identity image can be after encryption It sends.If the check plot seems to be synthesized by server-side, generated by server-side and store it is above-mentioned comprising the position and/or The information of the size of identity image, to be verified for the timeliness to the identity image.

In some embodiments, screen state detection image is colored and/or with texture lines.Wherein, it takes Safeguard that a screen state detection image set, screen state detection image randomly select from this collection in business end.In the set Screen state detection image be colored and/or with texture lines.In addition, being also equipped with higher resolution ratio, adapt to The cutting of various screen of intelligent device, which is shown, to be needed.Server-side combination hand picking is matched with Automatic parameter constantly to add replacement Screen state detection image in set.

In some embodiments, before server-side recognition screen image, first screen picture is calibrated, is obtained quite In the image obtained from the direction perpendicular to screen of intelligent device with distortionless image acquisition device.When identity figure When whether the position of picture needs verification consistent, server-side is accurately determined identity image in intelligence to be detected by respective algorithms Position in energy device screen calculates identity image and sets in intelligence to be detected in conjunction with the resolution information of smart machine Pixel coordinate in standby screen is (since check plot seems full of screen of intelligent device to be detected, the pixel coordinate, that is, check plot Pixel coordinate as in), by the way that verifying identity is compared with the coordinate of the identity image stored when generating and verifying image Whether effective identify image.Wherein, as an implementation, calibration includes: to identify the display of screen of intelligent device to be detected Boundary, the Image Acquisition plane for obtaining image collecting device are joined relative to the projective transformation of screen of intelligent device plane to be detected Number;The inverse transformation of projective transformation is carried out to received screen picture based on the projective transformation parameter;To the screen map after inverse transformation The coordinate of picture carries out undistorted front projection transformation to obtain the undistorted front view of screen picture.

In some embodiments, server-side judges whether the screen state of smart machine to be detected normally includes: to establish Training set, the training set include that smart machine normally shows that the normal screen image of each screen state detection image and intelligence are set The improper screen picture of standby improper each screen state detection image of display;Using the scorer of training set training server-side; The screen picture for deducting identity image is compared and is scored with normal screen image by scorer, to judge intelligence to be detected Whether the screen state of energy equipment is normal.The program is a kind of machine learning algorithm.

Fig. 3 shows the remote auto identifying system of screen of intelligent device state of the present invention in a kind of embodiment Under structure.As shown in figure 3, the remote auto identifying system of the screen of intelligent device state includes: server-side 1, with server-side 1 The smart machine to be detected 2 of data connection, the image collecting device 3 with 1 data connection of server-side;Wherein, image collecting device 3 The screen picture of smart machine 2 to be detected is acquired, and the screen picture is sent to server-side 1.

The remote auto identifying system of above-mentioned screen of intelligent device state between user and service provider for being related to Screen of intelligent device state online recognition in line service, pass through the remote auto identification for implementing above-mentioned screen of intelligent device state Method realizes the judgement of the instant screen state for the smart machine to be detected stated user.Wherein, server-side 1 is provided by service Quotient provides, and smart machine 2 and image collecting device 3 to be detected are provided by user.Server-side 1 includes computer, intelligence to be detected Equipment 2 can be all smart machines for having screen, can connecting internet, including but not limited to smart phone, tablet computer, The smart machines such as laptop, smartwatch, image collecting device 3 include the subscriber terminal equipment 31 that can connect internet With image collection assembly 32, acquired image is sent to server-side 1 by subscriber terminal equipment 31 by image collection assembly 32. There is server-side 1 sum for self-operating to download to the program for this system run on smart machine 2 to be detected for user, The program includes the service routine that can detecte the user's operation on smart machine 2 to be detected;Furthermore server-side 1 also has several Web portal, including but not limited to webpage, computer program and application program of mobile phone can pass through subscriber terminal equipment by user 31 are accessed, and correspondingly, subscriber terminal equipment 31 includes being not limited to setting for the accessible above-mentioned Web portal such as computer, mobile phone It is standby;Furthermore server-side 1 also there are several information to send service, can be by modes such as internet or short messages to intelligence to be detected Equipment 2 sends image information;Furthermore server-side 1 can also run the computer system of machine learning algorithm with several sets.Image Acquisition component 32 is the camera or CCD camera assembly that can take pictures and be transferred to digital photo subscriber terminal equipment 31.To Detection smart machine 2 and server-side 1 pass through the program run thereon and are configured as according to the remote of above-mentioned screen of intelligent device state Step in journey automatic identifying method carries out teledata exchange, is with realize the smart machine to be detected 2 stated user When screen state judgement.

In some embodiments, image collecting device 3 is arranged on subscriber terminal equipment 31 or is set by user terminal For 31 and 1 data connection of server-side.Wherein, image collection assembly 32 and subscriber terminal equipment 31 can be same portion's equipment not Same part, the equipment such as the mobile phone or tablet computer that including but not limited to can surf the Internet and take pictures, be also possible to two it is independent Equipment, such as image collection assembly 32 and subscriber terminal equipment 31 are digital camera and smart machine respectively.

In some embodiments, also operation has oracle listener on smart machine 2 to be detected, so that: it is aobvious in verification image After showing on the screen of smart machine 2 to be detected, the operation on smart machine 2 to be detected is i.e. monitored, once intelligence to be detected Energy equipment 2 has operation, then smart machine 2 to be detected sends information so as to verify picture failure, described in preventing to server-side 1 The attack of screenshotss class.

Fig. 4 shows a kind of workflow of above system.In conjunction with reference Fig. 3 and Fig. 4, which passes through to be checked It surveys in smart machine 2 and server-side 1 and runs corresponding program simultaneously and realize, including following can not be set in intelligence to be detected with interrupting Standby 2 and server-side 1 swapping data the step of:

Step 110: smart machine 2 to be detected passes through the identity knowledge that the program run thereon obtains smart machine 2 to be detected Other code is simultaneously sent to server-side 1 by exit passageway.

Step 120: server-side 1 passes through the program run thereon and is generated according to received identity code with timeliness The identity image of property, and the identity image is sent to smart machine 2 to be detected.

Step 130: server-side 1 pass through the program that runs thereon by randomly selected screen state detection image be sent to Detect smart machine 2.

Step 140: smart machine 2 to be detected passes through the program run thereon and executes a random hybrid algorithm for identity mark Know image and carries out being mixed to form verification image and be displayed on the screen with screen detection image.In this step, intelligence to be detected Equipment 2 is gone back while being encrypted and sends comprising the location information (phase between its reflection identity image and screen state detection image To positional relationship) and/or identity image size information to server-side 1 so that in server-side 1 in following step 170 In the timeliness of identity image is verified.

Step 150: running oracle listener on smart machine 2 to be detected, user should stop setting intelligence to be detected at this time Standby 2 carry out any operation.Smart machine 2 to be detected pass through the oracle listener that runs thereon connect server-side 1 and continue detection to All user's operation behaviors on smart machine 2 are detected, once discovery user has operation to smart machine 2 to be detected, then to clothes The transmission message of end 1 of being engaged in informs that server-side 1 will currently verify picture failure, and process returns to step 120.

Step 160: user is adopted with image collection assembly 32 (usually camera) within the validity period of identity image Collect the front screen image (usually photo) of smart machine 2 to be detected and by subscriber terminal equipment 31 (usually computer) from The screen picture is sent server-side 1 by the Web portal (usually webpage) of server-side 1.

Step 170: server-side 1 passes through the body in the screen picture that the routine call algorithm run thereon identifies that user sends Part mark image, and its timeliness is verified, confirm to be detected smart machine 2 of the screen picture in step 110.

Step 180: server-side 1 passes through the routine call machine learning algorithm run thereon and analyzes the screen map that user sends Screen state detection image as in, judges whether screen is shown normal.

Fig. 5 shows another workflow of above system.In conjunction with reference Fig. 3 and Fig. 5, the workflow by Corresponding program is run on detection smart machine 2 and server-side 1 simultaneously to realize, including it is following can not be with interrupting in intelligence to be detected The step of swapping data of equipment 2 and server-side 1:

Step 210: smart machine 2 to be detected passes through the identity knowledge that the program run thereon obtains smart machine 2 to be detected Other code is simultaneously sent to server-side 1 by exit passageway.

Step 220: server-side 1 passes through the program run thereon and is generated according to received identity code with timeliness The identity image of property.

Step 230: server-side 1 pass through the program that runs thereon execute a random hybrid algorithm by identity image and Randomly selected screen state detection image is carried out being mixed to form verification image and be sent to smart machine 2 to be detected.At this point, by Server-side 1 is generated and is stored (opposite between its reflection identity image and screen state detection image comprising location information Positional relationship) and/or identity image size information so that server-side 1 is in step 270 to identity image Timeliness is verified.

Step 240: smart machine 2 to be detected passes through the program run thereon and shows the verification image received in screen On.

Step 250: running oracle listener on smart machine 2 to be detected, user should stop setting intelligence to be detected at this time Standby 2 carry out any operation.Smart machine 2 to be detected pass through the oracle listener that runs thereon connect server-side 1 and continue detection to All user's operation behaviors on smart machine 2 are detected, once discovery user has operation to smart machine 2 to be detected, then to clothes The transmission message of end 1 of being engaged in informs that server-side 1 will currently verify picture failure, and process returns to step 220.

Step 260: user is adopted with image collection assembly 32 (usually camera) within the validity period of identity image Collect the front screen image (usually photo) of smart machine 2 to be detected and by subscriber terminal equipment 31 (usually computer) from The screen picture is sent server-side 1 by the Web portal (usually webpage) of server-side 1.

Step 270: server-side 1 passes through the body in the screen picture that the routine call algorithm run thereon identifies that user sends Part mark image, and the verifying to its timeliness, confirm to be detected smart machine 2 of the screen picture in step 110.

Step 280: server-side 1 passes through the routine call machine learning algorithm run thereon and analyzes the screen map that user sends Screen state detection image as in, judges whether screen is shown normal.

It should be noted that if having exceeded validity period, identity image can be refreshed in some embodiments, alternatively, In other embodiments, identity image appears in the position on verification image and/or the size of identity image It is changed.So in the case, then step 120 or 220 are come back to.

It should be noted that the above list is only specific embodiments of the present invention, it is clear that the present invention is not limited to above real Example is applied, there are many similar variations therewith.If those skilled in the art directly exported from present disclosure or All deformations associated, are within the scope of protection of the invention.

Claims (15)

1. a kind of remote auto recognition methods of screen of intelligent device state, which is characterized in that comprising steps of
It will uniquely corresponding identity code be sent to server-side with smart machine to be detected;
Server-side generates the identity image with timeliness according to the identity code, and by the identity image and Random screen state detection image is sent to smart machine to be detected, smart machine to be detected by the identity image and Screen state detection image is combined into verification image;Or server-side generates the body with timeliness according to the identity code Part mark image, and by the identity image and random screen state detection image be combined into verification image after be sent to Detect smart machine;
The verification image is shown on the screen of smart machine to be detected in a manner of full of screen of intelligent device to be detected;
Within the timeliness phase of identity image, the screen picture of smart machine to be detected is acquired, and the screen picture is sent To server-side;
Server-side identifies the screen picture, to confirm the identity of smart machine to be detected, and judges smart machine to be detected Whether screen state is normal.
2. the remote auto recognition methods of screen of intelligent device state as described in claim 1, which is characterized in that the identity Identification code is sent to server-side after being encrypted.
3. the remote auto recognition methods of screen of intelligent device state as described in claim 1, which is characterized in that in the school It tests after image is shown on the screen of smart machine to be detected, the operation on smart machine to be detected is i.e. monitored, once to Detecting smart machine has operation, then the verification picture failure.
4. the remote auto recognition methods of screen of intelligent device state as described in claim 1, which is characterized in that the identity Identifying image is the coded image that can be identified by computerized algorithm.
5. the remote auto recognition methods of screen of intelligent device state as described in claim 1, which is characterized in that the identity Mark image at least contains the first information and the second information, and wherein the first information is identity corresponding with identity code letter Breath, the second information is the check information generated at random, which is also held in server-side;The screen is identified in server-side When curtain image, the check information of preservation is compared server-side with the second information identified, to confirm intelligence to be detected The identity of equipment.
6. the remote auto recognition methods of screen of intelligent device state as claimed in claim 5, which is characterized in that be saved in The check information of server-side finds key value as the identity code.
7. the remote auto recognition methods of screen of intelligent device state as described in claim 1, which is characterized in that the identity The timeliness of mark image shows themselves in that after validity period, identity image is refreshed.
8. the remote auto recognition methods of screen of intelligent device state as described in claim 1, which is characterized in that the identity The timeliness of mark image shows themselves in that after validity period, identity image appears in position and/or identity on verification image The size of mark image is changed.
9. the remote auto recognition methods of screen of intelligent device state as described in claim 1, which is characterized in that the screen State-detection image is colored and/or with texture lines.
10. the remote auto recognition methods of the screen of intelligent device state as described in any one of claim 1-9, feature It is, before the server-side identifies the screen picture, first the screen picture is calibrated.
11. the remote auto recognition methods of screen of intelligent device state as claimed in claim 10, which is characterized in that the school Standard includes:
The display boundary for identifying screen of intelligent device to be detected obtains the Image Acquisition plane of image collecting device relative to be checked Survey the projective transformation parameter of screen of intelligent device plane;
The inverse transformation of projective transformation is carried out to received screen picture based on the projective transformation parameter;
Undistorted front projection transformation is carried out to the coordinate of the screen picture after inverse transformation with obtain screen picture it is undistorted just View.
12. the remote auto recognition methods of screen of intelligent device state as described in claim 1, which is characterized in that server-side Judge smart machine to be detected screen state whether normally include:
Training set is established, the training set includes the normal screen image that smart machine normally shows each screen state detection image And the improper screen picture of the improper each screen state detection image of display of smart machine;
Using the scorer of training set training server-side;
The screen picture for deducting the identity image is compared and is commented with the normal screen image by the scorer Point, whether the screen state to judge smart machine to be detected is normal.
13. a kind of implement such as claim 1-2, the remote auto of screen of intelligent device state described in any one of 4-12 is known The system of other method comprising: server-side, the smart machine to be detected with server-side data connection, with server-side data connection Image collecting device;Wherein, described image acquisition device acquires the screen picture of smart machine to be detected, and by the screen map As being sent to server-side.
14. system as claimed in claim 13, which is characterized in that described image acquisition device is arranged on subscriber terminal equipment Or pass through subscriber terminal equipment and the server-side data connection.
15. a kind of system for the remote auto recognition methods for implementing screen of intelligent device state as claimed in claim 3, packet It includes: server-side, the smart machine to be detected with server-side data connection, the image collecting device with server-side data connection;Its In, described image acquisition device acquires the screen picture of smart machine to be detected, and the screen picture is sent to server-side;Institute Stating operation on smart machine to be detected has oracle listener, so that: smart machine to be detected is shown in the verification image After on screen, the operation on smart machine to be detected is i.e. monitored, operates once smart machine to be detected has, then intelligence to be detected Energy equipment sends information so that the verification picture failure to server-side.
CN201610349430.3A 2016-05-24 2016-05-24 A kind of the remote auto recognition methods and system of screen of intelligent device state CN106060126B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610349430.3A CN106060126B (en) 2016-05-24 2016-05-24 A kind of the remote auto recognition methods and system of screen of intelligent device state

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610349430.3A CN106060126B (en) 2016-05-24 2016-05-24 A kind of the remote auto recognition methods and system of screen of intelligent device state

Publications (2)

Publication Number Publication Date
CN106060126A CN106060126A (en) 2016-10-26
CN106060126B true CN106060126B (en) 2019-03-19

Family

ID=57175791

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610349430.3A CN106060126B (en) 2016-05-24 2016-05-24 A kind of the remote auto recognition methods and system of screen of intelligent device state

Country Status (1)

Country Link
CN (1) CN106060126B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1777101A (en) * 2005-11-22 2006-05-24 大连理工大学 Real-time identity authentication method based on mobile phone, bluetooth and two-dimensional barcode
CN101782456A (en) * 2009-01-19 2010-07-21 深圳市新超亮特种显示设备有限公司 Method and system for remotely detecting working state of monitor
CN102915188A (en) * 2011-08-01 2013-02-06 中国移动通信集团公司 Method and device for controlling display status of terminal screen
CN104238819A (en) * 2014-09-16 2014-12-24 上海维服网络科技有限公司 Detection method and system for display screen state in mobile terminal
CN104935451A (en) * 2014-03-19 2015-09-23 中国移动通信集团公司 Fault detection method and device
CN105162993A (en) * 2015-10-28 2015-12-16 深圳市大悦智能科技有限公司 Automatic surveying method for mobile phone screen breaking insurance

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2652657A1 (en) * 2010-12-16 2013-10-23 Nike International Ltd. Methods and systems for encouraging athletic activity

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1777101A (en) * 2005-11-22 2006-05-24 大连理工大学 Real-time identity authentication method based on mobile phone, bluetooth and two-dimensional barcode
CN101782456A (en) * 2009-01-19 2010-07-21 深圳市新超亮特种显示设备有限公司 Method and system for remotely detecting working state of monitor
CN102915188A (en) * 2011-08-01 2013-02-06 中国移动通信集团公司 Method and device for controlling display status of terminal screen
CN104935451A (en) * 2014-03-19 2015-09-23 中国移动通信集团公司 Fault detection method and device
CN104238819A (en) * 2014-09-16 2014-12-24 上海维服网络科技有限公司 Detection method and system for display screen state in mobile terminal
CN105162993A (en) * 2015-10-28 2015-12-16 深圳市大悦智能科技有限公司 Automatic surveying method for mobile phone screen breaking insurance

Also Published As

Publication number Publication date
CN106060126A (en) 2016-10-26

Similar Documents

Publication Publication Date Title
CN105359516B (en) visual command processing
CN102868696B (en) The communication of many equipment rooms and information synchronization method and system
CN103795798B (en) Mobile phone checking-in method
CN103635954B (en) Strengthen the system of viewdata stream based on geographical and visual information
CN105869224B (en) A kind of classroom based on intelligent terminal WLAN is registered method and system
CN104581630B (en) A kind of self-service anti-method of registering of practising fraud based on location-based service and planar bar code technology
US20150110100A1 (en) Wireless communication system, wireless communication device, projector, and wireless communication method
CN100592690C (en) Group judgment device
JP5564946B2 (en) Video providing system and video providing method
US9025015B2 (en) Verification of playout of signage
CN104205774B (en) network address repository management
JP6402144B2 (en) Method and system for finding a guardian based on a two-dimensional code
GB2543673A (en) Online pseudonym verification and identity validation
EP1361725A2 (en) System and method for facilitating interactive presentations using wireless messaging
CN104137520B (en) A kind of information push method and device
CN104885125A (en) Information processing device, information processing system, and information processing method
CN104954506B (en) A kind of account management method, terminal device and system
CN104254869A (en) A method and system for projecting a visible representation of infrared radiation
US20090083060A1 (en) Automated computer electronics device reporting
CN103165106B (en) A kind of display system and display packing
CN104506886B (en) A kind of fault handling method and cloud server
DE10392489T5 (en) Initialize relationships between devices in a network
RU2008133798A (en) Network security system and method of its application
RU2679115C2 (en) External control lighting systems based on third party content
TW201505469A (en) Communication system for establishing p2p connections and the corresponding devices using the same

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
GR01 Patent grant
GR01 Patent grant