CN112287234B

CN112287234B - Information retrieval method, device and storage medium

Info

Publication number: CN112287234B
Application number: CN202011283949.9A
Authority: CN
Inventors: 杨俊拯; 毕浩; 钟卫东
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-11-16
Filing date: 2020-11-16
Publication date: 2023-05-30
Anticipated expiration: 2040-11-16
Also published as: WO2022100222A1; CN112287234A

Abstract

The application discloses an information retrieval method, an information retrieval device, an information retrieval system and a storage medium, wherein the information retrieval method, the information retrieval device and the storage medium are applied to first electronic equipment, and the information retrieval method comprises the following steps: acquiring a search request, wherein the search request is used for searching at least one second electronic device; the search request is sent to a cloud server, a device list of the at least one second electronic device is obtained by the cloud server, and relevant information of the at least one second electronic device is obtained according to the device list; receiving relevant information of the at least one second electronic device fed back by the cloud server; accessing each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device, and receiving a retrieval result fed back by the at least one second electronic device; and displaying the retrieval result fed back by the at least one second electronic device. By adopting the embodiment of the application, the search of a plurality of devices can be realized.

Description

Information retrieval method, device and storage medium

Technical Field

The present disclosure relates to the field of information processing technologies, and in particular, to an information retrieval method, an information retrieval device, and a storage medium.

Background

Along with the wide popularization and application of electronic products (such as mobile phones, tablet computers and the like), the electronic products have more and more applications and more powerful functions, the electronic products develop towards diversification and individuation, the importance of the electronic products to users is conceivable, and obviously the electronic products become indispensable electronic products in the life of the users.

In life, a user may have multiple devices at the same time. The devices may have various forms, such as mobile phones, computers, tablets, televisions, routers, etc., some devices have data and some devices have display and input devices; unlike cloud searching, where the server is located in the same network, a plurality of devices may be in a complex network environment and cannot be directly connected to each other, and the problem of how to search for a plurality of devices in this case needs to be solved.

Disclosure of Invention

The embodiment of the application provides an information retrieval method, an information retrieval device and a storage medium, which can realize searching of a plurality of devices and improve the searching intelligence.

In a first aspect, an embodiment of the present application provides an information retrieval method, applied to an electronic device, where the method includes:

Acquiring a search request, wherein the search request is used for searching at least one second electronic device;

the retrieval request is sent to a cloud server, a device list of the at least one second electronic device is obtained through the cloud server, and relevant information of the at least one second electronic device is obtained according to the device list;

receiving relevant information of the at least one second electronic device fed back by the cloud server;

accessing each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device, and receiving a retrieval result fed back by the at least one second electronic device;

and displaying the retrieval result fed back by the at least one second electronic device.

In a second aspect, an embodiment of the present application provides an information retrieval apparatus, applied to a cloud server, where the method includes:

receiving a search request sent by a first electronic device, wherein the search request is used for searching at least one second electronic device;

acquiring a device list of the at least one second electronic device, and acquiring related information of the at least one second electronic device according to the device list;

And sending the related information of the at least one second electronic device to the first electronic device, so that the first electronic device accesses each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device, receives the retrieval result fed back by the at least one second electronic device, and displays the retrieval result fed back by the at least one second electronic device.

In a third aspect, an embodiment of the present application provides an information retrieval apparatus, applied to a first electronic device, where the apparatus includes: an acquisition unit, a transmission unit, a receiving unit, a retrieval unit and a display unit, wherein,

the acquisition unit is used for acquiring a search request, and the search request is used for searching at least one second electronic device;

the sending unit is used for sending the search request to a cloud server, obtaining a device list of the at least one second electronic device through the cloud server, and obtaining relevant information of the at least one second electronic device according to the device list;

the receiving unit is used for receiving the related information of the at least one second electronic device fed back by the cloud server;

The retrieval unit is used for accessing each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device and receiving a retrieval result fed back by the at least one second electronic device;

the display unit is used for displaying the search result fed back by the at least one second electronic device.

In a fourth aspect, an embodiment of the present application provides an information retrieval apparatus, applied to a cloud server, where the apparatus includes: a receiving unit, an acquiring unit and a transmitting unit, wherein,

the receiving unit is used for receiving a search request sent by the first electronic equipment, and the search request is used for searching at least one second electronic equipment;

the acquiring unit is used for acquiring a device list of the at least one second electronic device and acquiring related information of the at least one second electronic device according to the device list;

the sending unit is configured to send the relevant information of the at least one second electronic device to the first electronic device, so that the first electronic device accesses each electronic device in the at least one second electronic device according to the relevant information of the at least one second electronic device, receives a search result fed back by the at least one second electronic device, and displays the search result fed back by the at least one second electronic device.

In a fifth aspect, an embodiment of the present application provides an information retrieval system, where the information retrieval system includes a first electronic device, a cloud server, and at least one second electronic device, and the method includes:

the first electronic equipment acquires a search request, wherein the search request is used for searching at least one second electronic equipment;

the first electronic device sends the search request to a cloud server;

the cloud server acquires a device list of the at least one second electronic device, and acquires related information of the at least one second electronic device according to the device list;

the first electronic device receives the related information of the at least one second electronic device fed back by the cloud server;

the first electronic equipment accesses each electronic equipment in the at least one second electronic equipment according to the related information of the at least one second electronic equipment, and receives a retrieval result fed back by the at least one second electronic equipment;

and the first electronic equipment displays the retrieval result fed back by the at least one second electronic equipment.

In a sixth aspect, embodiments of the present application provide an electronic device comprising a processor, a memory for storing one or more programs and configured for execution by the processor, the programs comprising instructions for performing the steps in the method of any of the first aspects.

In a seventh aspect, embodiments of the present application provide a cloud server comprising a processor, a memory for storing one or more programs and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of the first aspects.

In an eighth aspect, embodiments of the present application provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program causes a computer to perform some or all of the steps as described in the first aspect of the embodiments of the present application.

In a ninth aspect, embodiments of the present application provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program causes a computer to perform some or all of the steps as described in the second aspect of the embodiments of the present application.

In a tenth aspect, embodiments of the present application provide a computer program product, wherein the computer program product comprises a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform part or all of the steps described in the first aspect of the embodiments of the present application. The computer program product may be a software installation package.

In an eleventh aspect, embodiments of the present application provide a computer program product, wherein the computer program product comprises a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps described in the first aspect of the embodiments of the present application. The computer program product may be a software installation package.

By implementing the embodiment of the application, the following beneficial effects are achieved:

it can be seen that, in the embodiments of the present application, the information retrieval method, apparatus, system and storage medium described in the embodiments of the present application are applied to a first electronic device, obtain a retrieval request, where the retrieval request is used to retrieve at least one second electronic device, send the retrieval request to a cloud server, obtain a device list of the at least one second electronic device by the cloud server, obtain relevant information of the at least one second electronic device according to the device list, receive relevant information of the at least one second electronic device fed back by the cloud server, access each electronic device in the at least one second electronic device according to the relevant information of the at least one second electronic device, and receive a retrieval result fed back by the at least one second electronic device, and display the retrieval result fed back by the at least one second electronic device.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 2 is a schematic software structure of an electronic device according to an embodiment of the present application;

fig. 3A is a schematic flow chart of an information retrieval method according to an embodiment of the present application;

FIG. 3B is a schematic diagram of an information retrieval system according to an embodiment of the present application;

FIG. 3C is a schematic diagram of another information retrieval system according to an embodiment of the present application;

fig. 3D is a schematic illustration of a search result presentation provided in an embodiment of the present application;

FIG. 4 is a schematic diagram of another information retrieval system according to an embodiment of the present application;

FIG. 5A is a flowchart illustrating another information retrieval method according to an embodiment of the present disclosure;

FIG. 5B is a schematic diagram of an information retrieval system according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a first electronic device according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a cloud server according to an embodiment of the present application;

FIG. 8 is a flowchart of another information retrieval method according to an embodiment of the present disclosure;

FIG. 9 is a block diagram showing the functional units of an information retrieval apparatus according to an embodiment of the present application;

fig. 10 is a block diagram showing functional units of another information retrieval apparatus according to the embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

For a better understanding of aspects of embodiments of the present application, related terms and concepts that may be related to embodiments of the present application are described below.

The electronic device may communicate with a functional device such as a smart phone, a vehicle mounted device (navigator, vehicle recorder, radar rangefinder, etc.), a wearable device, a smart watch, an intercom, smart glasses, a wireless bluetooth headset, a computing device, a router or other processing device connected to a wireless modem, as well as various forms of User Equipment (UE), a Mobile Station (MS), a virtual reality/augmented reality device, a terminal device (terminal device), ETC. The first electronic device and the second electronic device may be referred to as electronic devices.

The electronic device may further include an intelligent home device, where the intelligent home device may be at least one of: the intelligent sound box, the intelligent camera, the intelligent electric cooker, the intelligent wheelchair, the intelligent massage chair, the intelligent furniture, the intelligent dish washer, the intelligent television, the intelligent refrigerator, the intelligent electric fan, the intelligent warmer, the intelligent clothes hanger, the intelligent lamp, the intelligent router, the intelligent switch board, the intelligent humidifier, the intelligent air conditioner, the intelligent door, the intelligent window, the intelligent cooking bench, the intelligent disinfection cabinet, the intelligent toilet, the sweeping robot and the like are not limited herein.

In the first part, the software and hardware operation environment of the technical scheme disclosed in the application is introduced as follows.

As shown, fig. 1 shows a schematic structural diagram of an electronic device 100. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a compass 190, a motor 191, an indicator 192, a camera 193, a display 194, a subscriber identity module (subscriber identification module, SIM) card interface 195, and the like.

It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor AP, a modem processor, a graphics processor GPU, an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor NPU, etc. Wherein the different processing units may be separate components or may be integrated in one or more processors. In some embodiments, the electronic device 101 may also include one or more processors 110. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution. In other embodiments, memory may also be provided in the processor 110 for storing instructions and data. Illustratively, the memory in the processor 110 may be a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it may be called directly from memory. This avoids repeated accesses and reduces the latency of the processor 110, thereby improving the efficiency of the electronic device 101 in processing data or executing instructions.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include inter-integrated circuit (inter-integrated circuit, I2C) interfaces, inter-integrated circuit audio (inter-integrated circuit sound, I2S) interfaces, pulse code modulation (pulse code modulation, PCM) interfaces, universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interfaces, mobile industry processor interfaces (mobile industry processor interface, MIPI), general-purpose input/output (GPIO) interfaces, SIM card interfaces, and/or USB interfaces, among others. The USB interface 130 is an interface conforming to the USB standard, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 101, or may be used to transfer data between the electronic device 101 and a peripheral device. The USB interface 130 may also be used to connect headphones through which audio is played.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and does not limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also use different interfacing manners, or a combination of multiple interfacing manners in the foregoing embodiments.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 140 may receive a charging input of a wired charger through the USB interface 130. In some wireless charging embodiments, the charge management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle times, battery health (leakage, impedance), and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The

antennas

1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G/6G, etc. applied on the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), UWB module, etc., applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (FLED), a mini light-emitting diode (mini light-emitting diode), microLed, micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or more display screens 194.

The electronic device 100 may implement a photographing function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, so that the electrical signal is converted into an image visible to naked eyes. ISP can also perform algorithm optimization on noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature, etc. of the photographed scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or more cameras 193.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store one or more computer programs, including instructions. The processor 110 may cause the electronic device 101 to execute the methods of displaying page elements, and various applications, data processing, and the like provided in some embodiments of the present application by executing the above-described instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area can store an operating system; the storage program area may also store one or more applications (such as gallery, contacts, etc.), etc. The storage data area may store data created during use of the electronic device 101 (e.g., photos, contacts, etc.), and so on. In addition, the internal memory 121 may include high-speed random access memory, and may also include nonvolatile memory, such as one or more disk storage units, flash memory units, universal flash memory (universal flash storage, UFS), and the like. In some embodiments, processor 110 may cause electronic device 101 to perform the methods of displaying page elements provided in embodiments of the present application, as well as other applications and data processing, by executing instructions stored in internal memory 121, and/or instructions stored in a memory provided in processor 110. The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

The pressure sensor 180A is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 may also calculate the location of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: and executing an instruction for checking the short message when the touch operation with the touch operation intensity smaller than the first pressure threshold acts on the short message application icon. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 180B may be used to determine a motion gesture of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., X, Y and Z axis) may be determined by gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the electronic device 100 through the reverse motion, so as to realize anti-shake. The gyro sensor 180B may also be used for navigating, somatosensory game scenes.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 100 is stationary. The electronic equipment gesture recognition method can also be used for recognizing the gesture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

The ambient light sensor 180L is used to sense ambient light level. The electronic device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. Ambient light sensor 180L may also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent false touches.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc.

The temperature sensor 180J is for detecting temperature. In some embodiments, the electronic device 100 performs a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs a reduction in the performance of a processor located in the vicinity of temperature sensor 180J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the electronic device 100 heats the battery 142 to avoid the low temperature causing the electronic device 100 to be abnormally shut down. In other embodiments, when the temperature is below a further threshold, the electronic device 100 performs boosting of the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperatures.

The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display 194.

By way of example, fig. 2 shows a block diagram of the software architecture of the electronic device 100. The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively. The application layer may include a series of application packages.

As shown in fig. 2, the application layer may include applications for cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is used to provide the communication functions of the electronic device 100. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media library (media library), three-dimensional graphics processing library (e.g., openGL ES), 2D graphics engine (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio video encoding formats, such as: MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The second part, the information retrieval method and the information retrieval device disclosed in the embodiment of the application are described as follows.

Fig. 3A is a schematic flow chart of an information retrieval method provided in an embodiment of the present application, which is applied to a first electronic device, and as shown in the figure, the information retrieval method includes:

301. a search request is obtained, the search request being used for searching at least one second electronic device.

In this embodiment of the present application, the search request may include a search term, or may not include a search term, where the search manner may include typical keywords, or include a list for a given resource without keywords, such as a picture list, a video list, a file list, and so on, and include various screening and sorting methods for information of these lists. . The search term may be entered by the user himself or the system may be pushed. The search term may be at least one of the following: chinese characters, english sentences, character strings, german sentences, french sentences, dialect sentences, japanese sentences, korean sentences, images, videos, documents, and the like, are not limited herein. In a specific implementation, the first electronic device may input a search term, generate a search request according to the search term, input the search term through the touch display screen, and generate the search request according to the search term. When the input search term is not text content, the search term can be converted into text content, and then subsequent search is carried out. The at least one second electronic device may belong to the same set or the same group, and further, the managed devices may be further extended, more types of devices may be managed, and a greater number of devices under the user name.

In addition, the first electronic device may be directly connected, indirectly connected, or unconnected to any of the at least one second electronic device, which is not limited herein. The number of the at least one second electronic device may be 1, 2, 3, or more, without limitation. The first electronic device may store, as a device list, relevant information of at least one second electronic device in the cloud server, where the relevant information may be at least one of the following: device identification information, device user record information, device, wherein the device identification information may be at least one of: MAC address, IP address, SIM card number, ICCID card number, device name, internet access permission number, etc., and are not limited herein. The device usage record information may be at least one of: browsing records, user habit data, user behavior habit data, work log data, and the like, are not limited herein. The user habit data may be at least one of: the operation habit data, the browsing habit data, and the like are not limited herein.

According to the method and the device, not only can all devices under a single user name be searched, but also unified searching among devices of cross users can be performed through certain authorization. With inter-user authorization, one user can search for content in his devices that are authorized to other users.

In one possible example, the step of inputting the search term may include the steps of:

a1, acquiring a target voice fragment;

and A2, analyzing the target voice fragment to obtain the search term.

The first electronic device can collect target voice fragments input by a user, convert the target voice fragments into texts, and perform semantic recognition on the texts to obtain search words.

b1, obtaining input content;

b2, when the input content is not text content, converting the input content into target text content;

and B3, extracting keywords from the target text content to obtain the search term.

In a specific implementation, the first electronic device may acquire the input content through an input circuit, where the input circuit may be at least one of: microphones, touch-sensitive display screens, touch-sensitive pens, mice, keyboards, etc., are not limited herein.

In a specific implementation, the first electronic device may acquire the input content, and when the input content is not text content, the input content may be converted into the target text content by means of character recognition, voice recognition, image recognition, and the like, and keyword extraction is performed on the target text content to obtain the search term, so that subsequent search may be facilitated.

302. And sending the search request to a cloud server, acquiring a device list of the at least one second electronic device through the cloud server, and acquiring related information of the at least one second electronic device according to the device list.

In this embodiment of the present application, the first electronic device may send a search request to the cloud server, where after receiving the search request, the cloud server may obtain a device list of at least one second electronic device, obtain relevant information of the at least one second electronic device according to the device list, and feed back the relevant information to the first electronic device.

303. And receiving relevant information of the at least one second electronic device fed back by the cloud server.

In a specific implementation, the cloud server may sequentially send at least one second electronic device to the first electronic device, or the cloud server may also package the at least one second electronic device, and send the packaged data packet to the first electronic device, where the first electronic device may receive relevant information of each second electronic device in the at least one second electronic device fed back by the cloud server.

304. Accessing each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device, and receiving a retrieval result fed back by the at least one second electronic device.

In a specific implementation, the first electronic device may access each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device, and receive a search result fed back by the at least one second electronic device, where each second electronic device may correspond to one search result.

Optionally, the step 304 of accessing each of the at least one second electronic device according to the related information of the at least one second electronic device may be implemented as follows:

directly accessing the second electronic device i when the related information of the at least one second electronic device confirms that the second electronic device i is allowed to be directly accessed;

or alternatively, the process may be performed,

when the related information of at least one second electronic device confirms that the second electronic device i is not allowed to be directly accessed, reporting the device information of the second electronic device i which needs to be connected to the cloud server, establishing a network tunnel between the first electronic device and the second electronic device i by the cloud server, and accessing the second electronic device i through the network tunnel;

The second electronic device i is any one of the at least one second electronic device.

In this embodiment of the present application, taking the second electronic device i as an example, the second electronic device i is any second electronic device in at least one second electronic device, and when the related information of at least one second electronic device confirms that the second electronic device i is allowed to be directly accessed, the first electronic device may directly access the second electronic device i, and further directly obtain a search result fed back by the second electronic device i. Otherwise, when the related information of at least one second electronic device confirms that the second electronic device i is not allowed to be directly accessed, reporting device information of the second electronic device i to be connected to a cloud server, establishing a network tunnel between the first electronic device and the second electronic device i by the cloud server, accessing the second electronic device i through the network tunnel, specifically, if the first electronic device cannot directly access the second electronic device i, the first electronic device can report device information of a device to be connected to a network traversing module of a device management system of the cloud server, the network traversing module establishes a network tunnel on a cloud end and the second electronic device i, provides a public network IP and a port to enable the device connected to the Internet to directly access, and returns the information to the first electronic device. In a specific implementation, the cloud end can be changed to be used as a transfer station in the whole searching process, so that access to equipment which is not directly connected is realized.

305. And displaying the retrieval result fed back by the at least one second electronic device.

In a specific implementation, the electronic device may display the search result fed back by at least one second electronic device after random randomness or ordering, for example, the user may search any device for the upper application and data of all devices under his name, and the data in the application and the data will be ordered uniformly according to the relevance.

In addition, the data of the user are kept on the original equipment, the data can not be synchronized among the equipment, the cloud synchronization can not be performed, and only the reference data are transmitted among the equipment during searching, and the original data are not contained, so that the privacy safety of the user is ensured.

In a specific implementation, the types of the managed user devices can be diversified, such as a computer, a mobile phone, a Pad, a television, a watch, a router and the like, and according to the characteristics of the device, a data provider and a search device can exist in the device at the same time or one of the data provider and the search device.

Of course, the retrieving device in the embodiment of the application can be run on any device, and further can be run on a web end, so that compatibility of different devices and systems is achieved. Through the open data indexing module, content in the system application, as well as third party applications, can be added to the search scope. In order to filter massive amounts of third party application information, content in the third party application is only strongly relevant to the user, such as browsed, recently accessed by a majority of people, etc., and may appear in the search results.

In the specific implementation, the display instantaneity and the integrity of the search result can be realized through the modes of asynchronous retrieval and UI asynchronous display of a plurality of devices, further, the display modes of data differentiation of different devices can be realized, and the results of different devices can be determined through different colors.

In a specific implementation, the definition of the strong correlation between the data in the application and the user can be expanded, the collective user behavior data can be adopted as a main way, the developer is defined as an auxiliary way, and further, the content which is strongly correlated with the data in the application can be defined according to the browsing record, the use preference and the current scene of the single user.

Optionally, the step 305 of displaying the search result fed back by the at least one second electronic device may include the following steps:

51. determining the priority order of the retrieval results fed back by the at least one second electronic device;

52. and displaying the retrieval result fed back by the at least one second electronic device according to the priority order.

The first electronic device may obtain device usage information, user habit data, or a correlation degree between the search result and the search request of at least one second electronic device to determine a priority order, where the correlation degree may be obtained by comparing the search term with the search result by a search algorithm, for example, if the device is frequently used, the device has a high priority, or if the correlation degree is high, the device has a high priority, and the like, which is not limited herein. Furthermore, the first electronic device can display the search result fed back by at least one second electronic device according to the priority order, so that the search result can be intelligently displayed according to the habit of the user, or the use frequency of the device, or the search relativity.

Further, optionally, the step 51 of determining the priority order of the search results fed back by the at least one second electronic device may include the following steps:

511. Acquiring user habit data and a corresponding correlation degree of a search result of each second electronic device in the at least one second electronic device to obtain at least one user habit data and a corresponding correlation degree;

512. determining a corresponding adjustment coefficient according to each user habit data in the at least one user habit data to obtain at least one adjustment coefficient;

513. adjusting the corresponding correlation according to the at least one adjusting coefficient to obtain at least one reference correlation;

514. and determining the priority order of the retrieval results fed back by the at least one second electronic device according to the at least one reference correlation degree.

The electronic device may obtain user habit data of each second electronic device in at least one second electronic device and a correlation degree of a corresponding search result to obtain at least one user habit data and a corresponding correlation degree, further, may determine a corresponding adjustment coefficient according to each user habit data in the at least one user habit data to obtain at least one adjustment coefficient, for example, may determine an activity degree of a user according to the user habit data, where the user habit data may be a duration of using a certain application in one day, for example, a number of times the user presses a fingerprint identification module in one day, etc., which is not limited, where a value range of the adjustment coefficient may be-1 to 1 or 0 to 1 or-0.15 to 0.15, etc., and specifically, the first electronic device may quantize the user habit data to obtain a quantized value, and determine an adjustment coefficient corresponding to the quantized value of the user habit data according to a mapping relationship between the preset quantized value and the adjustment coefficient. . Furthermore, the first electronic device may adjust the corresponding correlation according to at least one adjustment coefficient to obtain at least one reference correlation, which may be implemented specifically as follows:

Reference correlation j= (1+ adjustment coefficient j) correlation j

The correlation j is the correlation corresponding to the user habit data j, the adjustment coefficient j is the adjustment coefficient corresponding to the user habit data j, and the reference correlation j is the reference correlation corresponding to the user habit data j.

Furthermore, the first electronic device may determine the priority order of the search results fed back by the at least one second electronic device according to the at least one reference relevance, for example, the higher the reference relevance value is, the higher the priority is, and conversely, the lower the priority is.

Further optionally, the step 512 of determining a corresponding adjustment coefficient according to each user habit data in the at least one user habit data to obtain at least one adjustment coefficient may include the following steps:

5121. extracting features of the user habit data j to obtain a feature set, wherein the user habit data j is any user habit data in the at least one user habit data;

5122. inputting the feature set into a preset neural network model to obtain a target operation result;

5123. and determining the adjusting coefficient corresponding to the target operation result according to the mapping relation between the preset operation result and the adjusting coefficient.

In a specific implementation, the preset neural network model may be at least one of the following: a fully connected neural network model, a convolutional neural network model, a recurrent neural network model, a impulse neural network model, etc., are not limited herein. The preset neural network model may be used to enable determination of the degree of user dependence on the device. The first electronic device may train the neural network model in advance, input a feature set corresponding to different user habit data as a sample and a corresponding label as a sample label, where the label may be a specific value.

In a specific implementation, the first electronic device may perform feature extraction on user habit data j to obtain a feature set, where the user habit data j is any user habit data in at least one user habit data, input the feature set to a preset neural network model to obtain a target operation result, and further determine an adjustment coefficient corresponding to the target operation result according to a mapping relationship between the preset operation result and the adjustment coefficient, so that user habit can be simulated through the neural network model, and a degree of dependence of a user on the device is determined.

By way of example, as shown in fig. 3B, the information retrieval system may include a terminal device (first electronic device or second electronic device), a device management system, an information service system. The device management system and the information service system can be arranged on the cloud server, and unified information retrieval of multiple devices is realized through cooperation of the 3 roles.

In a specific implementation, there may be two subsystems of data providing and data retrieving for the terminal device, where the two subsystems are independent of each other, and reference may be made to the module deployment of the device A, B, C in fig. 3B. The device a has two subsystems of data providing and data retrieving, the device B has only a data retrieving subsystem, the device C has only a data providing subsystem, and the deployment mode can be according to the actual situation of the device, for example, the device a can enable devices with data storage capability and display input capability, such as a PC, a mobile phone, a Pad and the like, the device B can not belong to a user, devices with no storage capability on a third party device or on smart glasses and the like, and the device C can be devices with only storage capability, such as a router, a CPE and the like, and has data storage capability and no display capability. The scope of information retrieval is data on the device, and as illustrated in fig. 3C, the terminal device may obtain the retrieval result from the local through the indexing module, for example, may include, but not limited to: the general data such as the local picture, the local video, the local document, the system application, the third party application and the like can also be the application on the device, and the application can comprise the system application and the third party application. The information server system may then store a list of devices for each device, may also record user behavior via a user behavior log, and so on.

Further, the main flow of the distributed search is as follows:

1. and (3) registering the search service of each equipment end under the user name to a service management module of the cloud end in advance. This process does not occur at the time of search triggering, but rather at the time of terminal search system installation and uninstallation.

2. After the user logs in, a search request is initiated, the search is initiated through a UI module on the device, the UI module collects the search query request of the user, and the request is submitted to the distributed query module.

3. The distributed query module requests intermediate search results from a plurality of devices and a cloud, and specifically comprises the following steps:

A. the distributed query module queries all devices with search service under the user name through the user information to the cloud service management module.

B. And according to the equipment list obtained by the service management module, inquiring the related information of the equipment by the equipment management module, and returning the related information of the equipment to the distributed inquiry module.

C. The current device accesses a search interface on the user device, and if the current device can directly access the user device, the search result on the user device is directly obtained.

D. If the current device cannot directly access the user device, the current device reports the device information of the device to be connected to a network traversing module of the device management system, the network traversing module establishes a network tunnel on the cloud and the user device, provides a public network IP and a port to enable the device connected with the Internet to directly access, and returns the information to the current device searched by the user. The current device again accesses the search service on the user device with the obtained public network IP and port.

E. The current equipment sequentially accesses all the user equipment, and repeatedly executes the

steps

3 and 4 until all the user equipment is accessed;

F. and accessing the application search system of the cloud, and returning application data which is not browsed by the current user, such as hot application data.

Step E, F is to send the returned results to the search result merging module according to the actual time, and the search result merging module merges the intermediate search results on each device and submits the intermediate search results to the UI, and the user device inputs the search results to the search result merging module, where the results include a search ID indicating which search behavior belongs to, and a set of multiple results. Each result contains a unique result ID and fields to participate in the ordering, as well as fields to be presented. Because the entire search process is asynchronous, the next search result may arrive at the current device earlier than the current search result, and thus, in particular implementations, it is necessary to add a search ID to determine from which search the search result came from the user. Furthermore, the search results on all the devices can be comprehensively ordered according to a series of algorithms in combination with the behavior habit of the user, the use condition of the devices, the correlation degree of the content and the like, and are well aggregated according to the data types, for example, the picture information, the video information, the document information, the application information and the like can be classified. And the UI module receives data from the search result merging module and displays the data according to the data classification form, as shown in figure 3D, when 4 devices are searched, the search results of the 4 devices can be displayed.

Of course, the search results may also be categorized by data category, with each search result specifying from which device. For example, each search result is color-tagged by way of a preset color to determine from which device the search result came. This way, the user is not informed of the device from which the results originated, nor is it necessary to add a written description to each result to represent the information. There may be multiple results refreshing processes when the UI module performs a search operation, and each time the data of a device is ready, the search results merging module will merge the results again and submit the results to the UI module, and the UI module will redraw the search results presentation page, and the whole process is asynchronous and automatically triggered.

Further, the goal of searching intra-application data for intra-application data on a device is to allow a user to search not only for data on the device, but also for data of an application installed on the device, which may be data that the user browses over the application, or which may be data that the application is currently popular. Compared with a general search engine, the unified search device is more concerned about the search in the application with high user association degree.

In addition, the main flow of the data search in the application is as follows: and providing the SDK for an application developer on the terminal equipment, allowing the application developed by the developer to transmit the page browsed by the user to an index module on the terminal, and allowing the application developed by the developer to transmit part of the browsed page to an index module on the cloud end, wherein whether the page is transmitted to the cloud end is determined by the developer according to privacy considerations such as privacy and safety of page information. At the cloud, when the user browses the application, a part of browsing pages will enter the cloud index. Meanwhile, the cloud end can actively acquire information in the application by means of a web crawler, a cooperation interface and the like, and the data are imported into the cloud end index module. When a user searches, accessing each device and cloud of the user according to the main flow of distributed search, wherein a part of search results are closely related to the current user, and returning to related pages of related applications browsed by the user; the other part is the content with strong correlation, if not, even though the content has correlation with the user search keyword, the content will not appear in the search result, and the aim of this is to make the search in the application and the user have strong correlation, so as to distinguish the general search engine. The determination of strongly correlated content is determined in two ways. First, it is decided by the application developer, who can preset some pages as strongly related content of the application, and there is a limit in number. Second, due to the existence of the cloud, we can acquire browsing records of different users. In the same application, content that is accessed by more users at the device end will be considered strongly related content. Wherein the content of the second way will be more time-efficient and will be dynamically adapted to the behaviour of the user. For example, as shown in fig. 3C, a decision module in the information server system may be used to decide the relevance between the user and the content in the application, and the content that does not conform to the relevance of the user will be directly discarded.

In one possible example, before the retrieval request is obtained in step 301, the following steps may be further included:

c1, acquiring target identity information of a user;

c2, verifying the target identity information;

and C3, executing the step of acquiring the search request when the target identity information is verified.

In this embodiment of the present application, the target identity information may be at least one of the following: character strings, touch parameters, face images, fingerprint images, palm print images, vein images, brain waves, voiceprints, and the like, without limitation.

In a specific implementation, the electronic device may acquire the target identity information of the user, and may verify the target identity information, and execute step 301 when the target identity information is verified, or not execute the subsequent steps.

Further, when the target identity information is a target face image, the method may further include the following steps between step C2 and step C3:

c4, determining a target image quality evaluation value of the target face image;

c5, when the target image quality evaluation value is larger than a preset image quality evaluation value, matching the target face image with a preset face template to obtain a target matching value;

And C6, when the target matching value is larger than a preset matching threshold value, confirming that the target identity information is verified.

The preset face template can be pre-stored in the electronic equipment, and the preset image quality evaluation value and the preset matching threshold value can be set by a user or default by the system. In a specific implementation, the electronic device may perform image quality evaluation on the target face image by using at least one image quality evaluation index to obtain a target image quality evaluation value, where the image quality evaluation index may be at least one of the following: information entropy, average gradient, average gray, contrast, etc., are not limited herein. When the target image quality evaluation value is larger than the preset image quality evaluation value, matching the target face image with the preset face template can be performed to obtain a target matching value, otherwise, identity authentication can be required to be performed again.

Further, the step C4 of determining the target image quality evaluation value of the target face image may include the following steps:

c41, determining the distribution density of target feature points and the target signal-to-noise ratio of the target face image;

c42, determining a first image quality evaluation value corresponding to the target feature point distribution density according to a mapping relation between the preset feature point distribution density and the image quality evaluation value;

C43, determining a target image quality deviation value corresponding to the target signal-to-noise ratio according to a mapping relation between a preset signal-to-noise ratio and the image quality deviation value;

c44, acquiring first shooting parameters of the target face image;

c45, determining a target optimization coefficient corresponding to the first shooting parameter according to a mapping relation between a preset shooting parameter and the optimization coefficient;

and C46, adjusting the first image quality evaluation value according to the target optimization coefficient and the target image quality deviation value to obtain the target image quality evaluation value.

In a specific implementation, a memory in the electronic device may store a mapping relationship between a preset feature point distribution density and an image quality evaluation value, a mapping relationship between a preset signal-to-noise ratio and an image quality deviation value, and a mapping relationship between a preset shooting parameter and an optimization coefficient in advance, where a value range of the image quality evaluation value may be 0-1, or may be 0-100. The image quality deviation value may be a positive real number, for example, 0 to 1, or may be greater than 1. The value range of the optimization coefficient can be between-1 and 1, for example, the optimization coefficient can be between-0.1 and 0.1. In this embodiment of the present application, the shooting parameter may be at least one of the following: exposure time, photographing mode, sensitivity ISO, white balance parameter, focal length, focus, region of interest, and the like, are not limited herein.

In a specific implementation, the electronic device may determine a target feature point distribution density and a target signal-to-noise ratio of the target face image, and determine a first image quality evaluation value corresponding to the target feature point distribution density according to a mapping relationship between the preset feature point distribution density and the image quality evaluation value, where the feature point distribution density reflects image quality to a certain extent, and the feature point distribution density may be understood as a ratio between the total number of feature points of the target face image and the image area of the target face image. Furthermore, the electronic device may determine the target image quality deviation value corresponding to the target signal-to-noise ratio according to the mapping relationship between the preset signal-to-noise ratio and the image quality deviation value, and when generating the image, due to some noise generated by external (weather, light, angle, jitter, etc.) or internal (system, GPU) reasons, the noise may have some influence on the image quality, so that the image quality may be adjusted to some extent to ensure objective evaluation of the image quality.

Further, the electronic device may further obtain a first shooting parameter of the target face image, where the first shooting parameter may also be carried in the communication connection request, further determine, according to a mapping relationship between a preset shooting parameter and an optimization coefficient, a target optimization coefficient corresponding to the first shooting parameter, where the setting of the shooting parameter may also bring a certain influence to the image quality evaluation, so that it is required to determine an influence component of the shooting parameter on the image quality, and finally adjust the first image quality evaluation value according to the target optimization coefficient and the target image quality deviation value to obtain a target image quality evaluation value, where the target image quality evaluation value may be obtained according to the following formula:

In the case where the image quality evaluation value is a percentile, the specific calculation formula is as follows:

target image quality evaluation value= (first image quality evaluation value+target image quality deviation value) × (1+target optimization coefficient)

In the case where the image quality evaluation value is a percentage, a specific calculation formula is as follows:

target image quality evaluation value=first image quality evaluation value (1+target image quality deviation value) ×1+target optimization coefficient

Therefore, the image quality can be objectively evaluated by combining the influences of internal and external environment factors, shooting setting factors and the like, and the image quality evaluation accuracy is improved.

It can be seen that, in the embodiment of the present application, the information retrieval method is applied to a first electronic device, a retrieval request is obtained, the retrieval request is used for retrieving at least one second electronic device, the retrieval request is sent to a cloud server, a device list of the at least one second electronic device is obtained by the cloud server, relevant information of the at least one second electronic device is obtained according to the device list, relevant information of the at least one second electronic device fed back by the cloud server is received, each electronic device in the at least one second electronic device is accessed according to the relevant information of the at least one second electronic device, and a retrieval result fed back by the at least one second electronic device is displayed.

Fig. 4 is a schematic flow chart of an information retrieval method according to an embodiment of the present application, which is applied to a first electronic device; as shown in the figure, the information retrieval method includes:

401. input content is acquired.

402. When the input content is not text content, converting the input content into target text content.

403. And extracting keywords from the target text content to obtain a search term.

404. And generating a search request according to the search term, wherein the search request is used for searching at least one second electronic device.

405. And sending the search request to a cloud server, acquiring a device list of the at least one second electronic device through the cloud server, and acquiring related information of the at least one second electronic device according to the device list.

406. And receiving relevant information of the at least one second electronic device fed back by the cloud server.

407. Accessing each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device, and receiving a retrieval result for the retrieval word fed back by the at least one second electronic device.

408. And displaying the retrieval results fed back by the at least one second electronic device aiming at the retrieval words.

The specific description of the steps 401 to 408 may refer to the corresponding steps of the information retrieval method described in fig. 3A, and will not be repeated herein.

It can be seen that, in the information retrieval method described in the embodiment of the present application, a search term can be extracted through input content, a search request is generated based on the search term, and a response request is responded by acquiring relevant information of a device to be retrieved from a cloud server, and the device to be retrieved is retrieved based on the relevant information, so that searching for a plurality of devices can be achieved, and searching intelligence is improved.

Fig. 5A is a schematic flow chart of an information retrieval method provided in an embodiment of the present application, which is applied to a cloud server; as shown in the figure, the information retrieval method includes:

501. a search request sent by a first electronic device is received, the search request being for searching at least one second electronic device.

502. Acquiring a device list of the at least one second electronic device, and acquiring related information of the at least one second electronic device according to the device list.

503. And sending the related information of the at least one second electronic device to the first electronic device, so that the first electronic device accesses each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device, receives the retrieval result fed back by the at least one second electronic device, and displays the retrieval result fed back by the at least one second electronic device.

The specific description of the above steps 501 to 503 may refer to the corresponding steps of the information retrieval method described in fig. 3A, and will not be repeated herein.

Optionally, in the step 503, the first electronic device accesses each electronic device of the at least one second electronic device according to the related information of the at least one second electronic device, and may include the following steps:

31. receiving device information of the second electronic device i which is required to be connected and reported by the first electronic device when the related information of the at least one second electronic device confirms that the second electronic device i is not allowed to be directly accessed;

32. establishing a network tunnel between the first electronic equipment and the second electronic equipment i, and enabling the first electronic equipment to access the second electronic equipment i through the network tunnel; the second electronic device i is any one of the at least one second electronic device.

In a specific implementation, when the related information of at least one second electronic device confirms that the second electronic device i is not allowed to be directly accessed, the cloud server can receive device information of the second electronic device i, which is required to be connected, reported by the first electronic device, a network tunnel between the first electronic device and the second electronic device i is established by the cloud server, and access to the second electronic device i is achieved through the network tunnel. In a specific implementation, the cloud end can be changed to be used as a transfer station in the whole searching process, so that access to equipment which is not directly connected is realized. For example, as shown in fig. 5B, a user may submit a search request to a cloud end for a distributed query, where the distributed query module requests a device management module to return all device information of the user, and the distributed query module sends the search request to each terminal, and the cloud end information server system, and the search data merging module merges all the search information, merges and sorts the search information, and returns the merged search information to the UI module of the terminal.

In accordance with the above-mentioned embodiments, referring to fig. 6, fig. 6 is a schematic structural diagram of a first electronic device provided in an embodiment of the present application, and as shown in the fig. 6, the first electronic device includes a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and in the embodiment of the present application, the programs include instructions for executing the following steps:

Optionally, in terms of said accessing each of said at least one second electronic device in accordance with information related to said at least one second electronic device, the program comprises instructions for:

or alternatively, the process may be performed,

Optionally, in the aspect of presenting the search result fed back by the at least one second electronic device, the program includes instructions for executing the following steps:

Determining the priority order of the retrieval results fed back by the at least one second electronic device;

and displaying the retrieval result fed back by the at least one second electronic device according to the priority order.

Optionally, in determining the priority order of the search results fed back by the at least one second electronic device, the program includes instructions for:

acquiring user habit data and a corresponding correlation degree of a search result of each second electronic device in the at least one second electronic device to obtain at least one user habit data and a corresponding correlation degree;

determining a corresponding adjustment coefficient according to each user habit data in the at least one user habit data to obtain at least one adjustment coefficient;

adjusting the corresponding correlation according to the at least one adjusting coefficient to obtain at least one reference correlation;

and determining the priority order of the retrieval results fed back by the at least one second electronic device according to the at least one reference correlation degree.

Optionally, in said determining a respective adjustment factor in dependence of each of said at least one user habit data, obtaining at least one adjustment factor, the program comprises instructions for:

Extracting features of the user habit data j to obtain a feature set, wherein the user habit data j is any user habit data in the at least one user habit data;

inputting the feature set into a preset neural network model to obtain a target operation result;

and determining the adjusting coefficient corresponding to the target operation result according to the mapping relation between the preset operation result and the adjusting coefficient.

The foregoing description of the embodiments of the present application has been presented primarily in terms of a method-side implementation. It will be appreciated that the electronic device, in order to achieve the above-described functions, includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will readily appreciate that the elements and algorithm steps described in connection with the embodiments disclosed herein may be embodied as hardware or a combination of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The embodiment of the application may divide the functional units of the electronic device according to the above method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated in one processing unit. The integrated units may be implemented in hardware or in software functional units. It should be noted that, in the embodiment of the present application, the division of the units is schematic, which is merely a logic function division, and other division manners may be implemented in actual practice.

In accordance with the above embodiment, referring to fig. 7, fig. 7 is a schematic structural diagram of a cloud server provided in an embodiment of the present application, as shown in the fig. 7, the cloud server includes a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and in the embodiment of the present application, the programs include instructions for executing the following steps:

Optionally, in terms of the first electronic device accessing each of the at least one second electronic device according to the relevant information of the at least one second electronic device, the above-mentioned program comprises instructions for performing the following steps:

receiving device information of the second electronic device i which is required to be connected and reported by the first electronic device when the related information of the at least one second electronic device confirms that the second electronic device i is not allowed to be directly accessed;

establishing a network tunnel between the first electronic equipment and the second electronic equipment i, and enabling the first electronic equipment to access the second electronic equipment i through the network tunnel;

In accordance with the foregoing embodiments, referring to fig. 8, fig. 8 is a schematic structural diagram of an information retrieval system provided in an embodiment of the present application, as shown in the fig. 8, the information retrieval system includes a first electronic device, a cloud server, and at least one second electronic device, where the system is configured to perform the following functions:

the first electronic device obtains a search request, and the search request is used for searching at least one second electronic device.

And the first electronic equipment sends the retrieval request to a cloud server.

The cloud server acquires a device list of the at least one second electronic device, and acquires relevant information of the at least one second electronic device according to the device list.

The first electronic device receives relevant information of the at least one second electronic device fed back by the cloud server.

The first electronic device accesses each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device, and receives the retrieval result fed back by the at least one second electronic device.

The specific description of the above functions may refer to the corresponding steps of the information retrieval method described in fig. 3A, and will not be repeated herein.

In addition, the information retrieval system can also implement the covered embodiment of the information retrieval method described in fig. 3A, which is not described herein.

Fig. 9 is a block diagram showing the functional units of the information retrieval apparatus 900 according to the embodiment of the present application. The information retrieval apparatus 900 is applied to a first electronic device, the apparatus 900 comprising: applied to a first electronic device, the apparatus comprising: an acquisition unit 901, a transmission unit 902, a reception unit 903, a retrieval unit 904, and a presentation unit 905, wherein,

the acquiring unit 901 is configured to acquire a search request, where the search request is used to search at least one second electronic device;

the sending unit 902 is configured to send the search request to a cloud server, obtain, by using the cloud server, a device list of the at least one second electronic device, and obtain relevant information of the at least one second electronic device according to the device list;

The receiving unit 903 is configured to receive information about the at least one second electronic device fed back by the cloud server;

the retrieving unit 904 is configured to access each electronic device of the at least one second electronic device according to the related information of the at least one second electronic device, and receive a retrieval result fed back by the at least one second electronic device;

the display unit 905 is configured to display the search result fed back by the at least one second electronic device.

Optionally, in terms of accessing each of the at least one second electronic device according to the related information of the at least one second electronic device, the retrieving unit 904 is specifically configured to:

or alternatively, the process may be performed,

Optionally, in the aspect of displaying the search result fed back by the at least one second electronic device, the displaying unit 905 is specifically configured to:

Optionally, in the aspect of determining the priority order of the search results fed back by the at least one second electronic device, the displaying unit 905 is specifically configured to:

Optionally, in determining the corresponding adjustment coefficient according to each user habit data in the at least one user habit data, to obtain at least one adjustment coefficient, the display unit 905 is specifically configured to:

It should be noted that the tag device described in the embodiments of the present application is presented in the form of a functional unit. The term "unit" as used herein should be understood in the broadest possible sense, and the objects used to implement the functions described by the various "units" may be, for example, an integrated circuit ASIC, a single circuit, a processor (shared, dedicated, or group) and memory that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.

The acquiring unit 901 may be a touch display screen, a microphone, or one or more of a control circuit or a processor; the transmitting unit 902 and the receiving unit 903 may be communication circuits; the retrieving unit 904 and the displaying unit 905 may be one or more of a control circuit and a processor, and the displaying unit 905 may also be a touch display screen, so that the functions or steps of any of the methods can be implemented based on the above unit modules.

Fig. 10 is a block diagram showing functional units of the information retrieval apparatus 1000 according to the embodiment of the present application. The information retrieval apparatus 1000 is applied to a cloud server, the apparatus 1000 includes: the device is applied to a cloud server, and comprises: a receiving unit 1001, an acquiring unit 1002, and a transmitting unit 1003, wherein,

the receiving unit 1001 is configured to receive a search request sent by a first electronic device, where the search request is used to search at least one second electronic device;

the obtaining unit 1002 is configured to obtain a device list of the at least one second electronic device, and obtain related information of the at least one second electronic device according to the device list;

The sending unit 1003 is configured to send the related information of the at least one second electronic device to the first electronic device, so that the first electronic device accesses each electronic device of the at least one second electronic device according to the related information of the at least one second electronic device, receives a search result fed back by the at least one second electronic device, and displays the search result fed back by the at least one second electronic device.

Optionally, in the aspect that the first electronic device accesses each electronic device of the at least one second electronic device according to the related information of the at least one second electronic device, the apparatus is specifically configured to:

Wherein the receiving unit 1001, the transmitting unit 1003 may be a communication circuit; the acquisition unit 1002 may be one or more of a control circuit or a processor, based on which the functions or steps of any of the methods described above can be implemented.

The present embodiment also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the above computer program causes a computer to execute the embodiments as the present application for implementing any of the methods of the embodiments.

The present embodiment also provides a computer program product which, when run on a computer, causes the computer to perform the above-described relevant steps to implement any of the methods of the above-described embodiments.

In addition, embodiments of the present application also provide an apparatus, which may be specifically a chip, a component, or a module, and may include a processor and a memory connected to each other; the memory is configured to store computer-executable instructions that, when the device is operated, are executable by the processor to cause the chip to perform any one of the method embodiments described above.

The electronic device, the computer storage medium, the computer program product, or the chip provided in this embodiment are used to execute the corresponding methods provided above, so that the beneficial effects thereof can be referred to the beneficial effects in the corresponding methods provided above, and will not be described herein.

It will be appreciated by those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional modules is illustrated, and in practical application, the above-described functional allocation may be performed by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to perform all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of modules or units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and the parts shown as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions to cause a device (may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes and substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An information retrieval method, characterized by being applied to a first electronic device, the method comprising:

Displaying the retrieval result fed back by the at least one second electronic device;

the displaying the search result fed back by the at least one second electronic device includes:

displaying the retrieval result fed back by the at least one second electronic device according to the priority order;

wherein determining the priority order of the retrieval results fed back by the at least one second electronic device includes:

2. The method of claim 1, wherein accessing each of the at least one second electronic device based on information related to the at least one second electronic device comprises:

or alternatively, the process may be performed,

3. The method of claim 1, wherein determining the corresponding adjustment factor based on each of the at least one user habit data, to obtain the at least one adjustment factor, comprises:

4. An information retrieval method, characterized by being applied to a cloud server, the method comprising:

the related information of the at least one second electronic device is sent to the first electronic device, so that the first electronic device accesses each electronic device in the at least one second electronic device according to the related information of the at least one second electronic device, receives the retrieval results fed back by the at least one second electronic device, and displays the retrieval results fed back by the at least one second electronic device;

5. The method of claim 4, wherein the first electronic device accessing each of the at least one second electronic device based on information related to the at least one second electronic device, comprising:

6. An information retrieval apparatus, characterized by being applied to a first electronic device, the apparatus comprising: an acquisition unit, a transmission unit, a receiving unit, a retrieval unit and a display unit, wherein,

the display unit is used for displaying the search result fed back by the at least one second electronic device;

7. An information retrieval apparatus, characterized by being applied to a cloud server, the apparatus comprising: a receiving unit, an acquiring unit and a transmitting unit, wherein,

the sending unit is configured to send relevant information of the at least one second electronic device to the first electronic device, so that the first electronic device accesses each electronic device in the at least one second electronic device according to the relevant information of the at least one second electronic device, receives a search result fed back by the at least one second electronic device, and displays the search result fed back by the at least one second electronic device;

8. An information retrieval system, comprising a first electronic device, a cloud server, and at least one second electronic device, wherein,

the first electronic device sends the search request to a cloud server;

the first electronic equipment displays the retrieval result fed back by the at least one second electronic equipment;

9. An electronic device comprising a processor, a memory for storing one or more programs and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-3.

10. A cloud server comprising a processor, a memory for storing one or more programs and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of claim 4 or 5.

11. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-5.