KR100806370B1 - Personal Computer System Suitable To Integration and Representation Five Senses - Google Patents

Abstract

The present invention is equipped with an evolving hardware platform and software platform for the next generation personal computer, and an input / output device for a user interface, in order to achieve miniaturization and light weight suitable for a wearable form, and to achieve a loss of essential performance. Essential functions were implemented on the wearable computer, and additional functions and supplements of instincts were implemented on the smart gate, which is a belt type wearing form.

Five senses, computer, watch computer, belt gateway

Description

Personal Computer System Suitable To Integration and Representation Five Senses             

1 is a functional block diagram of a next-generation personal computer capable of fusing and reproducing five senses information according to the present invention.

2 is a diagram showing an example of a central processing unit that can be employed in the next generation personal computer that can fuse and reproduce the five senses information according to the present invention.

3 is a flowchart of visual information recognition in a next-generation personal computer capable of fusing and reproducing five senses information according to the present invention.

4 is a flow diagram of auditory information recognition in a next-generation personal computer capable of fusing and reproducing the five senses information according to the present invention.

5 is a flow chart of recognition of rear / taste information in a next-generation personal computer capable of fusing and reproducing five senses information according to the present invention.

6 is a flow chart of tactile information recognition in a next generation personal computer capable of fusing and reproducing the five senses information according to the present invention.

7 is a configuration diagram of a distributed environment recognition system using a next-generation personal computer capable of fusing and reproducing five senses information according to the present invention.

8 is an overall configuration diagram including a smart gate for the practical use of the next generation personal computer fusion and reproduction of the five senses information according to the present invention.

<Explanation of symbols for the main parts of the drawings>

100: central processing unit 110: internal connection

120: external connection 130: expansion connection

140: memory interface 150: multimedia accelerator

160: system control unit 170: standard system input and output unit

180: user interface 190: multimedia interface

710: next generation personal computer 720: distributed recognition server

730: after / beauty / touch / sight / hearing device

The present invention relates to a wearable next-generation personal computer, and more particularly, to a next-generation personal computer system capable of expressing and recognizing five senses information and reconciling and reproducing wearable five senses information.

Recently, digital devices have been pursuing miniaturization and lightening of each component with the goal of wearable and portable form in order to pursue the convenience of the user, and various models have been developed. There is no system that adopts a platform structure that can express perceptions and feelings.

In addition, in the case of a portable computer that is developed as a wearable type, it is a situation where omission of essential functions and loss of performance are required for miniaturization and light weight.

Accordingly, there is a demand for development of a next-generation personal computer system that adopts a platform structure capable of recognizing and expressing the five senses information as a wearable form without exhibiting essential functions.

Accordingly, the present invention has been developed to meet the above-described demands of the prior art, and has an object of providing a next-generation personal computer system capable of recognizing and expressing the five senses information and wearing and reproducing the five senses information. .

Wearable personal computer according to the present invention for achieving the object, in the wearable personal computer having a central processing unit, a memory, an interface unit, a Bluetooth module, providing a bus for connection between the respective internal components Internal connections, external connections to provide connectivity for external devices, expansion connections to expand the functionality of the system, multimedia accelerators to facilitate multimedia functions on the system, system clocking, debugging and booting, etc. At least one selected from the system control unit for controlling the system, the standard system input and output unit for managing the standard input and output of the system, the user interface unit for controlling the input and output function of the user command, the multimedia interface unit for providing an interface with the camera and the interface unit Vision / blue connected via / Visual / auditory / taste / olfactory / tactile recognition device for recognizing or conveying the taste / smell / sense / sense to the user, and through the visual / auditory / taste / smell / tactile recognition device Characterized in that the sense of touch, or to perform the processing necessary for delivery to the user characterized in that the distributed processing using a server that can communicate through the Bluetooth module.

delete

Here, as an algorithm for recognizing the collected image information from the visual apparatus, after extracting the outline of the necessary portion for recognition, only the extracted data of the image information is transmitted to the server to perform distributed recognition.

In addition, when performing the recognition function of the after / taste information, can be encoded by the predetermined after / taste element code, it is possible to add or delete the after / taste element code according to the user's purpose, the addition of the after / taste element code Alternatively, the addition / deletion and rearrangement of the after / taste sensor for efficient decomposition of odor information according to the deletion may be varied, and the type and number of the after / taste elements may be arbitrarily set through software setting.

In addition, the post-taste coded element code may be represented by a type and a combination of appropriate elements through the computer presenter.                         

In addition, a signal of a user's finger shape, hand gesture, etc. input to the haptic device is converted into a predefined command set on the computer, and the computer can express everything from simple manipulation to complex text input.

In addition, encoding is performed according to a user's purpose of the information input to the haptic device, and the encoded information can be reproduced by using the tactile expression device.

Preferably, the wearable personal computer is a wrist watch type computer, and the server is a belt wearable smart gate.

delete

Hereinafter, with reference to the accompanying drawings will be described in detail with respect to the next generation personal computer system fusion and reproduction of the five senses information according to the present invention.

1 is a functional block diagram of a next generation personal computer (Wearable Personal Station (hereinafter abbreviated as " WPS ")) capable of fusion and reproducing of the five senses information according to the present invention.

In the figure, the central processing unit 100 is responsible for managing the entire system, such as operation and control of the next-generation personal computer (WPS) proposed in the present invention. According to an embodiment of the present invention, a Motorola i.MX1 or i.MX21 chip (see FIG. 2) using an ARM 9 series core processor is used as a central processing unit.

In addition, the internal connection unit 110 is responsible for providing a bus for connection of audio mux, I ² C, SSI, CSPI, and the like. In addition, the external connection unit 120 is responsible for providing a connection to the UART, USB / Host / OTG, IrDA and the like for connecting to the external devices.

In addition, the expansion connection unit 130 is responsible for providing a function such as MMC / SD, PCMCIA / CF to expand the function of the WPS. In addition, the memory interface 150 is responsible for functions such as memory allocation, control, and storage area, which are used for program operation and control on the WPS.

In addition, the multimedia accelerator 150 provides a video processing accelerator, a preprocessor, a post processor, and the like to facilitate providing multimedia functions on the WPS. In addition, the system controller 160 manages the clock, debugging, booting, and the like of the system.

In addition, the standard system input / output unit 170 is responsible for system standard input / output such as GPIO, RTC, and the like. In addition, the user interface 180 manages an input / output function of a user command by providing a display means such as an LCD and an input means such as a keypad.

In addition, the multimedia interface 190 serves as an input / output function of an image by providing an interface between a WPS and a camera proposed in the present invention.

In addition, although not shown in FIG. 1, interlocking of the tactile device for input / output of the user by using the internal connector 110 and the external connector 120 on the WPS, and interworking of the rear / taste recognition / expression apparatus for the expression and recognition The connection of the head mounted display (HMD) and the visual recognition device through the multimedia interface 190 are also possible.

When the HMD is connected to the user interface 180, for example, the WPS interface shown in FIG. 1 may be used, or it may be via an interface via the smart gate shown in FIG. When using the interface via the smart gate as described above, the image information transmission between the WPS and the smart gate uses Bluetooth, and the interface between the smart gate and the HMD is connected using USB, IEEE1394 and wireless LAN, Bluetooth, etc. This is possible.

Next, the flow of visual information recognition in the WPS according to the preferred embodiment of the present invention will be described in detail with reference to FIG. 3.

First, image information is acquired by, for example, a CMOS image sensor (camera) connected through the multimedia interface unit 190 (step S11), and the obtained image information is input to FIG. 1 for real-time image recognition. The multimedia accelerator 150 is shown (step S12). In the case of a general video signal, the amount of data and the computational power for processing the data are high, so the visual recognition function in the WPS of the present invention utilizes a dispersion function. In addition, in order to perform distributed recognition, data transmission to a distributed recognition server (refer to 720 of FIG. 7) installed at a remote location is essential, and in case of image information, a large amount of data is required, and a large amount of time is required for data transmission. do. Therefore, in order to minimize the data transmission time, the present invention uses an algorithm for transmitting only the extracted data after extracting only the data necessary for recognition.

The multimedia accelerator 150 extracts only a portion (that is, a contour portion necessary for recognition) from the transmitted input information (that is, a contour portion necessary for recognition) (step S13), and then extracts the image information extracted by the recognition server for recognition from the external connection unit 120. In step S14, the distributed recognition server (see 720 of FIG. 7) performs recognition using only some information of the received original image (step S15). Thereafter, the distributed recognition server transmits the recognition result to the external connection unit 120 of the WPS (step S16).

On the other hand, distributed recognition of the new concept proposed in the present invention can also be implemented using a smart gate of the belt wearing form shown in FIG. In general distributed recognition, it is customary to take the performance degradation of the client in order to reduce the size and weight of the client side, and to perform a calculation using the communication with the server by setting up a separate server. have. In the case of the server for distributed recognition proposed in the present invention, not only the client end but also the server may be implemented in a worn form to prevent the problem of distributed recognition / reproduction according to the communication problem between the server and the client.

Next, the flow of auditory information recognition in the WPS according to a preferred embodiment of the present invention will be described in detail with reference to FIG. 4.

Auditory information (voice information) is collected through a microphone connected to the user interface unit 180 (step S21), and the collected voice information is transmitted to the multimedia accelerator 150 through the user interface unit 180 (step S22). ).

The next generation portable computer, WPS, performs a voice information recognition function and provides a user interface. The recognition function of the voice information proposed in the present invention performs recognition in a distributed environment in order to perform a real time recognition function, and the multimedia accelerator 150 requires voice information (that is, energy and average of input voice information) for recognition. After extracting only the voice section in consideration of noise (step S23), the extracted voice information is transmitted to the distributed recognition server (720 of FIG. 7) for recognition through the external connection unit 120 (step S24). The distributed recognition server (see 720 of FIG. 7) performs recognition using only some information of the received original voice (step S25). Thereafter, the distributed recognition server transmits the recognition result to the external connection unit 120 of the WPS (step S26).

Next, with reference to Figure 5 will be described in detail with respect to the after / taste information recognition flow in the WPS according to an embodiment of the present invention.

The rear / taste sensor is connected through the external connection unit 120 shown in FIG. 1, and the rear / taste sensor performs a rear / taste recognition function according to the control of the proposed WPS (step S31). The user requests the post / taste function using the microphone connected through the user interface unit 180, and the WPS operates according to the result of the auditory recognition function using the distributed function.

The post / taste recognition function proposed in the present embodiment may classify the input odor signal into a odor element similar to a basic element form, which is predefined, and encode the odor element. Type and number can be added or deleted according to user purpose. In addition, it is possible to select the type and number of odors to be recognized through the replacement of the after / taste sensor and the S / W setting according to the user needs, so as to facilitate the extraction of the odor element input to the after / taste sensor. In addition, the kinds of smells and tastes encoded by the after / taste elements can be expressed by the after / the taste expressor by the kind of the odor elements and the appropriate concentration combination of each element (step S32).

The central processing unit 100 of the WPS collects the after / taste information through the after / taste sensor connected through the external connection unit 120 (step S33), perform the recognition in a distributed environment for the purpose of performing a real-time recognition function In order to transmit the taste information to the distributed recognition server (720 of Fig. 7) through the external connection unit 120 (step S34), the distributed recognition server (see 720 of Fig. 7) is transferred to After receiving / recognition using the taste information (step S35). Thereafter, the distributed recognition server transmits the recognition result to the external connection unit 120 of the WPS, so that the WPS central processing unit 100 receives the recognition result (step S36).

Next, the tactile information recognition flow in the WPS according to the preferred embodiment of the present invention will be described in detail with reference to FIG. 6.

The external connection part 120 shown in FIG. 1 enables interworking with a haptic device, such as a glove device, which performs a tactile recognition function under the control of the proposed WPS. The user can perform a user input function according to his or her intention by naturally moving the worn tactile device (bending a finger, moving a hand, etc.) (step S42). In addition, the input user's hand gestures perform a function of inputting a character such as a keyboard of a computer according to a predetermined encoding method from a simple operation of a portable computer through a series of encoding processes. Recognition function of the tactile information is performed by the central processing unit 100 of the proposed WPS (step S43). In addition, the user's input signal has a tactile basic property such as intensity, direction, and texture according to the user's intention by using a function of an external haptic device such as an armored device, and by using the tactile basic property, Perform encoding according to The coded tactile information is capable of expressing tactile basic properties such as texture using a tactile expression device.

In this way, the recognition result of the tactile sense recognized by the central processing unit 100 is transmitted to the system control unit 160 (step S44), and the system control unit 160 performs the control of the device according to the tactile recognition result ( Step S45).

In order to construct a distributed system recognition system, the preferred embodiment of the present invention implements a wireless communication system using Bluetooth as shown in FIG. 7. The Bluetooth RF module interworked through the external connection unit 120 or the expansion connection unit 130 is a server for the distributed environment according to the instructions of the central processing unit 100 and the system control unit 160 of the proposed next-generation portable computer WPS ( 720) and a communication function.

On the other hand, the central processing unit 100 shown in FIG. 1 is capable of directly interworking with the internal and external devices shown in FIG. 2, and each of the devices is an external device (representation and recognition device of five sense information) as needed. Can be linked with

In addition, the detailed specifications of the software and hardware of the WPS proposed in the present invention are as follows.

In addition, this invention is not limited to the above-mentioned specific Example, It can variously deform and modify in the range which does not deviate from the summary of this invention, and can be implemented.

According to the present invention, the sensory expression and recognition of the five senses information can be realized through the WPS, and various types of user interfaces for user convenience can be provided.

Claims (19)

In the wearable personal computer having a central processing unit, a memory, an interface unit, and a Bluetooth module, Internal connections that provide a bus for connection between each internal component, An external connection providing a connection for connection with external devices, Expansion connections for extending the functionality of the system, Multimedia accelerator unit for smoothly performing multimedia functions on the system, System controls that control the clocking, debugging, and booting of the system, Standard system input / output unit that manages the standard input and output of the system, A user interface that manages the input / output function of a user command, Multimedia interface unit for providing an interface with the camera and It includes a visual / auditory / taste / olfactory / tactile recognition device for recognizing or transmitting the visual / auditory / taste / olfactory / tactile sense connected to at least one selected from the interface unit, Recognize the visual / audio / taste / olfactory / tactile senses through the visual / audio / taste / olfactory / tactile recognition device or perform a process necessary for transmitting to the user by using a server that can be communicatively connected through the Bluetooth module. Wearable personal computer, characterized in that the processing. delete delete The method of claim 1, Wearable individual characterized in that the algorithm for recognizing the collected image information from the visual device, after extracting the contour of the necessary portion for recognition, and transmitting only the data of the extracted image information to the server to perform distributed recognition computer. The method of claim 1, When performing the recognition function of the after / taste information, it is possible to encode the predetermined after / taste element code, the addition or deletion of the after / taste element code according to the user's purpose, the addition or deletion of the after / taste element code Wearable personal computer, characterized in that the addition / deletion of the after / taste sensor for the efficient decomposition of odor information according to the, and the arrangement can be changed, and the type and number of the after / taste elements can be arbitrarily set through the setting of the software . The method of claim 5, The wearable personal computer of the post-taste coded element code may be represented by a type and a combination of appropriate elements through a presenter on the computer. The method of claim 1, The wearable individual, which converts a signal of a user's finger shape, hand gesture, etc. inputted into the haptic device into a predefined command set on the computer, and can express a simple character input to a complex text input. computer. The method of claim 1, Wearing personal computer characterized in that for performing the encoding according to the user purpose of the information input to the haptic device, the encoded information can be reproduced by using the tactile expression device. The method of claim 1, The wearable personal computer is a wrist watch type computer, and the server for distributed recognition and expression is a wearable personal computer, which is capable of communicating with the wrist watch type computer and carrying a belt through a smart gate. . delete delete delete delete delete delete delete delete delete delete

Images