Sixth Sense Technology Introduction

Sixth Sense Technology Introduction Abstract: ‘Sixth Sense is a wearable gesture interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. This technology will definitely give the user a new way of seeing the world with information at their fingertips it has been classified under the category ‘wearable computing’. The true power of Sixth Sense lies on its potential to connect the real world with the Internet, and overlaying the information on the world itself. The key here is that Sixth Sense recognizes the objects around you, displaying information automatically and letting you access it in any way you want, in the simplest way possible. This paper gives you just introduction about sixth sense. This paper makes you familiar with sixth sense technology which provides freedom of interacting with the digital world using hand gestures. The sixth sense prototype is comprised of pocket projector, a mirror, mobile components, color markers and a camera. The sixth sense technology is all about interacting to the digital world in most efficient and direct way. Sixth Sense devices are very much different from the Computers; this will be a new topic for the hackers and the other people also. Everyone can get general idea of sixth sense technology by look at this paper. Keywords: Sixth Sense, wearable computing, Augmented Reality, Gesture Recognition, Computer Vision __________________________________________________________*****_________________________________________________________ 1. INTRODUCTION We’ve evolved over millions of years to sense the world around us. When we encounter something, someone or some place, we use our five natural senses which include eye, ear, nose, tongue mind and body to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. Sixth Sense bridges this gap, bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. ‘Sixth Sense’ frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer. All of us are aware of the five basic senses – seeing, feeling, smelling, tasting and hearing. But there is also another sense called the sixth sense. It is basically a connection to something greater than what their physical senses are able to perceive. To a layman, it would be something supernatural. Some might just consider it to be a superstition or something psychological. But the invention of sixth sense technology has completely shocked the world. Although it is not widely known as of now but the time is not far when this technology will change our perception of the world. Fig. 1.1: Six Senses Sixth Sense is a wearable â€Å"gesture based† device that augments the physical world with digital information and lets people use natural hand gestures to interact with that information. Right now, we use our devices (computers, mobile phones, tablets, etc.) to go into the internet and get information that we want. With Sixth Sense we will use a device no bigger than current cell phones and probably eventually as small as a button on our shirts to bring the internet to us in order to interact with our world! Sixth Sense will allow us to interact with our world like never before. We can get information on anything we want from anywhere within a few moments! We will not only be able to interact with things on a whole new level but also with people. One great part of the device is its ability to scan objects or even people and project out information regarding what you are looking. 1.1 History and Evolution of Sixth Sense Technology Steve Mann is father of sixth sense who made a wearable computer in 1990. The Sixth Sense Technology was first implemented as the neck worn projector + camera system. He was a media lab student at that time. There after it was used and implemented by an Indian who is the man has become very famous in the recent Pranav Mistry. There will be a long future rather than the short period of history for the Sixth Sense technology. 1.2 Why choose Sixth Sense Technology This sixth sense technology provides us with the freedom of interacting with the digital world using hand gestures. This technology has a wide application in the field of artificial intelligence. This methodology can aid in synthesis of bots that will be able to interact with humans. This technology enables people to interact in the digital world as if they are interacting in the real world. The Sixth Sense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system [4]. 2. CONSTRUCTION AND WORKING The Sixth Sense prototype comprises a pocket projector a mirror and a camera contained in a pendant like, wearable device. Both the projector and the camera are connected to a mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks users hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers. The movements and arrangements of these fiducially are interpreted into gestures that act as interaction instructions for the projected application interfaces. Sixth Sense supports multi-touch and multi-user interaction. Fig. 2.1: Sixth Sense Technology Working 3. TECHNOLOGIES THAT ARE RELATED TO SIXTH SENSE DEVICES 3.1. Augmented Reality The augmented reality is a visualization technology that allows the user to experience the virtual experience added over real world in real time. Augmented reality adds graphics, sounds, hepatic feedback and smell to the natural world as it exists [3]. 3.2. Gesture Recognition It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. Gesture recognition technique basically special type of hand gloves which provide information about hand position orientation and flux of the fingers [3]. 3.3. Computer Vision Computer Vision is the technology in which machines are able to interpret necessary information from an image. This technology includes various fields like image processing, image analysis and machine vision. It includes certain aspect of artificial intelligence techniques like pattern recognition [3]. 3.4. Radio Frequency Identification Radio Frequency Identification systems transmit the identity of an object wirelessly, using radio magnetic waves. The main purpose of this technology is to enable the transfer of a data via a portable device. This technology is widely used in the fields like asset tracking, supply chain management, manufacturing, payment system etc [3]. 4. APPLICATIONS The Sixth Sense device has a huge number of applications. The following are few of the applications of Sixth Sense Technology:- 4.1. Viewing Map: With the help of a map application the user can call upon any map of his/her choice and navigate through them by projecting the map on to any surface. By using the thumb and index fingers movements the user can zoom in, zoom out or pan the selected map[2]. Fig -4.1: Viewing Map 4.2. Taking Pictures: Another application of Sixth Sense devices is the implementation of a gestural camera. This camera takes the photo of the location user is looking at by detecting the framing gesture. After taking the desired number of photos we can project them onto any surfaces and then use gestures to sort through those photos and organize and resize them[2]. Fig 4.2: Taking Pictures 4.3. Drawing Application: The drawing application allows the user you to draw on any surface by tracking the fingertip movements of the user’s index finger. The pictures that are drawn by the user can be stored and replaced on any other surface. The user can also shuffle through various pictures and drawing by using the hand gesture movements[2]. Fig -4.3: Drawing Application 4.4. Making Calls: We can make calls with the help of Sixth Sense device. The Sixth Sense device is used to protect the keyboard into your palm and using that virtual keypad we can make calls to anyone[2]. Fig -4.4. Making Calls 4.5. Interacting with Physical Objects: The Sixth Sense system also helps to interact with physical objects we use in a better way. It augments physical objects by projecting more information about these objects projected on them. For example, a gesture of drawing a circle on the user’s wrist projects a watch on the user’s hand. Similarly a newspaper can show live video news or dynamic information can be provided on a regular piece of paper[2]. Fig -4.5: Watching News 4.6. Flight Updates: The system will recognize your boarding pass and let you know whether your flight is on time and if the gate has changed[2]. Fig 4.6: Flight Updates 4.7. Other Applications: Sixth Sense also lets the user draw icons or symbols in the air using the movement of the index finger and recognizes those symbols as interaction instructions. For example, drawing a magnifying glass symbol takes the user to the map application or drawing a à ¢Ã¢â€š ¬Ã¢â‚¬ ¢@à ¢Ã¢â€š ¬- symbol lets the user check his mail[2]. 5. KEY FEATURES OF SIXTHSENSE Sixth Sense is a user friendly interface which integrates digital information into the physical world and its objects, making the entire world your computer. Sixth Sense does not change human habits but causes computer and other machines to adapt to human needs. It uses hand gestures to interact with digital information, supports multi-touch and multi-user interaction. Data access directly from machine in real time. It is an open source and cost effective and we can mind map the idea anywhere. It is gesture-controlled wearable computing device that feeds our relevant information and turns any surface into an interactive display. It is portable and easy to carry as we can wear it in our neck. The device could be used by anyone without even a basic knowledge of a keyboard or mouse. There is no need to carry a camera anymore. If we are going for a holiday, then from now on wards it will be easy to capture photos by using mere fingers CONCLUSION As this technology will emerge may be new devices and hence forth new markets will evolve. This technology enables one to account, compute and browse data on any piece of paper we can find around. Sixth Sense devices are very much different from the computers; this will be a new topic for the hackers and the other people also. First thing is to provide the security for the Sixth Sense applications and devices. Lot of good technologies came and died due to the security threats. There are some weaknesses that can reduce the accuracy of the data. Some of them were the on palm phone keypad. It allows the user to dial a number of the phone using the keypad available on the palm. There will be a significant market competitor to the Sixth Sense technology since it still required some hardware involvement with the user. REFRENCES http://www.pranavmistry.com/projects/sixthsense/ http://dspace.cusat.ac.in/jspui/bitstream/123456789/2207/1/SI XTH%20SENSE%20TECHNOLOGY.pdf http://en.wikipedia.org/wiki/SixthSense http://www.engineersgarage.com/articles/sixth-sense-technology http:/www.ted.com/talkspranav_mistry_the_thrilling_potential_of_sixthsense_technology.html