Greg's bite: the history and future of computer/human interfaces

Greg's bite: the history and future of computer/human interfaces

by Greg Mills

Back in the beginning of computers putting information in was hard work as numerous switches had to be thrown a certain way to generate results. The punch cards had to be cut and processed.  Then keyboards were used (about this time IBM screwed up and helped Microsoft take off).

A Zerox research group conceived the Graphical User Interface (GUI) and someone showed it to a fresh face in the crowd who immediately saw the future Mac interface. Foolishly trusting Microsoft to launch needed software that would run on the new Mac computers and to not steal them blind, Steve Jobs showed Gates the graphical interface. At that point Gates was driven to create a graphical interface that worked as well as the new Mac Operating System.

Apple, in time, sued and later settled rather than waste money pursuing Gates and Company. The Apple/Microsoft relationship has had its ups and downs but, seemingly, Apple was long on innovation and Microsoft was long on marketing. For most of the last 25 years marketing won the money race but was always a few years behind the innovation that is Apple.

To some extent, speech control has co-existed for some time now with the mouse and more recently the touch pad. Interestingly, "Star Trek" used voice control before the PC made it work well in real life. Even now, background noise and changes in the voice can confuse computer voice control. Advances in dictation software have resulted in some voice control applications but it never really caught on for general use.  

Interface with the hands, the mouse, the touch pad and now touch screen have been the main way we tell our computer what to do. The touch screen on the iPhone and iPad are based upon Cocoa Touch. A layer of the iPhone OS that allows the computer to convert touches on the screen at a given point to mean something. One, two or more touch points moving from point to point are converted to meaningful information that can control the computer. The length of time the points are touched and the pattern of movement all can be used to mean something. The menu in addition to the touch pattern can do everything the mouse can do, or will do so soon.  

Let's look a ways down the pike. What happens after the touch OS has matured? There have already been successful experiments with both eye contact interfaces and reading brain waves.

Imagine a camera that faces forward that scans for eyes looking at the screen. The computer calculates several times per second what the eyes are focusing on. As the eye moves around the screen the computer could turn the page of a book or scroll down to keep the point of interest in the middle of the screen. That and some sort of clicking mechanism to create an event in time would allow the touches computer control without speech.

Finally, imagine the equivalent of a mouse on a chip implanted in your brain. You think and it happens on the screen or display device. The advent of 3D displays is closer than one might think, but that is fodder for another article. The old saying, "I think, therefore I am" may become "I think therefore I compute."

(Greg Mills is currently a Faux Artist in Kansas City. Formerly a new product R&D man for the paint sundry market, he holds 11 US patents. He's working on a solar energy startup using a patent pending process of turning waste dual pane glass into thermal solar panels used to heat water.  Married, with one daughter still at home, Greg writes for intellectual web sites and Mac related issues. See Greg's web sites at http://www.gregmills.info .  He can be emailed at gregmills.mac.)


Comments

fd

Replica Handbags with Best Quality and Lowest Price. Enjoy Cheap Fendi Designer replica handbags Outlet Sell. You can't miss it.

A key factor at play here

One of the important things about human computer interaction to keep in mind here is that even with the touch interface, we're still having to learn to work with computers the way it wants us to, not the other way around (yet). Our touch gestures must be unambiguous and accurate. There's still a problem area when palms are resting on the screen.

When it comes to handwriting and speech recognition, things get fuzzy. We get great results when, as you say, you're in a quiet room (Dragon Dictation for iPad is amazing), or you happen to write neatly, but humans vary so widely, and you could be in a noisy coffee shop or have a thick accent. And computers have trouble recognizing sloppy chicken scratchings.

To get to a point where the results would be reliable enough for, say, Apple to integrate it into their OS, we still have a long way to go for the evolution of computer intelligence.

Furthermore, we now have cameras that won't take a picture until you smile and know where the faces are, but a human hand is doing the "aiming" of the lens. This is a critical factor because a tablet, for example, can be at any angle and it's camera must move on a pivot to find and KEEP faces and eyeballs in view.

This is, in my opinion, a big reason why a camera was not included on the iPad and everyone misses this. Apple already knows what the problem is that makes it "unacceptable." You just watch... when people start using the front facing camera on the upcoming iPhone due next week, you'll start to hear people on the other end of the conversation saying "Would you stop shaking your phone! You're making me sick." and "I can't see you anymore." That unreliability, especially when someone is holding a heavy iPad, puts things way outside of "acceptability" for an Apple product. A laptop camera can more easily be aimed and stay in a solidly fixed position.

Putting a camera on a gimbal is another moving part that can break. We humans are so complicated! (Also, I think you meant to spell Xerox, not Zerox, and spellchecking is an automatic feature of most computers. My web browser just put a red underline under the misspelling. :-)

Mark Hernandez
Information Workshop

 
AAPL
$282.52
Apple Inc.
-1.23
MSFT
$24.38
Microsoft Corpora
-0.11
GOOG
$525.62
Google Inc.
-0.17
MacTech Search:
Community Search:

Introducing the App Hall of Fame!
App discoverability continues to be a real issue. With the fast churn of apps in the App Store, an app has only a few weeks of promotional life in it before it‚Äôs largely forgotten. There are a few things developers can do to fix that, but those... | Read more »
Gobliiins Are Coming
In the midst of the huge Q4 launch schedule, the cult classic, Gobliiins, as well as the rest of the trilogy, are being ported to the iPhone in all of their original glory. The Goblins trilogy was a quirky Atari/Amiga game series from the early 90‚Äôs... | Read more »
myPhoneDesktop – Chrome to iPhone Extens...
Anyone who has used myPhoneDesktop knows that it is a fantastic tool for streamlining your onscreen workflow. Instead of having to type line after line into your phone directly, you can use myPhoneDesktop to type from your computer directly into... | Read more »
Classes Review
Developer: Dustlab Price: $0.99 Version Reviewed: 2.4.7 iPhone Integration Rating: 3 out of 5 stars User Interface Rating: 4 out of 5 stars Re-use / Replay Value Rating: 3 out of 5 stars Overall Rating: 3.33 out of 5 stars | Read more »
AutoVerbal Talking Soundboard Pro helps...
Being able to speak and communicate with others is something that many of us take for granted. It‚Äôs not so easy for many folks though, in particular for individuals with autism spectrum disorders, as well as those who have suffered various brain... | Read more »
Pocketbooth Review
Developer: Project Box Price: $0.99 Version Reviewed: 1.0 iPhone Integration Rating: 4 out of 5 stars User Interface Rating: 4 out of 5 stars Re-use / Replay Value Rating: 4.5 out of 5 stars Overall Rating: 4.17 out of 5 stars | Read more »
Get Your Roast Right With ‘Time To Roast...
Roasting meat, in the cooking world, is about as simple as it gets. The greatest roast recipe I‚Äôve ever found is from Michael Ruhlman‚Äôs website, with the recipe titled, ‚ÄúThe World‚Äôs Most Difficult Roasted Chicken Recipe.‚Äù | Read more »

All contents are Copyright 1984-2010 by Xplain Corporation. All rights reserved. Theme designed by Icreon.
Greetings, and welcome to the new MacTech web site! Our home page is designed to be your Industry Dashboard -- so you can have a snapshot of all that's relevant in the industry in one easy location. Many readers tell us that because the information is updated so frequently, they are now checking the site multiple times a day. Here's a quick run down of the features on the new web site, which can be subtle. We truly hope you register so that we can keep you up to date about new features as they are implemented. And, please use the BETA button in the top right to provide us any feedback, suggestions or bugs. We love to hear from you.