36

This Ars Technica article discusses the design principles of the Star Trek LCARS touch-based user interface from The Next Generation as it was imagined in 1987 and how it relates to Apple's iPad.

Reading this article led me to wonder: what are some other examples of interesting, inspiring, forward-thinking user interfaces from sci-fi universes? Please add references or imagery where possible, and try to talk a bit about why it's interesting.

2
  • 1
    Added a bounty to this one. Would love to see more examples.
    – fluxd
    Nov 15, 2010 at 17:57
  • no kings no mods no masters
    – Shayne
    Jul 5, 2018 at 15:54

34 Answers 34

12

You guys might be interested in Access Main Computer File:

http://accessmaincomputerfile.net/

0
19

ironman 2 holographic interface

The holographic 3d gui in ironman 2 is awesome, see it in action on youtube

2
  • 4
    The translucent 2D displays are actually possible using OLED technology on a transparent substrate. Displays like those should hit the market within the next few years including displays that are also bendable/rollable/foldable. Sep 17, 2010 at 1:44
  • 1
    I think the better part of this interface is the way Tony Stark can have a conversation with "Jarvis." Most of the interesting interaction is Jarvis' seemingly clairvoyant understanding of what Tony needs to get done. Once interaction graduates from "Siri" to "Jarvis" the world will be transformed (IMHO).
    – mawcsco
    Jun 5, 2012 at 13:58
14

Some good examples here, but we can also look to SciFi, particularly movie and TV SciFi, for inspiration on what not to do. SciFi UIs are designed to tell a story to the audience, not make a good UI for the characters. Examples:

  • Dedicated consoles or rooms for the UI, for example the sanctum for accessing Mother in Alien –the UI for which was basically a VT100. Cool, but an unnecessary inconvenience given networking abilities. However, the point wasn’t that this was a technically superior future UI, but to suggested a secretive hierarchical society.

  • Transparent vertical screens or images, such as in Minority Report, but I seem to remember first seeing it in the original Battlestar Galactica series. These make it difficult to read the images due to interference from the background. However, it allows the audience to see the character’s faces as they study the images.

  • Voice UI, such as seen in Star Trek and various others. As pointed out in Ars Technica article linked by the OP, voice interaction is often much less convenient than “doing the action yourself” by direct manipulation. However, it allows the characters to conduct dialog with the technology, which engages the audience more than just a character quietly staring at a screen and clicking something occasionally.

  • Anthropomorphic UIs, such as Holly in Red Dwarf and various robots. In the real world this is typically a waste of resources that makes an awkward UI that can even be creepy. We’re better off with simple dumb check-in kiosks at the airport than robot ticket agents. However, anthropomorphism allows the technology itself to become a character, which can advance the story.

  • Hardware dependence, for example the “tape” tiles in Star Trek TOS, the encryption-cracking circuit board in Sneakers, or sub-mini laser disks in Star Cops. Recordings and devices are often easier to handle and more robust when composed of bits of information rather than physical material. However, actors need props to help express their characters and interact with others.

  • Binary inputs, such as push-buttons and touch interfaces. For analog inputs, you can’t beat knobs, leavers, and joysticks, yet these are relatively rarely seen on SciFi sets. Wouldn’t Sulu rather steer the Enterprise with a sidestick? However, knobs, leavers, and such are relatively expensive for set builders to make or buy, so they’re kept to a minimum.

  • Slow screen redraws, as seen in various TV and movies. Even simple short phrases like “Access Denied” are shown with each character appearing one at a time from left to right, as if the connection were about 48 BAUD (often with light beep-beep-beep sound effects for each character). Today’s computers can refresh an entire screen instantly, making users more productive. However, slower animation allows text or images to emerge dramatically.

One UI you rarely see in SciFi is thought-controlled UIs, even though it’s “obviously” the ultimate in intuitiveness and speed. That’s because thinking doesn’t give the audience much to look at. The movie Firefox featured a Soviet fighter with thought control, but when it came time for the protagonist to use it, he ended up speaking his thoughts slowly aloud –sort of defeating the entire advantage of a thought-controlled UI.

4
  • 1
    Great idea! You should turn this into a question, answer it yourself, and then allow others to contribute, IMO. Could potentially generate a lot of traffic.
    – Rahul
    Nov 11, 2010 at 12:25
  • I'd say the interface to mother in Alien was the server room, ie you go to the (secured) console instead of asking over a terminal. They had terminals for "userland" apps, like navigation after all.
    – gbjbaanb
    Dec 24, 2010 at 0:15
  • Also the 'anthropomorphic' UIs are the best for non-technical users (which definitely describes Lister), but this also applies to any interface that has a natural-language input. The pretty face of the UI is nice but not as accurate as a lower-level UI. (you could say the same about Windows however, or any higher-level UI)
    – gbjbaanb
    Dec 24, 2010 at 0:18
  • I completely disagree with your (and ARs) assessment of voice UI. I ask people to do things all the time. Why not ask a system to do things for me. The key to voice is asynchronous activities. If you could give a brief vocal command that initiates an activity that allows us to do other things, it would improve the experience.
    – mawcsco
    Jun 5, 2012 at 14:04
12

Terminator augmented reality vision - some iPhone apps try to do this

Also known as a HUD (Heads Up Display)

Terminator 2 HUD

10

The desk interface from the movie "The Island". Interesting blend somewhere between Microsofts Surface and more tactile products like Siftables.

alt text

9

Tron (1982) showed a device very similar to a multi-touch surface. The one used to communicate with the MCP.

Tron Surface

9

Interface from "Matrix Reload" in Zion Docking Seaquence

Matrix Reload Zion Computer Interface - Docking Sequence

source http://artect.net/?p=784
"Ghost in the shell Stand Alone Complex" first season, virtual chat (9 episode)
(source: jcubic.pl)
and when kids create firewalls in 3d in social welfare facility (11 episode) don't have image.

View of robots from animatrix
(source: jcubic.pl)

3d map from X-Men don't have image

Update There is nice looking multi touch interface in Microsoft Ads series "Future Vison":
http://www.youtube.com/results?search_query=ms+future+vision

7

Minority Report is usually one that people mention. Microsoft Kinect is definitely a step in that direction, at least in a hardware sense. However, I think we ultimately end up with a mind/machine interface.

For a different direction, take a look at the Aurora Concept Browser.

3
  • 1
    The mind/machine interface was discussed here: ui.stackexchange.com/questions/467/brain-computer-interface Aug 28, 2010 at 22:04
  • 1
    I think it was Jakob Nielsen who remarked how ridiculous this is. Users' arms will tire fast.
    – Jonta
    Apr 7, 2011 at 0:54
  • Minority Report used a multi-touch screen, the Kinect does not require touching any physical interface. The analogy between them is incorrect. Jun 6, 2012 at 8:03
7

The guy behind a bunch of Hollywood UI:

http://blog.coleran.com/category/portfolio/screendesign

3
  • It works fine for me on Safari. Try google for Mark Coleran, it's his blog.
    – nyg
    Aug 28, 2010 at 20:02
  • 1
    @nyg - doesn't mean that the site didn't do something bad to your computer. That's what Chrome is telling you when you use it. Google checks sites and if visiting pages on the site results in malware or other bad things happening to your computer, the site gets flagged. Here's the reason for it being considered unsafe: safebrowsing.clients.google.com/safebrowsing/… Aug 31, 2010 at 18:13
  • It's likely the site was, or still is, hacked and unwittingly hosting malware. Sep 1, 2010 at 16:13
5

Talking computers like HAL and KITT

5

And did you guys/gals forgot about the LCARS, the Star Trek GUI/OS used in the Next Generation TV series? :) http://en.wikipedia.org/wiki/LCARS

alt text

3
  • 3
    I actually mentioned that one in the question... ;)
    – Rahul
    Sep 3, 2010 at 14:52
  • 2
    Huh... I should really start reading top to bottom. My bad... Thanks for not being rude about it :) Sep 3, 2010 at 19:27
  • I've always thought LCARS was actually a really good design from a UIX perspective. Its well laid out, uses color freely to denote various things, and those curved menus group things really well. Once you had your head around it, it'd be a really intuitive system, somthing most sci-fi uis are most definately not. Plus, it looks cool as hell, which is amazing for an 80s design. Back in the 90s I implemented a few work systems based off it, and people loved it, until the bores in management told me to stop it and return to crappy windows greyworld
    – Shayne
    Jul 5, 2018 at 15:58
4

Avatar and lots of movies like it, had interesting UI inside robots and giant machines. 3D interfaces where people can move things by hand in an imaginary space, rotate earth and stars by some gestures. that's interesting.

4

Another famous FUI (Fantasy UI) designer: http://www.teknoel.com/

1
  • 1
    That might be the first flash-based navigation I like Aug 28, 2010 at 22:05
4

Anyone interested in the subject should definitely check out Nathan Shedroff´s notes from his presentation at dconstruct/ux week.

Make It So: What Interaction Designers can Learn from Science Fiction Interfaces (19MB PDF)

4

I was really blown away by the realistic UI of the Iron Man suit. It seemed like it was actually "designed" rather than just being part of the "effects." If that makes sense. The suit followed his eye movements and depending on what he looked at, the system provided information on that object. The UI even gets streamlined with the Mark 3 suit. Really geeked out on that part of the movie.

The mech suit in District 9 is another great example. Although it didn't feel as polished as the Iron Man UI, it did offer some interesting ideas. When it was under fire, for example, it pointed out (with colored "pings") what direction the shots came from. It also looked like it plugged in directly to his brain. There's a part where it sounds like he's muttering calculations. After an instant or two, he fires on his enemies with great precision.

Also in District 9, I really liked the navigation UI of the alien ship. http://www.youtube.com/watch?v=HicHPRZs6GI&list=PLCC0CF402CF60B949 I've always wondered how we would navigate effectively in 3 dimensions like space or underwater. This interface looks pretty advanced and looks like it was created specifically with that 3rd axis in mind.

Lastly, I need to mention Final Fantasy: spirits within. Some of the displays were a little funky looking, but some, like the wrist computer, were pretty sweet. Especially the virtual keyboards. Image ('cause I don't have enough rep.) http://dl.dropbox.com/u/1461399/final_fantasy_wrist1.jpg

3

More of a HUD but I really liked the graphics used in Stranger Than Fiction

alt text

http://wemadethis.typepad.com/we_made_this/2007/04/stranger_than_f.html

1
  • I really liked the look of this one, so I watched the movie. Pretty awesome! Thanks for posting these shots :)
    – TomvB
    Nov 15, 2010 at 19:52
3

The ultimate UI was the control interface to the ship Andromeda. that's the only kind of UI I want.

3

The Hitch Hikers Guide to the Galaxy - which predates the Kindle by about 35 years...

...he also had a device which looked rather like a largish electronic calculator. This had about a hundred tiny flat press buttons and a screen about four inches square on which any one of a million "pages" could be summoned at a moment's notice. It looked insanely complicated, and this was one of the reasons why the snug plastic cover it fitted into had the words Don't Panic printed on it in large friendly letters. The other reason was that this device was in fact that most remarkable of all books ever to come out of the great publishing corporations of Ursa Minor - The Hitch Hiker's Guide to the Galaxy. The reason why it was published in the form of a micro sub meson electronic component is that if it were printed in normal book form, an interstellar hitch hiker would require several inconveniently large buildings to carry it around in.

2

Some shots of an 24 episode. Never been a fan of what they did with the interfaces. In this case, a weird mail client/hybrid, with some encoding and personnel files going on. If you base it on the windows 7 GUI, please don't add weird looking stuff..

alt text alt text alt text

1
  • 2
    so they host at SERVER.com. Nov 30, 2010 at 6:23
2

The movie "Gamer" has a concept that is quite intriguing. As a player you control the actions of another human being. Without going into the plot of the movie, I'll attempt to explain the controls or UI.

Character in combat scene

The main character in the game(Gerard Butler) is being control in a real life "war game". The player is sitting in his room surrounded by tv screens 360 degrees around him and above him. His bodily actions control Gerard Butlers character within the game. I tried to find images online of the kid in his room standing up with his arms in a "gun shaped position" playing the game, but couldn't come up with any. A youtube search for "Gamer movie" may show something(I'm at work, no youtube allowed..shhh!) It is like Microsoft Kinect on super steroids!

There is another part of the plot where a man controls a woman in a Sims like surrounding, however it was in real life. The woman who was being controlled would actually "go to work" where she would then be connected to her controller. The controller could then tell her to walk up to people to talk, act crazy etc. Pretty much like Sims... In this case, the controller(man) would wear like goggles on his face, to see, but the control was through his thoughts and voice.

Picking your character in "Sims" style game

In both cases, the character that was being played was controlled by thought(?), speech and action. The UI was almost invisible at play time or when they started the game. But, in certain scenes, you would see the player setting up the game and they would use full body actions to slide things across the screen, etc., like Minority Report.

The concept of making the UI as transparent as possible is the goal we may be working towards.

1
  • The great thing about Kinect is that it's proving that a concept UI like Gamer doesn't work in real life: you can't control a character's movement with Kinect. It'll be interesting to see how Microsoft solves that problem (hybrid games where you stand in front of Kinect while holding an Xbox controller?)
    – Rahul
    Nov 17, 2010 at 8:58
2

Here's one from World Builder: the holographic equivalent of 3dsmax, with a great realtime renderer :-)

Look at the video to see how it works: http://vimeo.com/3365942

alt text http://sneakhype.com/wp-content/uploads/2009/03/world-builder.jpg

0
2

Here's another one from Tron.

1
  • jtnimoy & gmunk's process makes for a really interesting read, cheers for posting it.
    – corin
    Jun 6, 2012 at 6:12
1

The Minority Report interface actually exists in reality.

(Note: that link is to my own blog, but I'm not pointing there to raise my hit count. If someone can find the direct TED link, please post it)

Update: Changed the link. Original link was here.

2
  • TED videos are also on YouTube youtube.com/watch?v=b6YTQJVzwlI - I tend to watch them there because I prefer the player.
    – Wilka
    Aug 31, 2010 at 12:32
  • Ah, yes - that's the better place to watch it. I'll edit my answer.
    – whybird
    Sep 1, 2010 at 9:03
1

The operating system/GUI seen in swordfish was pretty cool

alt text

1
  • I've always loved that idealized view of linking software :) I added in your image and removed the comment about not being able to add it. Cheers!
    – e.James
    Nov 9, 2010 at 4:29
1

You may well be interested in this book that's due out soon and the accompanying 1 hour video on the subject by the authors.

1

The Table UI  from the latest Bond movie, Quantum of Solace, designed by MK12 and related UIs/devices, has been somewhat of an inspiration for me in terms of UI design. As tricky as transparent wall displays can be (have to get the lighting right for it to be properly visible), I like MK12's take on context diving.

A number of TV shows and movies have used variations of CDE, OpenLook and TWM as their UIs, especially when they want to look super-techie and show lots of command line stuff.

A couple of examples are Alias & Enemy of The State - he's using an Ultra 10 so CDE sorta makes sense in this context. The dollhouse from Dollhouse uses BeOS. The Bourne Ultimatum rather famously (well, in certain circles) used Bash terminals, which reminds me that Trinity uses a recognised SSH exploit in The Matrix Reloaded, and has to use a bash prompt to do it. What's always suprising and magical about these high-detail ultra-techie interfaces is the amazing context sensitivity of the underlying system - it knows exactly what ancillary windows and information to throw up on the screen, often from the most minimal of input. ;-)

D

1

I personally thought that some of the infographics in the city scenes aboard the Axiom in Wall-E were actually quite amazing. It was "for dummies" all the way, but I really liked it.

Clock

Sun control panel

More info : Wall-E interface design

1

Robert Wise's 1971 adaption of Michael Crichton's The Andromeda Strain has some of the earliest and most wonderful user interfaces ever created for film. Douglas Trumbull's effects work was amazing and ground breaking and at the time.

More importantly though, these interfaces were plot devices, providing engaging means of narration and exposition.These interfaces were not designed to exist in the film's universe alone. They are often given full or splitscreen presentation directly to the audience. These computer graphics are without question a character in the film, a character which expresses itself succinctly.

This seems at odds with the window dressing role that interfaces often play in films today.

The Andromeda Strain, 1971, Splitscreen diagram The Andromeda Strain, 1971, Wildfire diagram The Andromeda Strain, 1971, Computer typography The Andromeda Strain, 1971, Microscope

1

I think the most forward thinking UI is the natural speech recognition. I don't know who came up with the idea first of being able to simply talk to the computer, but it is certainly a key thing in the Star Trek series. It has inspired different companies in the early and late nineties to develop speech recognition software. Most luxury cars today allow you to operate the car's controls like satnav, climate control etc by such software. Later on companies have been trying to develop software that is able to recognize more natural speech rather than predefined commands. Right now we have Siri and comparable services. Am am sure these things still have a long way to go until they truly work like Start Trek has shown us. But when Star Trek has first shown it, we all went "That would be awesome, but totally impossible!".

Read for fun: Early Computers

0

Another one is the UI from the movie Night Watch. But I can't find any images :(

Not the answer you're looking for? Browse other questions tagged or ask your own question.