I'm thinking on how to solve for an application that uses real-time positioning to project images.

It uses a beacon (same as motion capture) that is hidden and sewed into a person clothes

When the beacon is detected, a projector will point an image to a default spot which is the supposed to be a midpoint between these two LEDs.

I need to design a visual representation of the screen but with a way to allow direct manipulation of an offset position, in this case, to drag it down from that middle point to the desired offset location. I do have another panel for precise movement (X Y Z coordinates) but I would like the user to do it with direct manipulation easily. Is the representation I created well for this?

Are there other examples/innovation in those types of graphical software manipulation?. I have been trying to read and find HCI journals to read about design patterns in design software but could not find many.

Ideally, the solution can be applied for mouse + keyboard or touchscreen inputs

1 Answer 1


At several points, people in the HCI research community have dreamed of being able to tell you the "right" way to do something like this, but it turns out it's really hard to give general guidance, when each use case is so diverse.

There are plenty of valid designs and interactions—your use case actually feels a little novel / interesting. If you're really concerned about getting it right, the HCI literature will tell you more about how to understand the way that your users think about the problem, how to go about implementing several designs, how to get a feel for which / how many different designs to test, and how to go about testing those designs. If you really went through some/all of this process, you could probably publish a really good CHI paper.

If you're just interested in a decent solution, feel free to trust your own instincts. There are maybe some relevant precedents (e.g. drawing programs often have something like an "anchor" for cloning / rotating around a specific point), but a lot of those assume desktop interfaces and the ability to do things like Control-click. I actually really like your diagram itself—what if you initially showed the white box, and only show the green one if the user clicks/taps or drags from the white one (with maybe a little x to get rid of the offset that they created)?

  • 1
    That's good advice. Do you recommend any directory of research papers and books for these methods? I don't have academic background in this area. I'm a self taught designer. I do use guerrilla user centered design and UX research, but it's always nice to know what literature is available for these types of problems. I already read some material from Jef Raskin, Bret Victor, Don Norman and Kruger. But I could not find a lot of specific material related to computer graphics HCI / UI Jul 16, 2018 at 18:20
  • 1
    "Ways of Knowing in HCI" is an excellent starter textbook. The high-impact papers in this area of computer science tend to be at conferences more than journals... for this kind of stuff CHI is probably the most relevant, but you'll probably see relevant things from UIST, VIS / EuroVis (disclaimer: I'm a visualization researcher, not pure HCI), UBICOMP, CSCW, DIS... I'm sure there are more. Jul 16, 2018 at 21:17

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.