Monday, March 21, 2011

Paper Reading #15: Gesture Search: A Tool for Fast Mobile Data Access

Comments
Paola Garza 
Stephen Morrow 

Reference Information
Title: Gesture Search: A Tool for Fast Mobile Data Access
Author: Yang Li
Where/When: UIST 2010


Summary
Gesture Search is a tool for mobile phones that allows users to quickly search for data items stored on the phone by use of touch gestures. The idea behind the tool is to make data access on mobile phones faster and easier, due to the power and storage potential of such devices. Current gesture systems require users to input specific gestures for specific data items, such as a shortcut for a desired application, and allow gestures to be input into only a small section of the already-limited screen. However, Gesture Search works by allowing the user to input a gesture using the entire touch screen.
The process of using gesture search by inputting two alphabetical gestures, with the end results displayed on the far right. Source: operationandroid.com
Gesture Search uses the input of character gestures to search through data elements on the phone, such as contacts and applications. Gestures include single letters or letter sequences to produce a list of search results. It actively learns from the user's search history to optimize future search results for those particular gestures. Because of this, gestures that are not entirely recognizable may at first produce many different results, but if the user selects the desired result from the results list, the next time that gesture is used it will show the selected result at the top of the list. In addition, this means that gestures do not need to be precise. Feedback is provided to the user by highlighting the letters in each item of the results list that are matched to the inputted gesture. Gestures are automatically distinguished from typical phone motions such as scrolling by analyzing trajectories and usage patterns.

A long-term user study was conducted by allowing employees at the company to try out the system for months at a time. User logs were maintained and a survey was issued at the end. Only those that had frequently used the application or had used it for long amounts of time were included in the results that were analyzed. It was determined that the learning of past search histories greatly improved the search quality and made the access of mobile data faster. However, the fact that Gesture Search had to be used through a home screen shortcut made it difficult. Gesture Search is now a publicly available, widely used application.


Discussion
I found this article very interesting, as it discussed the production of a product currently on the market for public use. I like that there was a need for such a product, and that Gesture Search was designed specifically to improve upon current systems and to fulfill the need to access data in an easier fashion on mobile phones. In addition, the long-term, large user study was very interesting, since it was not done in a lab. Data from actual, every-day usage was used, so I would expect the data to be very accurate as to how the system would be perceived and used in the real world. I did not find many faults with this paper, but I think the idea of applying real-world user studies should be used more often, where it can be used.

4 comments:

  1. I really like that they collected data outside of the laboratory environment and I agree with you that I wish I could see that done more often. Whenever I first saw this, I was reminded of this Japanese dictionary for the Nintendo DS someone showed me once. I wonder if they have applied this system to be used in other languages like Japanese or Chinese.

    ReplyDelete
  2. This sort of gesture search seems like it would have a wide range of applicability. This reminds me of the old Palm Pilot interface. There was a separate section to draw letters using the stylus. This sort of borrows from that and uses the whole screen instead. Awesome.

    ReplyDelete
  3. I also liked the idea that the study was not done in a lab, this way people get to genially use the product.

    ReplyDelete
  4. As you say, there was a need for such an application. I think that is one of the reasons that makes it really interesting to read about. Also, the idea of doing user studies outside of the labs should allow for better results, since users are testing the device in a more natural way.

    ReplyDelete