Patient quality of life data can be acquired in a variety of ways, including over the telephone and through computerized questionnaires. However, if the method of collection produces different results, medical decisions regarding appropriate and cost-effective care may be influenced by collection method. We conducted an experiment where subjects had two quality of life measures, the time trade-off and rating scale utilities, assessed both in telephone interivews and via computer touchscreens. The order of telephone and touchscreen was randomized. We found that rating scale utilities were similar whether obtained via the telephone or via touchscreen regardless of which was done first. However, patients who had their time trade-off utilities assessed over the telephone first did not provide as consistent responses as those elicited first via touchscreen (p = 0.01). Caution is suggested when considering eliciting time trade-off over the telephone with subjects who have not had time trade-off elicited previously.