Current models for individual-level paired comparison data are based on the three assumptions that (1) pairwise judgments are independent, (2) the utility of an item remains invariant across trials, and (3) pair-specific variability can account for intransitive choice behaviour. All three assumptions seem strong and likely to be violated in empirical applications. This paper introduces a new framework for the analysis of paired comparison data which relaxes these three assumptions and considers the utilities associated with the same item across trials to be neither independent nor identical, but related. The proposed approach provides new insights about the reliability and consistency of paired comparison judgments and can account for systematic violations of transitivity. An application, based on a replication of Tversky's [(1969). Intransitivity of preference. Psychological Review, 76, 31–48] gamble study, illustrates the usefulness of the new approach in modelling both transitive and intransitive preferences.