REVIEW 2 cited by
Collaborative Filtering and the Missing at Random Assumption
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Collaborative Filtering and the Missing at Random Assumption
read the original abstract
Rating prediction is an important application, and a popular research topic in collaborative filtering. However, both the validity of learning algorithms, and the validity of standard testing procedures rest on the assumption that missing ratings are missing at random (MAR). In this paper we present the results of a user study in which we collect a random sample of ratings from current users of an online radio service. An analysis of the rating data collected in the study shows that the sample of random ratings has markedly different properties than ratings of user-selected songs. When asked to report on their own rating behaviour, a large number of users indicate they believe their opinion of a song does affect whether they choose to rate that song, a violation of the MAR condition. Finally, we present experimental results showing that incorporating an explicit model of the missing data mechanism can lead to significant improvements in prediction performance on the random sample of ratings.
Forward citations
Cited by 2 Pith papers
-
On the Convergent Validity of Offline Evaluation Designs for Recommender Systems
Sparse offline recommender rankings correlate only weakly—and sometimes negatively—with dense ground-truth rankings, and no evaluation design is uniformly best.
-
ConAlign: Conditional Alignment Framework for Balancing Biased and Unbiased Recommendation
A per-instance gated alignment between biased and unbiased ranking towers improved unbiased recommendation accuracy and, in live deployment at Kuaishou, slightly raised retention and interest diversity with negligible...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.