SIGIR 2013 will introduce a new review criterion, Reproducibility of Methods.
These are the exact questions that the reviewers will see on the new review form:
Reproducibility of Methods
Are the descriptions of the methods used detailed and accurate? Given the resources used in the paper, or (if they are unavailable) similar resources, could researchers carry out similar experiments to verify the results? What further description could the authors provide?
So when you write a paper for SIGIR 2013, make sure you explain what you did rigorously!
Tetsuya Sakai, SIGIR 2013 PC co-chair