IASS Webinar 21: Design-based analysis of experiments embedded in probability samples

Map Unavailable

Date(s) - 22/09/2022
2:00 pm - 3:30 pm

Category(ies) No Categories

IASS Webinar 21: Design-based analysis of experiments embedded in probability samples

22 September 2022 at 2pm – 3:30pm (CET)


All are invited to the webinar, organised by the International Association for Survey Statisticians.


Please register for the IASS Webinar HERE:



After registering, you will receive a confirmation email containing information about joining the webinar. There will be time for questions. The webinar will be recorded and made available on the IASS and ISI web site. See below for the abstract and biography of the speakers.


Webinar Abstract


The fields of randomized experiments and probability sampling are traditionally two separated domains of applied statistics. Both fields share one similarity, which makes them unique from other areas of statistics: design plays a crucial role in this type of empirical research.  While design of randomized experiments is traditionally focused on establishing the causality between differences in treatments and observed effects (internal validity), design of probability samples is focused on generalizing results observed in a small sample to an intended target population (external validity). Many experiments conducted with the purpose to improve survey methods are small scaled or conducted with specific groups. The value of empirical research into survey methods is strengthened as conclusions can be generalized to populations larger than the sample that is included in the experiment. This can be achieved by selecting experimental units randomly from a larger target population and naturally leads to randomized experiments embedded in probability samples. This results in experiments that potentially combine the strong internal validity from randomized experiments with the strong external validity of probability sampling. Generalizing conclusions observed in an experiment to a larger target population can be achieved with a design-based inference framework known from sampling theory. In this webinar a general design-based framework for the analysis of single factor and factorial randomized experimental designs embedded in general complex probability samples is presented. Methods are illustrated with real life applications conducted at Statistics Netherlands.




Jan van den Brakel is extraordinary professor of Survey Methodology at Department of Quantitative Economics, Maastricht University School of Business and Economics and works as senior statistician at the Department of Statistical Methods of Statistics Netherlands. His main interest areas are sampling theory, small area estimation, inference in mixed mode surveys, design and analysis of experiments and time series analysis. He is author of many papers, among which we can find New data sources and inference methods for official statistics, Estimation of domain discontinuities, Assessing discontinuities and rotation group bias in rotating panel designs an Estimating monthly labour force figures during the COVID-19 pandemic in the Netherlands.