An unintended bias in the Citizens’ Assembly

That’s Maths: Why do 10 counties have no members among the 99 people who were selected?

The country was divided into 22 areas, each with a known number of voters

The country was divided into 22 areas, each with a known number of voters

 

Recently, the Government established the Citizens’ Assembly, a body of 99 citizens that will consider a number of constitutional issues. The assembly meets this Saturday to continue its deliberations on the Eighth Amendment to the Constitution, which concerns the ban on abortion. It will report to the Oireachtas on this issue in June.

The assembly comprises the chairperson and 99 registered voters. Red C Research and Marketing was selected by tender to provide the representative body of 99 members. The goal was that the assembly would be broadly representative of the State’s population. More specifically, the 99 members were chosen to be representative of the Irish electorate in terms of gender, age and regional spread.

A list is available on the official website (citizens assembly.ie), giving the names and counties of the members. A reader of That’s Maths has observed that a significant number of counties are absent from this list. Of the 26 counties of the Republic, there are assembly members from just 16, with none from the remaining 10 counties.

As this seemed surprising, I asked my colleagues in UCD’s school of mathematics and statistics, Nial Friel and Alan Benson, if they could estimate the probability of the observed assembly membership arising, assuming the selection process was truly random; that is, if the probability of choosing someone from each county were proportional to the number of voters in that county.

Sixteen on, six off

Since the boundaries of the parliamentary constituencies do not all coincide with county boundaries, the country was divided into 22 areas, each with a known number of voters. These closely correspond to counties or pairs of counties: the latter Carlow-Kilkenny, Cavan-Monaghan, Longford- Westmeath and Sligo-Leitrim. Among the selected assembly members, 16 areas are represented and six are not. The six “missing areas” include 10 counties, as shown on the map.

The outcome of simple random sampling is modelled by a probability distribution called the multivariate hypergeometric distribution. By repeatedly selecting 99 voters randomly from the electorate, an ensemble of “virtual assemblies” is generated. This is called Monte-Carlo simulation, reflecting the crucial role of chance in the procedure. The ensemble of assemblies is then analysed to estimate the probability of the spread of assembly members actually observed.

To give everyone an equal chance, 99 voters were sampled randomly from the 3.3 million electors. Then each was mapped to an area and the number of areas was recorded. The UCD statisticians generated one million sets of 99 members. From these, the probability distribution of the number of “missing areas” was calculated.

Only 1 per cent of the ensemble members had five or more of the 22 areas unrepresented. Only 155 of these had six or more areas unrepresented. This gives a tiny probability – about one in 6,500 – of the observed pattern occurring in a truly random process.

Constraints

It must be stressed that the method described here is not that used by Red C Research, which is explained in part in a document on the assembly website. Red C incorporated constraints to ensure gender balance and spread among socio- economic groups. They appear to have employed a hybrid method with a random component but including systematic aspects in the interests of balance.

Notwithstanding this, the absence of representatives from so many counties does point towards an unintended bias.

Peter Lynch is emeritus professor at the school of mathematics and statistics, University College Dublin. He blogs at thatsmaths.com

The Irish Times Logo
Commenting on The Irish Times has changed. To comment you must now be an Irish Times subscriber.
SUBSCRIBE
GO BACK
Error Image
The account details entered are not currently associated with an Irish Times subscription. Please subscribe to sign in to comment.
Comment Sign In

Forgot password?
The Irish Times Logo
Thank you
You should receive instructions for resetting your password. When you have reset your password, you can Sign In.
The Irish Times Logo
Please choose a screen name. This name will appear beside any comments you post. Your screen name should follow the standards set out in our community standards.
Screen Name Selection

Hello

Please choose a screen name. This name will appear beside any comments you post. Your screen name should follow the standards set out in our community standards.

The Irish Times Logo
Commenting on The Irish Times has changed. To comment you must now be an Irish Times subscriber.
SUBSCRIBE
Forgot Password
Please enter your email address so we can send you a link to reset your password.

Sign In

Your Comments
We reserve the right to remove any content at any time from this Community, including without limitation if it violates the Community Standards. We ask that you report content that you in good faith believe violates the above rules by clicking the Flag link next to the offending comment or by filling out this form. New comments are only accepted for 3 days from the date of publication.