The Universities

Bogus Statistics and ‘Sex Assaults’ on Campus

A National Student Safety Survey has been released (23 March 2022) with media fanfare. Its full title is Report on the prevalence of sexual harassment and sexual assault among university students in 2021.  The report is the work of the Social Research Centre for Universities Australia and it focuses on thirty-eight member Universities.  Headline and banner stories were prominent in today’s media. Most bulletins reduced the news to lists of percentages of students harassed or assaulted, and percentages by location. The stats were “facts”.

The Survey’s national snapshot says 43,819 students participated in the survey. Its key statistics are that one in six students (16.1 per cent) have been sexually harassed since starting university, one in twelve in the last twelve months (8.1 per cent), and that one in twenty have been sexually assaulted since starting university (4.5 per cent) and one in ninety (1.1 per cent) in the last 12 months.  When the figures are unpacked it seems that far higher percentages of ‘non-binary, pansexual and students with a disability’ are the victims.

As was the case with the prior 2017 Report, Change the Course, I cannot but note the issue of overwhelmingly substantial student non-response to the survey instrument.  Non-response is the giraffe in the room. As far as I can see, it is not discussed.

On page 82 of the Survey we read that a pilot test at ANU and Charles Sturt was run before the survey was rolled out. The pilot was limited to 2000 selected students.  Yet we are told that ‘a total of 332 students participated in the pilot survey for a completion rate of 16.6 per cent.’  Each respondent spent on average 11.2 minutes on the task.  The final form of the survey ran for four weeks across September and early October 2021 with students from all the Universities Australia member universities taking part.

The report tells us that 10,000 students were selected from each of the 38 universities ‘to take part in the survey’, and thus 378,992 students were selected for the national survey.  This total figure is 50,000 more than the 319,252 students targeted in the 2017 report.  We find the same silence and non-response from today’s students that we found in the 2017 cohort.  Thus, in the 2021-2022 Survey, we find a grand total of 43, 819 students or 11.6 per cent responding.  That 11.6 per cent is a percentage of the 378,000 targeted for inclusion and must again be divided by one-third to get a percentage of the national student body.  That is, the current 2022 survey relates to under 4 per cent of the tertiary students in Australia.

I simply want to ask: What does the silence of 96 per cent of Australian tertiary students mean? And why can two successive national surveys, marshalling the heavy guns of peak body Universities Australia, be faced by silence from roughly 90 per cent of those surveyed, let alone the whole cohort?

The interesting and unasked question is ‘What does this silence mean?’ It could easily have generated the headline ‘90 per cent of Uni Students Ignore Universities Australia Survey.’

Immediately and on cue, universities around Australia have released their pre-prepared response to the headline results, listing the good things done to change course since 2017. They are surfing the wave of change that they are driving.

But I remain interested in the silence of the statistical lambs.

The Australian Human Rights Commission’s (AHRC) Change the Course Report from August 2017 was weak statistically. Weakness began with failing to ask why the vast majority of students surveyed failed to respond or chose not to respond.

In 2017, pre-COVID, there were  more than 1.3 million tertiary students in Australia.  The AHRC and its agencies set out to survey, professionally, over 300,000 tertiary students at a total report-cost of around a million dollars.  As in the 2022 survey, only about 30,000 of the 319,252 students responded in 2017.  The big news could have been but wasn’t: ‘289,000 students made no response to Sexual Harassment and Assault Survey’. 

The 2017 survey had a response rate of 9.7 per cent of the survey pool.  I don’t want to make a technical comment about lack of statistical power but simply note that the silent majority outweighed respondents by almost ten to one.  

What did concern me was that every subsequent figure and percentage for a rate of assault, and each stat-based conclusion of the Report, was in fact drawn from only 2.3 per cent of the student population; ie., from 30,000 of 1.3 million students.  This was never really acknowledged, and the figures were shouted out as reflective of the whole.

The 10 percent assault rates referred to are thus 10 per cent of this 2.3 per cent pool, not 10 per cent of the 1.3 million students. It is there that the question of false extrapolation into the silence and non-response of students becomes an issue. in few words: the silent are recruited as supporters of the responders.

Buried — page 33 of the 2017 Report — where the reader must search for it as if for a needle in a haystack there is this (emphasis added):

The survey data has been derived from a sample of the target population who were motivated to respond, and who made an autonomous decision to do so. It may not necessarily be representative of the entire university student population.

Understatement. It is not representative. The AHRC needed to comment and talk candidly about why less than 10 per cent of those surveyed responded to their Survey.  What do the tiny percentages that result really mean? No valid conclusions could be drawn from the data about the million plus who are not in the data field. 

What do we in fact know about the 1,270,000 students who made no comment? Or even about the 270,000 in the Survey who did not respond?  We can know nothing at all from the statistics presented.

Commentators used the numbers as if they applied non-problematically to everyone and to all. That was a mistake.  The university sector has to date largely glossed over the matter. The slogan ‘one assault is one too many’ is correct but it also covers a multitude of statistical sins.

This is the kind of concern that drove Bettina Arndt and Miranda Devine, and perhaps Germaine Greer, to maintain the problem of sexual assault amongst students has not been properly identified let alone described or quantified. The non-response of the vast majority of students can be as much the news as the response of the few who completed the surveys.

The substantive questions raised by further, confidential, narrative-reporting of incidents of assault (mentioned in the 2017 Change the Course) raise different and deeply engaging matters. But these cannot be scoped by those who will never read the harrowing contents.  Any and every direct report of assault and sexual assault made by a student on campus should be investigated. But investigated by whom? The media? The vice-chancellor? A committee of qualified people reporting to the VC?  A head of residence? An external professional mediator? Or the police and courts? And at what trauma to participants? And to what outcome? And with what appeal process and at what cost and publicity to the participants? Each path has embedded challenges.

Anyone who has responded to specific, actual incidents and how they ‘track’ is fully aware of these challenges, or soon becomes aware of them.

The current National Student Safety Survey seems to say this about the statistical approach taken, given the completion rate of a mere 11.6 per cent or a non-response rate of 88.4 per cent.

To ensure survey results were as representative as possible of the student population, weights were calculated for each respondent. The approach to deriving weights involved calibrating to match population benchmarks for a range of respondent characteristics. These included the strata variables (gender at enrolment, year of study, residency, level of study) and three additional variables found to be related to non-response (age, country of birth and field of education). The weights were calculated separately for each institution and account for non-response bias and selection bias on the benchmark variables used to generate more precise survey estimates.  (Page 83)

When I read this, I was reminded of lines by W. H. Auden in The Shield of Achilles from 1952. He wrote:

Out of the air a voice without a face
Proved by statistics that a cause was just
In tones as dry and level as the place:
No one was cheered and nothing was discussed.

Much more discussion is needed. The question of the silent ones needs to be asked.

Ivan Head holds a PhD from Glasgow University and studied Philosophy at UWA and Philosophy and Classical Indian Thought at Melbourne University. When Chair of a Human Research Ethics Committee constituted under the NHMRC, he was routinely made aware of the issue of statistical power and its absence in some research projects

15 thoughts on “Bogus Statistics and ‘Sex Assaults’ on Campus

  • Daffy says:

    In such a survey the comment about students motivated to respond is telling. Surely a student who had been sexually assaulted (or even discomforted…as many of us have been, I’m sure) would be motivated. Thus we can suggest that the incident of unwanted sexual behaviour is minuscule. Whew. In my three degrees, plus several lesser quals, I came across not one report, rumour or accusation of sexual impropriety. And I know, a sample of one is not too good. But there you are.

  • call it out says:

    My four years at university were some decades ago. Presumably in less enlightened (read woke) times.
    I cannot recall a single instance of a sexual assault, or harassment, being reported, or discussed on campus.
    I take the survey described above as another shallow political exercise.

  • Blair says:

    The respondents to the survey were not randomly selected, so any statistical tests may be invalid. A large proportion of non-responses may result in a biased sample so usually during pilot testing a random sample of non-respondents is selected from those who were asked to participate and their results compared with those of the respondents. If there are significant differences between the two groups, then a survey of the population would result in meaningless statistics.

  • Geoff Sherrington says:

    When I was at Uni I really enjoyed women who bothered me sexually. It was fun.
    What is different about the students of today? Geoff S

  • wdr says:

    In 1954 a well known book was published in the US called How to Lie With Statistics. This “survey” should obviously be included in a new edition. It appears to be virtually worthless, for reasons set out in this excellent article. As well, it would appear that no definitions were provided as to what was meant by “sexual harassment” or “sexual assault.” How many “sexual assaults”- examples of physical violence- were actually reported to the police? Why were any not reported? How many actually occurred on a tertiary campus, as opposed to someone’s bedroom or at a drunken party? As noted in the comments, it is almost impossible to see how a “sexual assault” could occur on a tertiary campus, with hundreds of students and staff at hand, as well as security guards. Any woman who screamed during a genuine assault would attract immediate attention. Any student who engaged in a sexual assault would be arrested and expelled, and any staff member would be arrested and sacked. How many have actually been? Very few.

  • Alice Thermopolis says:

    Geoff S: “What is different about students of today?”

    It seems a lot of young people – not only students – everywhere are suffering from “sexual anxiety’, at least according to a recent BBC WS documentary: “Why are we having less sex?”

    “Across the world, there has been a recent, steep decline in sexual activity – and amongst the young, the change is particularly stark. With the help of experts, activists and the winners and losers in the mating game, author Jerry Barnett explores why this is happening, and asks where it might lead.”

    Interesting interviews. Alas, no more fun.
    When closeness becomes taboo and we have lost or debased the language and rituals of romantic love, this is the inevitable outcome.
    All we seem to hear about today is a cacophony of complaints about male crimes and misdemeanors. The only two women I have heard publicly saying nice things about men have been Joanna Lumley and Catherine Deneuve.
    In Japan, so many men are uninterested they form a new cohort: the celibate “herbivores’. They avoid feminist “carnivores” like the plague, or COVID.

  • lbloveday says:

    “They avoid feminist “carnivores” like the plague, or COVID.”
    .
    From Daily Telegraph: https://todayspaper.dailytelegraph.com.au/infinity/article_popover_share.aspx?guid=269e0878-cbe8-4d00-867c-de6b9a23e1c9
    >
    Key points:
    After almost 2 years, a man has been found not guilty of raping his girlfriend’s best friend as his girlfriend slept next to them in a bed at a South Western Sydney home.
    .
    According to court documents, the complainant told police she consumed four lines of cocaine, four beers and up to five vodkas during the evening of partying, where they played beer pong and sat in the spa at the home.
    .
    The man and his girlfriend then drove the alleged victim home.
    .
    She went to police, who charged the man.
    .
    The girlfriend gave evidence that she woke up and heard the sound of the pair having sex and laid there for about 10-15 minutes before she got up and said the pair had ruined her birthday.
    .
    The man’s legal team argued that it would be hard to fathom that the complainant did not raise the alarm with her friend who was laying next to her while she was being raped.
    .
    The jury acquitted the man after about 15 MINUTES of deliberation.

  • lbloveday says:

    Additional:
    .
    That’s almost 2 years of “Hell” before a being found not guilty in the shortest time I’ve ever read of which to me indicates the charges were ridiculous. The article does not tell whether he was on remand or bail, whether he lost his job, was restricted in movements, had to report to a police station twice weekly……FOR 2 YEARS.

  • Adam J says:

    lbloveday:
    Dead on target. Pleading not guilty in our system is a true test of mental stamina. It’s an absolute disgrace.
    Ned Kelly was tried in 2 weeks!

  • Elizabeth Beare says:

    “They are surfing the wave of change that they are driving.
    But I remain interested in the silence of the statistical lambs.”
    Yes, a great article unpacking the essential untruthfulness in this beat-up statistic.
    We now know what some representative pansexuals worry about, and not much more.
    If a genuine sexual attack occurs the victim should take it to the police, under the law.
    Otherwise, let normal social rules prevail to solve ‘harrassments’. They have done so for years.
    And it seems as though the majority of the student body prefers it that way.

  • lbloveday says:

    “Otherwise, let normal social rules prevail to solve ‘harrassments’.
    Maybe I watch too many old movies, but the traditional slap in the face seemed to end “harassment” as it seems nowadays defined.
    Or if not practical, enlist the help of a “Popeye” as the office “girls” used to refer to me in a TAFE College I taught in. They were subjected to persistent suggestive and unwanted verbal remarks by a 18-20yo full-time male student and sought my advice.
    He spent a lot of time in the computer room and I waited until he was alone there, came in, pointedly locked the door then informed him of the consequences that he would incur if he did not desist. Problem solved.
    These days I guess I’d be in the poo as a Year 12 Math teacher friend was. He was on yard duty and saw 3 male well-known bullies had bailed up a well-known “nerd”. He stepped between them, said “back off” to the bullies, one stepped forward, my mate, pushing 60, put his hand on his chest and pushed him firmly back; that’s it, pushed away an active bully who challenged his right to protect a “nerd”. Bully went home and told Mummy, Mummy came to see the female Principal, Principal carpeted mate and said he’d have to go to anger management classes. He applied for and got a transfer to a country high school.

  • GaryR says:

    Worth noting that the article in The Australian that trumpeted the ‘survey’ results, by its top education writer, made no mention of the methodology, let alone provide any reference to past critiques. And when I respectfully pointed this out in an online comment, it was ‘rejected’.

  • Michael says:

    These surveys are pretty obviously rubbish at best, and ideology-driven at worst. Let’s take the reported statistic that 16.1 per cent of students have been sexually harassed since starting university. That means over 200,000 students were sexually harassed, which seems implausible to say the least. I know men are sometimes sexually harassed, but it is so much rarer than sexual harassment of women that the 16.1 per cent figure could imply that about a third of women had been sexually harassed since starting university. Implausible. If this were really the situation, it’s hard to see why women are turning up to universities in their hundreds of thousands every day. And were are the formal cases being brought to university or other authorities? They are occasional instances, not the hundreds a day that would be implied by the reported statistics of prevalence.

  • lbloveday says:

    No so implausible Michael when sexual harassment includes a lingering look at a woman in a low-cut body-hugging outfit, a wink, a first invitation to a date or “Can I sit here?” referring to an empty chair in a crowded cafeteria with no empty table.

  • Louis Cook says:

    I had a quick look at the report and nearly puked when I read the acknowledgement copied below. These people are a waste of space, time, and money. Thank you to the Quadrant community for sanity in the ‘wokeplace’.
    Acknowledgement – We acknowledge the Wurundjeri People who are the Traditional Custodians of the lands on which our research team is located, and we recognise the ongoing impacts of colonisation on First Nations peoples around Australia and the world. We also acknowledge the numerous students who gave their time to participate in the research. We further acknowledge the lived experience of victim/survivors of sexual harassment and sexual assault. This research hopes to contribute to a future free of violence and abuse for all Australians.

Leave a Reply