• Written by John Quiggin, Professor, School of Economics, The University of Queensland
Projections are often be repeatedly wrong. That's because the models don't learn from mistakes. Shutterstock

It is difficult to make predictions, especially about the future. (attributed to Danish physicist Niels Bohr)

The difficulty of making predictions has long been known, but the rise of the internet means that it is getting harder to hide the gaps between predictions and reality.

Perhaps the most significant example of repeated failed projections has been the International Energy Agency’s projections of the importance of renewable power – the proportion of electricity generated by solar and wind and other renewable sources other than hydro.

Beginning in 1994, when generation from these sources was negligible, the Agency has produced estimates of the future share of renewables every two years.


Read more: Getting projections right: predicting future climate


Every two years, with striking regularity, the previous estimates have been exceeded (hugely) and the new set has been revised upwards. But never by enough. Each time the upward revision has been inadequate.

This graph, prepared by Paul Mainwood from IEA reports, illustrates the point:


Projections versus reality

Reality versus repeated projections of renewables share of electricity generation (ex hydro). Paul Mainwood, Quora

The dashed lines represent successive projections from 1994 to 2016.

The solid red line represents the actual growth of non-hydro renewables as a share of total electricity generation.

What can be seen is that eleven times in a row the projected growth in renewables was far too low and had to be upgraded. Eleven times in a row the upgrades weren’t big enough.

As a joke (indicated by the green line) Mainwood “corrected” the 2016 projection for the typical under-projection:


Projections plus “corrected” 2016 projection

Reality versus projections of renewables share of electricity generation (ex hydro) plus 2016 projection corrected for typical undershoot. Paul Mainwood

Projections often understate change

Another striking example relates to religious belief. In 2015 the Pew Research Institute released a report suggesting a gradual decline in Christianity in the United States.

The headline finding for the US:

Christians will decline from more than three-quarters (75%) of the population in 2010 to two-thirds (66%) in 2050.

Yet only four years later in 2019, Pew released another report with this headline finding about the US:

In 2018 and 2019, 65% of American adults describe themselves as Christians when asked about their religion, down 12 percentage points over the past decade.

Thus, a decline expected to take forty years had taken place inside ten.

Moreover, Christian affiliation is highest in the older age cohorts, very few members of which will be around in 2050. Looking at the younger cohort born after 1981, only 49% claim a Christian affiliation, a proportion that has declined by 16 percentage points in a decade. Unless that trend is rapidly reversed, or later cohorts experience a religious revival, Christians will be a minority well before 2050.

They enable modellers to escape responsiblity

Faced with outcomes of this kind, modellers often defend themselves by drawing a distinction between “predictions” and “projections”.

A prediction (Latin for “foretelling”) is a claim about what is most likely to happen in the future. By contrast, a projection (“casting forward”) is a model output derived by extrapolating past trends, holding some parameters constant and allowing others to vary.

The International Energy Agency projections were characterised by the assumption that the costs of renewable energy would change only slowly, rather than continuing the extraordinary decline that began in the 1970s.


Read more: A radical idea to get a high-renewable electric grid: Build way more solar and wind than needed


In the case of the Pew projections, the crucial parameter is conversion rates – the frequency with which people brought up with one religion (including “no religion”) change to another. The Pew projections were based on the assumption conversion rates will remain unchanged.

It is the opposite of the widely-held but controversial “secularisation hypothesis” which states that modernisation leads to increased conversions to “no religion”.

Predictions force them to take responsiblity

Projections are useful in the development of models. All models are based on past experience and have to assume that in some respects the future will be like the past. By examining the projections generated under particular assumptions about which variables and parameters will remain constant, it is possible to understand how models works and make modelling choices.

But projections of this kind are of no use in informing people not familiar with the material. They mislead casual readers of the Australia’s budget.

The budget uses both predictions and projections.

For the two years following each budget the Commonwealth uses “forecasts” which it is prepared to stand by, then for the next two it presents mechanical “projections”:

2019-20 Commonwealth budget, Budget Paper 1

When asked to defend (for example) its wage growth number of 3½%, the treasury points out that it is a mechanical projection rather than a forecast, a distinction lost on all but the most enthusiastic of budget devotees.

In practice it is impossible to separate the two.

Even though both the International Energy Association and Pew describe their estimates as “projections” they are almost invariably treated as predictions.


Read more: Vital Signs: dismal wages growth makes a joke of budget forecasts


Since any statement about the future will be treated as a prediction, the only serious option for modellers prepared to be truthful with the public is to bite the bullet and make predictions.

It means working hard to make the best possible estimate of the future paths of all model parameters, and using judgement to take account of everything else.

It’s what those of us looking to experts for guidance deserve.

John Quiggin does not work for, consult, own shares in or receive funding from any company or organization that would benefit from this article, and has disclosed no relevant affiliations beyond their academic appointment.

Authors: John Quiggin, Professor, School of Economics, The University of Queensland

Read more http://theconversation.com/please-no-more-projections-what-we-need-are-predictions-and-theyre-harder-126734

Tips to get Australian Rubber Stamps

If you are from Australia and need self-inking stamps for your home or business, there are many reputable and reliable stamp manufacturers to choose from. The easiest way to reduce product and sup...

Patoluna - avatar Patoluna

Best 4x4 wheels

The best for 4x4 wheels are a matter of debate for collectors. People see real potential in the Ozzy Tyres that they are buying. That brand can stand up to the test in almost any kind of setting t...

Diogenes Cnc - avatar Diogenes Cnc

How can you use competitor keyword research to enhance your SEO strategy?

What are Keywords? Typed in queries in a search engine often gives us insight into what people are looking for and how they are targeting their queries using a set few words to maintain relevancy.  ...

News Company - avatar News Company

The US has bought most of the world's remdesivir. Here's what it means for the rest of us

Dimitri Karastelev/Unsplash, CC BYTo beat the coronavirus pandemic, countries need to collaborate. We need the best possible science to develop vaccines and drugs, and to test, track and contain the v...

Barbara Mintzes, Senior Lecturer, Faculty of Pharmacy, University of Sydney - avatar Barbara Mintzes, Senior Lecturer, Faculty of Pharmacy, University of Sydney

Why some people don't want to take a COVID-19 test

Last week, outgoing chief medical officer Brendan Murphy announced all returned travellers would be tested for COVID-19 before and after quarantine.Some were surprised testing was not already required...

Jane Williams, Researcher at the Centre for Values, Ethics and the Law in Medicine (VELiM), University of Sydney - avatar Jane Williams, Researcher at the Centre for Values, Ethics and the Law in Medicine (VELiM), University of Sydney

How To Make The Most Of Your Morning When You Have Small Children

It’s unclear how they got themselves organised when, for all we know, they can barely even tie their own shoes or drink from a glass without spilling it but, all the children in the world have man...

News Company - avatar News Company

Beginner’s Guide to Changing an Apple Watch Band

An Apple watch says a lot not only about the taste of the wearer but also his style. It shows you are on the head of the most recent things in innovation, and it flaunts your design sense. Custo...

Daisy Bell - avatar Daisy Bell

Victoria's coronavirus contact tracers are already under the pump. What happens next?

ShutterstockThe emergence of significant community transmission of COVID-19 in Melbourne over the past week is greatly concerning to the whole of Australia.Earlier this week, Victoria’s chief he...

Gerard Fitzgerald, Emeritus Professor, School of Public Health, Queensland University of Technology - avatar Gerard Fitzgerald, Emeritus Professor, School of Public Health, Queensland University of Technology

what's the new coronavirus saliva test, and how does it work?

A cornerstone of containing the COVID-19 pandemic is widespread testing to identify cases and prevent new outbreaks emerging. This strategy is known as “test, trace and isolate”.The standa...

Deborah Williamson, Professor of Microbiology, The Peter Doherty Institute for Infection and Immunity - avatar Deborah Williamson, Professor of Microbiology, The Peter Doherty Institute for Infection and Immunity



News Company Media Core

Content & Technology Connecting Global Audiences

More Information - Less Opinion