Health literacy linked with safe and successful self-induced abortions in Lagos state, Nigeria

Recently, we published a blog post about our paper “Sexual and Reproductive Health Literacy, Misoprostol Knowledge and Use of Medication Abortion in Lagos State, Nigeria: A Mixed Methods Study” in the FemQuant blog.

Please click here to read the post, which summarises some of the main results of our study.

Advertisement

Relationship stability is important for abortion decisions in Finland

In a recent study (Väisänen 2017), I examined how women make decisions to terminate a pregnancy within the wider context of their lives – including the state and quality of their romantic relationships.

Please read my report about this study on the N-IUSSP online news magazine website.

The unequal abortion patterns in Finland

It’s been a while since my last post. A lot has happened in the last half-a-year-or-so. I became a lecturer at the University of Southampton in October, submitted my thesis to LSE in February and a couple of papers came out one of which was featured in Helsingin Sanomat (the biggest newspaper in Finland; see here in Finnish).

These last two papers that I published out of my thesis were about the association between labour market position (being employed, unemployed, student or inactive in the labour market) and the likelihood of abortion; and about the educational gradient in the likelihood of having more than one abortion. The former came out in the Finnish Yearbook of Population Research and the latter in Journal of Biosocial Science.

Both papers show that women’s socioeconomic position is associated with the likelihood of having an abortion and this has been the case since the 1970s until nowadays. Women who were unemployed were more likely to have an abortion than employed women in particular if they were not married or cohabiting. This indicates that women are concerned about the economic wellbeing of their family in an uncertain situation. During the recession of the 1990s the likelihood of abortion was higher among those who already had children and who were employed than it was before or after the recession. This implies that women may have been concerned about their position in the workplace in case they became pregnant. Given the economic situation we are facing today, it is something to consider.

When it comes to the likelihood of having more than one abortion during one’s reproductive life course, the likelihood is higher among those who have low levels of education, and the gap between the highly educated and those with no more than compulsory education has increased over time. Not many highly educated women had more than one abortion and the time since the first abortion, their relationship status or number of children they had were not associated with the likelihood. Women who had completed only compulsory education, however, had their second and third abortions sooner after the previous procedure than highly educated women and their other characteristics altered the likelihood as well. It may be that women with high education benefit more from post-abortion contraceptive counselling than women with low education.

Taken together, both of these studies show that abortion access in Finland depends on women’s standing in the society regardless of family planning provision in all municipalities since the 1970s and sexuality education in all schools. Although these are important policies and should be continued, there is a need to evaluate whether something could be done to better reach those in more precarious situations in the society.

Sources:

Väisänen, Heini (2016). “Educational inequalities in repeat abortion: A longitudinal register study in Finland 1975-2010.” Journal of Biosocial Science, doi:10.1017/S002193201600016X.

Väisänen, Heini (2015). “Labour Force Participation and the Likelihood of Abortion in Finland over Three Birth Cohorts.” Finnish Yearbook of Population Research, 50: 5-20.

Soininvaara is not a demographer

Edit 18 Noveber 2015

Some people have asked me what is wrong with using Nigeria as an example or the type of reasoning used in Soininvaara’s post. The problem is that it uses the same type of reasoning that led people in the 1970s to believe that there will be a population bomb. People looked at the fertility levels at the time, assumed they would stay constant and predicted how long it would take for the world population to double, triple, quadruple etc. However, this assumption has been proven to be invalid (fertility rates decrease when people are better off) and even UN does not provide the “constant fertility rates scenario” in its projections anymore. The mechanisms that affect population growth are complex and when projecting population growth, we must make complex assumptions based on those mechanisms. Nigeria is not a very good example of the most prevalent fertility trajectories in Sub Saharan Africa, since its fertility levels have decreased less than in most other countries of the area and thus give the wrong impression that when projecting population growth we could assume the current rates stay constant for long periods of time.

Original post

A Finnish Green Party Politician Osmo Soininvaara recently stated that the world population bomb is not over like some people claim (see here in Finnish). He based his argument in showing that in Sub Saharan Africa fertility rates (the average number of children per woman) are still high. He argued that people in for example Nigeria keep having lots of children, because religious leaders tell them to. He also noted that people in Nigeria have children in order to have someone to take care of them when they are old.

I agree with the latter point and anyone who doubts can watch Hans Rosling explain why ending poverty will lead to lower fertility rates.

When it comes to other views Soininvaara has about Sub Saharan Africa (SSA), I am not sure he thought his argument through.

First, he based his argument on the fertility rates of one country (Nigeria), which seems to be an exception rather than a rule when each SSA country is examined individually. Most countries show a downward trend in their fertility rates (see below). Moreover, basing one’s argument on one country only is hardly convincing giving the huge variation in fertility rates in the region: from 1.44 in Mauritius to 7.56 in Niger.

All Sub-Saharan African Counties (click for a better graph).

all SSA TFR

According to World Economic Forum (WEF), the most promising economies in SSA are found in Mauritius, South Africa, Rwanda, Botswana, Namibia, Kenya, Seychelles, Zambia, Gabon and Lesotho. WEF’s ranking includes measures of education, health care and infrastructure in addition to more traditional economic measures. Fertility rates have decreased markedly in all these countries, six out of ten being at around three children per woman or less, emphasising the importance of fighting poverty and providing health care and education in order to reduce fertility rates.

Top ten economies in the region (click for a better graph).

best economies SSA TFR

According to UN population projections, it is true that the world’s population will keep growing for some time still and the fastest growth is in Sub Saharan Africa. The smallest changes in fertility may cause big differences in population size a few decades later, so projecting population is a very difficult task, like the graph below, put together by the most prominent professionals in the field, shows.world population

Instead of throwing out arguments about Nigerians or anyone else not being able to “achieve” lower fertility rates due to following the instructions of their religious leaders, it would be more useful to think why fertility rates differ so drastically around the world. The important thing is to figure out how we could ensure a better future for everyone in terms of economic prosperity, health care, education and social safety nets.

Raskaudenkeskeytystä hakevan naisen oikeudet tärkeämpiä kuin hoitohenkilökunnan vakaumukset

Huomenna 8. lokakuuta 2015 eduskunnassa on lähetekeskustelussa laki joka koskee kansalaisaloitetta lakisääteisestä oikeudesta kieltäytyä “elämän lopettamisesta” (suora lainaus eduskunnan sivuilta) terveydenhuollon henkilökunnalle vakaumuksellisista syistä. Todellisuudessa lakiehdotus tarkoittaisi hoitohenkilökunnan mahdollisuutta kieltäytyä hoitamasta naista, joka hakee raskaudenkeskeytystä.

Ensikuulemalta lakiehdotus ei ehkä kuulosta kovin pahalta. Suomessahan voi aina hakeutua toisen lääkärin puheille, mikäli ensimmäinen sattuu vakaumuksellisista syistä vastustamaan aborttia. Todellisuudessa kyseisellä lainsäädännöllä on huomattu olevan useita negatiivisia vaikutuksia maissa, joissa se on olemassa.

Lainsäädännön haittavaikutuksia vähätellään usein sanomalla, että vain pieni osa lääkäreistä ja muusta hoitohenkilökunnasta kieltäytyisi hoitamasta potilaitaan. Kuitenkin esimerkiksi Italiassa keskimäärin 70% gynekologeista on kieltäytynyt aborttien tekemisestä (1). Joillain alueilla jopa yli 80% ei tähän toimenpiteeseen suostu (2). Laki asettaa naiset eriarvoiseen asemaan ja vaikeuttaa hoitoonpääsyä etenkin kaupunkien ulkopuolella, missä vaihtoehtoisia palveluita voi olla vaikeaa löytää.

Usein lakia perustellaan säälimällä hoitohenkilökuntaa, joka joutuu toimimaan vastoin uskonnollista vakaumustaan. Vaikka asia heille varmasti vaikea onkin, on muistettava, etteivät hoitoon hakeutuvat naiset ja hoitohenkilökunta ole tasa-arvoisessa valta-asemassa. Suomessa naisen tulee jo nyt saada kahden lääkärin hyväksyntä abortille sosiaalisista syistä. Lääkärit toimivat portinvartijoina ja voivat käyttää valtaansa vaikeuttaakseen toimenpiteeseen pääsemistä. Ehdotettu lainsäädäntö ei ainakaan parantaisi tilannetta, vaan viestittäisi, ettei naisten tule saada itse päättää omasta kehostaan. Lainsäädännön tulisi puolustaa heikommassa asemassa olevaa, ei vaikeuttaa heidän asemaansa.

Olen jo aikaisemmassa kirjoituksessani korostanut, että pääsy turvallisiin raskaudenkeskeytyspalveluihin on tärkeää, sillä tämän oikeuden rajoittaminen ajaa naiset kotikutoisten menetelmien ääreen, mikä on riski heidän terveydelleen ja jopa elämälleen. Salliva aborttillinsäädäntö on yksi mutta ei ainoa tekijä naisten elämän turvaamisessa. Helppo pääsy raskaudenkeskeytykseen on toinen yhtä tärkeä tekijä.

Lakialoitteesta on puhuttu mediassa surullisen vähän huolimatta siitä kuinka tärkeä se on naisten oikeuksien kannalta. Pitäkää meteliä! Lain haittavaikutukset on tuotava esiin.

Muita aiheeseen liittyviä tekstejä:

Marianne Niemelä, Vihreä Lanka: Miksi joudumme yhä taistelemaan aborttioikeudesta?

Väestöliitto: Ei omantunnonvapautta raskauden keskeytyksiin.

Lähteet

  1. Chavkin et al. 2013. Conscientious objection and refusal to provide reproductive healthcare: a White Paper examining prevalence, health consequences, and policy responses. International Journal of Gynecology and Obstetrics.
  2. Fiala & Arthur 2014. “Dishonourable disobedience” – Why refusal to treat in reproductive healthcare is not conscientious objection. Woman – Psychosomatic Gynaecology and Obstetrics.

How to define top journals in social science? The example of demography.

Inspired by a blog post by Patrick Dunleavy about citation practices in different disciplines I wanted to update my understanding of which journals belong to the top of my discipline, demography.

Traditionally I have checked this using the impact factor scores listed in ISI Web of Social Science’s Journal Citation Reports under group “Demography”. I knew that impact factor is in fact quite a bad indicator of a journal’s prestige, but I kept focusing on that anyway. I simply assumed that everyone else was doing that as well and thus the socially constructed understanding of which journals are the best ones would be based on impact factor rankings despite its problems. As a young researcher I have to be constantly thinking about my CV and I thought submitting to journals that rank high on this indicator would impress a potential employer reading my list of publications.

However, Professor Dunleavy wrote that anyone still looking at impact factors is “mathematically ignorant”, whereas h-indices listed in Google Scholar’s Metrics are “robust and meaningful average indicators”. In addition, he said that coverage of social science journals is much better in Google’s than ISI Web’s database. Consequently, I decided to see what Google Metrics had to say about demography.

Unfortunately Google Metrics does not have a subcategory for demography, so I was only left guessing whether the coverage actually is any better in my discipline. Instead, I decided to search for the top 20 journals listed by ISI Web and see what happens to the rankings when h-index is used instead of impact factor.

The table below shows that regardless of the metric the top two journals in demography are Demography and Population and Development Review. There is more variation in the raking of other journals, for instance the open source Demographic Research’s rankings vary from 5 to 11 and the London based Population Studies’ from 8 to 17.

journalranks

So, what did we learn from all this? Where should I submit my next article? I guess we are still in search of the perfect metric and journal database, but the results seem to be fairly robust at least when it comes to the few journals at the very top of the rankings.

If one wants to maximise the h-index/impact factor of their publications, and happens to work in an interdisciplinary field like demography, they’re probably better of publishing in journals listed under other disciplines, such as sociology (e.g. American Sociological Review has H5 index of 47) or epidemiology (e.g. H5 of American Journal of Epidemiology is 73).

I guess in the end it all comes down to varying citation traditions discussed in Dunleavy’s blog post. Perhaps we all should just start vigorously citing research published in our field?

Whose life matters? Spain’s abortion bill

Spain is about to pass a bill called “The Organic law for the protection of the life of the conceived and the rights of the pregnant woman” into the parliament for debate. The bill suggests restricting access to abortion only in rape cases or if the woman’s health is at risk. The bill not only violates human rights, but will also put a number of women into a severe risk. Unsafe abortion is often fatal.

Studies have shown that restrictive abortion laws do not reduce the number of abortions. In a paper published in The Lancet in 2012, Gilda Sedgh and colleagues showed that abortion rate was lower in those regions of the world, where legislation was liberal.

In many countries, where access to safe abortion is restricted, women use life threatening methods to terminate unwanted pregnancies. These range from black market drugs to inserting unhygienic objects, such as sticks, to vagina in order to induce the abortion. Around 13% of maternal deaths are due to unsafe abortion, resulting in the death of almost 50,000 women every year. In developing countries, where access to abortion is often restricted by legislation, lack of appropriate health care facilities, or both, around five million women per year are treated due to complications due to unsafe abortion.

Adverse health consequences of unsafe abortion can easily be prevented by providing easy access to contraceptives and safe abortion services.

Please sign Amnesty’s petition against Spain’s abortion bill. Finns can do it here, others please check your local Amnesty International, or write directly to Spanish Politicians (see instructions here) before 24 July 2014.

Academic articles:

Other sources:

How to Tackle the Socioeconomic Inequalities of Teenage Pregnancy

This is a post based on our article “Social Inequalities in Teenage Fertility Outcomes: Childbearing and Abortion Trends of Three Birth Cohorts in Finland”.

 

In the media, Finland is often displayed as an example of a country where society has taken big steps in ensuring equality in children’s upbringing: the world’s leading education system is free, parents are well supported financially, and able to choose between a long parental leave and working full time. At the same time their children are taken care of in one of the many public nurseries with university educated kindergarten teachers and parents only have to pay a small fraction of the costs.

When adolescents reach their teens and begin to explore elements of the adult world such as sex, it is important to ensure that they are equipped with enough information regarding sexual health, contraception and the emotions involved. Apart from a few recession years in the 1990s, sex education has been a compulsory part of the curriculum in Finland since 19701. That, among other reasons, has resulted in internationally low teenage pregnancy rates despite a temporary increase in the late 1990s2,3. In addition, contraceptives have been easily available from a variety of sources including school health centres and the public healthcare system since the early 1970s4.

Studies in the US and UK5,6 have found that teens who lack the possibility of pursuing certain careers, may wish to start childbearing at a young age because they see that as a legitimate pathway to adulthood. Perhaps the low teen pregnancy rates in Finland indicate that the policies mentioned above have been successful in providing alternative pathways to adulthood, making the remaining teen pregnancies happen due to other reasons than one’s socioeconomic position?

Although I do think that these policies are needed and should continue, it looks like they have not been very successful in decreasing the socioeconomic gap in teenage childbearing and abortions. Evidence for this is based on the results of our study looking at fertility behaviour of three birth cohorts of Finnish women when they were aged 15 to 19 (born in 1955-59, 1965-69 and 1975-79).

The likelihood of teenage childbearing or abortion was the highest for the adolescents from low socioeconomic status households, in particular if the head of the household was a manual worker. Among the teenagers who experienced a pregnancy the odds of choosing an abortion rather than childbearing were two to three times higher for teens from white-collar backgrounds, indicating a will to postpone childbearing – perhaps in order to pursue higher education and a career.

Interestingly, the socioeconomic differences were the largest for the 1960s cohort, even though they were the ones who should have enjoyed the best family planning services and sex education. The 1950s cohort was already in their teens when sex education and family planning services became compulsory in all municipalities, whereas the 1970s cohort suffered from cuts in these services due to the severe recession in the 1990s.

The results of the study do not claim that teens are better off without sex education and family planning services – in fact teen pregnancy rates started to increase soon after cuts were made to these services and started to decline again after the services were re-introduced. However, there is a need for tailored policies taking into account the different backgrounds of the adolescents. Although targeted family planning services and sex education should be in the core of these policies, it is equally important to provide support for teens who conceive regardless of whether they decide to carry the pregnancy to term. All adolescents, irrespective of their pregnancy history should be able to attend school and pursue the career of their choice.

This text has also been posted to Demotrends blog (an amazing blog I highly recommend!). For more information, check the article on the journal’s website.

 

References

  1. Kontula, O. The evolution of sex education and students’ sexual knowledge in Finland in the 2000s. Sex Educ. 10, 373–386 (2010).
  2. Heino, A. & Gissler, M. Induced abortions 2011. (National Institute for Health and Welfare, 2012).
  3. Vuori, A. & Gissler, M. Perinatal statistics: parturients, deliveries and newborns 2012. (National Institute for Health and Welfare, 2013).
  4. Kosunen, E. in New Views Sex. Health – Case Finl. (Lottes, I. & Kontula, O.) 70–84 (Väestöliitto, 2000).
  5. Hayford, S. R. & Guzzo, K. B. Racial and Ethnic Variation in Unmarried Young Adults’ Motivation to Avoid Pregnancy. Perspect. Sex. Reprod. Health 45, 41–51 (2013).
  6. Smith, D. M. & Roberts, R. Social inequality and young pregnancy: the causal attributions of young parents in London, UK. Health Place 17, 1054–1060 (2011).

Toisenlainen lukiovertailu

”Sijoitus voi siksi [koulun pienen koon vuoksi] vaihdella paljonkin, mutta ei koulun opetuksen taso samaan tahtiin voi vaihdella. Vertailussa auttaa paljon, jos otetaan huomioon lukion lähtökeskiarvo. Mutta pitäisi ottaa huomioon myös koulujen eri koko.” (Yle.fi 28.5.2013)

“Kokonaan toinen asia olisi yrittää mitata lukion vaikuttavuutta eli lisäarvoa tai “arvonmenetystä”: leipooko yksi lukio peruskoulun armoviitosillakin läpäisseistä kelpo ylioppilaita, ja onnistuuko toinen lukio tukahduttamaan peruskoulussa loistaneiden motivaation. Ratkaisuksi eli lähtötason paljastajaksi on tarjottu peruskoulun päättötodistusta, mutta mittarina se on varsin epätarkka. Opetushallituksen osaamistesteissä on havaittu todellisen osaamisen ja arvosanan välillä jopa kahden numeron heittoja, jotka voivat olla myös systemaattisia.” (HS.fi 29.5.2013)

Miten osaamisen ja opettamisen tasoa tulee mitata? Voidaanko kouluja, oppilaita tai opettajia asettaa paremmuusjärjestykseen ja mikäli voidaan, millaisia kriteereitä kyseisen järjestyksen luomiseen tulisi käyttää?

Lienee selvää, ettei edellä esitettyihin kysymyksiin ole yksiselitteisiä vastauksia. Siitä huolimatta joka vuosi kohistaan Helsingin Sanomien lukiovertailusta, jossa lukiot asetetaan paremmuusjärjestykseen sen mukaan, kuinka hyvin niiden oppilaat ovat keskimäärin ylioppilastutkinnossa kyseisenä vuonna pärjänneet. Joka vuosi tähän keskusteluun liittyy kritiikkiä siitä, että mittausta tulisi muuttaa ottamalla huomioon erinäisiä asioita, kuten oppilaiden lähtötaso tai koulun koko kuten yllä olevista lainauksista tulee ilmi. Viime vuonna STT päätti muuttaa sanat teoiksi ja rakensi oman lukiovertailunsa, jossa otettiin huomioon oppilaiden lähtötaso (eli peruskoulun päättötodistuksen keskiarvojen keskiarvo) lukioita vertaillessa. Ykkössijan sai lukio, joka tuotti eniten “lisäarvoa” eli jonka oppilaat pärjäsivät ylioppilastutkinnossa paremmin kuin heidän lähtötasonsa antoi olettaa.

Olimme jo pitkään ystäväni kanssa kehitelleet vastaavaa vertailua ennen kuin STT julkaisi omansa. Uutisen myötä oma vertailumme jäi pölyttymään pöytälaatikkoon. Tallensin kuitenkin STT:n vertailun avoimen datan koneelleni sateisen päivän varalle. Tänä keväänä Yle julkaisi vertailun, jossa huomioon otettiin koko 2000-luvun ylioppilastutkintotulokset. Yhdistämällä tietoja näistä kahdesta lähteestä sekä Hesarin uusimmasta lukiorankingista, loin tietokannan, jonka avulla asiaan saattoi perehtyä syvällisemmin kuin vain yhden tai kahden muuttujan avulla. Saatavilla oli tieto vuosien 2012 ja 2013 puoltoäänien keskiarvosta, koko 2000-luvun puoltoäänien keskiarvo ja keskihajonta (joista jälkimmäistä voidaan pitää mittarina lukion tuloksen tasaisuudesta siten, että pieni keskihajonta tarkoittaa tasaista tulosta ja suuri keskihajonta epätasaista), kirjoittaneiden määrä vuosina 2012 ja 2013 sekä kunta ja maakunta, jossa lukio sijaitsee. Päätin tarkastella, mitkä asiat vaikuttavat pitkäaikaiseen hyvään menestykseen (eli 2000-luvun puoltoäänien keskiarvoon).

Kun tarkastellaan edellä mainittujen muuttujien vaikutusta puoltoäänien pitkäaikaiseen keskiarvoon yksitellen lineaarisella regressiomallilla, näyttää siltä, että jokaisella niistä on merkitystä. Mitä epätasaisempia tuloksia lukio tuottaa, sitä huonommat puoltoäänet kun taas suuri koko parantaa tulosta hieman (sadan oppilaan lisäys n.1 puoltoäänen), korkea sisäänpääsykeskiarvo (yhden yksikön lisäys keskiarvossa tuottaa 2,8 puoltoääntä lisää keskimäärin) ja ruotsinkielisyys (keskimäärin 1,2 puoltoääntä enemmän kuin suomenkielisillä lukioilla) enemmän. Uuteenmaahan verrattuna kaikkien muiden maakuntien lukiot näyttävät pärjäävän huonommin, vaikkakaan ero ei aina ole tilastollisesti merkitsevä. Yli yhden puoltoäänen päässä Uudestamaasta ovat Lappi, Etelä-Pohjanmaa, Etelä-Savo, Kainuu ja Kanta-Häme.

Yleensä kuitenkin on hyödyllistä tarkastella useiden muuttujien vaikutusta yhtäaikaa sen sijaan, että pohdittaisiin jokaisen vaikutusta erikseen. Lisäsin kaikki edellä mainitut muuttujat samaan malliin ja lisäksi otin huomioon vielä sisäänpääsykesiarvon neliön, mikä käytännössä tarkoittaa sitä, ettei sen ja puoltoäänien määrän oleteta riippuvan toisistaan ainoastaan lineaarisesti. Näyttääkin siltä, että sisäänpääsykeskiarvon ja puoltoäänien välinen yhteys on melko tasainen ala- ja keskikastin lukioissa, kun taas 8,5 sisäänpääsykeskiarvon jälkeen puoltoäänien määrä ampaisee hurjaan nousuun. Ruotsinkieliset lukiot pärjäävät keskimäärin 1,5 puoltoääntä paremmin kuin suomenkieliset. Tasaista tulosta tuottavat lukiot pärjäävät keskimäärin paremmin kuin epätasaista tuottavat. Lukion koolla ja sijainnilla ei enää juurikaan ole merkitystä, kun sisäänpääsykeskiarvo, tuloksen tasaisuus ja ruotsinkielisyys on otettu huomioon.

keskiarvo puoltoaanet
Sisäänpääsykeskiarvon vaikutus puoltoäänien määrään, kun maakunta on uusimaa ja lukion koko sekä tuloksen tasaisuus on vakioitu keskiarvoihinsa.

taulukko mallit

 

Mikä lukio sitten on paras lukio? Mikäli halutaan selvittää, mikä lukio tuottaa eniten ”lisäarvoa” opiskelijalle, eli tuottaa mahdollisimman hyvät puoltoäänet ottaen huomioon opiskelijoiden lähtötason, voidaan tarkastella viimeisimmän regressiomallin residuaaleja. Ne kertovat, mitkä lukiot pärjäävät paremmin kuin regressiomalli keskimäärin olettaa ja mitkä huonommin. Residuaalitarkastelun perusteella näyttää siltä, että perinteisesti huippuina pidetyt lukiot pärjäävät juuri niin hyvin kuin niiden voi olettaakin pärjäävän: esimerkiksi Ressun ja SYK:in residuaalit ovat lähellä nollaa, mikä on merkki siitä. Mitä kauempana nollasta, sitä poikkeavampia tuloksia lukio tuottaa.

residuaalit taulukko resuduaalit

Kuinka vakavasti tämä analyysi tulisi ottaa? Käyttämässäni datassa on useita puutteita. On kyseenalaista, voinko päätellä em. asioita sisäänpääsykeskiarvon ja lukion koon suhteen, sillä ne ovat tiedossa vain vuosilta 2012 ja/tai 2013, kun taas puoltoäänien määrä on koko 2000-luvun keskiarvo. Ideaalitilanteessa tulisi käyttää sisäänpääsykeskiarvoja ja kokoa vastaavilta vuosilta. Oletan kuitenkin, etteivät nämä ole muuttuneen niin dramaattisesti, etteikö ainakin suuntaa-antavia tuloksia voitaisi niiden perusteella laskea. Lisäksi malleissa ovat mukana vain ne 370 lukiota, joilta saatavissa kaikki tiedot vaikka Suomessa on yli 400 lukiota. Tässä analyysissa esimerkiksi kaikki aikuislinjat puuttuvat. Näiden lisäksi ollaan vielä jo alussa mainitsemieni perustavanlaatuisten mittaamiseen liittyvien ongelmien äärellä.

Neuvoni onkin olla ottamatta tätä (tai mitään muutakaan) rankingia ainoana oikeana totuutena. Etenkin jokaisen lukiovalintaa pohtivan oppilaan tulisi muistaa, ettei tällaisilla agregaattitason vertailuilla voida sanoa mitään yksilötason tuloksesta. Lisäksi painottamalla rankingissa erilaisia asioita saadaan erilaisia tuloksia, joiden hyödyllisyys vaihtelee riippuen siitä, mitä niiden avulla halutaan sanoa. Toisaalta, vaikka peruskoulun päättötodistus ei olisi hyvä osaamismittari, veikkaan, että ilmapiiri koulussa, johon mennään keskiarvolla 9,5 on hyvin erilainen kuin koulussa, jossa kuka tahansa pyrkijä pääsee sisään. Kympin oppilaiden opiskelumotivaatio ja luottamus omaan kouluosaamiseensa lienevät ihan eri tasoa kuin vitosen oppilaiden riippumatta siitä, miten nämä numerot mittaavat “todellista” osaamista. Ehkäpä rankingit kertovatkin jotain lähinnä koulun opiskelumyönteisestä ilmapiiristä?

Numbers don’t lie, but news do. An analysis of news coverage of polls in Finland.

Inspired by a friend’s rant in Facebook regarding the media’s way of presenting poll results and by a public lecture of Nate Silver at LSE, where similar problems were discussed, I decided to investigate the news regarding the popularity of the largest parties in Finland. I wondered, what the polls actually say about the popularity and is that reflected in the language used in the news.

I limit my mini-investigation to the four largest parties: Social-democrats (SDP), National Coalition Party a.k.a. Kokoomus (KOK), Centre Party a.k.a. Keskusta (KESK) and True Finns Party a.k.a. Perussuomalaiset (PS), because the polls usually only give the margin of error for the largest parties. Therefore, I can only try to estimate the accuracy of popularity of these parties.

I searched for a few latest polls in the two biggest news institutions’ websites in Finland: Yle.fi (the National Broadcasting Company) and HS.fi of Helsingin Sanomat (a broadsheet with the largest number of readers). In the end I chose seven polls, conducted between December 2012 and April 2013. Yle uses Taloustutkimus and HS TNS Gallup to conduct the analysis.

polls

The figure clearly shows that if we consider the margins of error reported by Yle and HS, most of these polls cannot distinguish, which one of these four parties is the most popular one. However, arriving to this conclusion is not easy due to four reasons:

  1. Margin of error is only reported for “the biggest” parties, although I couldn’t find a definition of what “the biggest parties” mean. I assume it means these four, since there is a significant gap between these and the 5th largest party popularity in all polls. In the latest HS poll (24 April 2013) the margin was not reported at all.
  2. Yle polls report that the results of the polls are “more accurate than what the margin of error would imply” due to calibration methods they use, but this is not explained further. Therefore, I chose to ignore this information here.
  3. In order to understand, what margin of error means, one has to know that it actually is a 95% confidence interval and that this interval (in simple terms) means that “we are 95% confident that the value in the total population is within this range”. In other words, if we drew an infinite number of random samples from the Finnish population and asked, which party people support, in 95/100 cases we would get an estimate within the range of 95% confidence interval. In 5/100 cases the estimate would be outside the range. The interval is reported, since as long as we don’t actually ask everyone, we cannot be entirely certain that our estimate is correct. However, we can provide information on how certain we are. Wide range implies more uncertainty than a narrow range.
  4. Most importantly: the way these polls are reported in the media is almost entirely inaccurate. I will elaborate this claim below.

The first poll (Yle 2 Dec 2012) was titled “Support for Centre Party in rapid increase“, which is not far from truth, since their popularity was 2.5%-points higher than in a previous poll and the margin of error was 1.4%-points. Therefore the overlap of the 95% confidence interval is marginal: the upper limit for the old poll’s estimate is 16.9% and the lower limit for this poll’s estimate is 16.6%. So, maybe their support actually has increased. Later they state that KOK is clearly the largest party, which is not the case, not at least clearly: looking at the figure we can see that the confidence intervals of KOK and SDP overlap. Therefore, the difference in their popularity might be only a coincidence (or noise) due to sampling. In another sample we might have gotten estimates presenting similar popularity for the two, or even higher percentages for SDP. The correct interpretation thus is: KOK is more popular than PS or KESK, but not significantly different from SDP. SDP seems to be more popular than PS but we’re not confident that there is a significant difference between PS and KESK or SDP and KESK.

The reasoning for all of the polls is similar, so I won’t present it in as much detail as above for the rest of the polls. Instead I’ll focus on the most inaccurate reports I found. If you’re interested in comparing these further, please take a look at the list of links below. As long as you have fluent Finnish skills, you should be able to do it based on this blog post.

The Centre Party is the second most popular” (HS 24 April 2013)*. Really? Looking at the figure, we quickly observe that the popularity of all four parties is really similar. We cannot even distinguish between the most and the least popular among these four — all the confidence intervals overlap. Thus, one should say: according to the latest poll, all the four biggest parties have similar levels of support.

The Centre Party is the most popular, SDP crashed” (Yle 29 April 2013). Guess what? I don’t agree with the statement. It indeed looks like KESK is more popular than SDP, but based on these results, it is impossible to say, whether it is KESK, KOK or PS, which currently is the most popular. The estimates differ only a tiny bit and the confidence intervals clearly overlap. The statement is not just exaggerating. It is false. What about SDP then, did it crash? Well, I don’t think so. The point estimate of their popularity is indeed lower than it has been in previous Yle polls in the figure. However, we have no way of knowing, if that was due to chance (remember the sampling thing!) or if there actually is a difference, since the confidence intervals overlap in all but the earliest poll in 2 December 2012. Therefore, my interpretation of this poll is: there is little difference in popularity of KESK, KOK and PS, whereas SDP may be less popular than the three other parties and also less popular than it was in the beginning of December 2012.

Okay, the rest of the interpretations you have to conduct yourself. I’m left wondering, why false information is so commonly presented in the media. Is it due to lack of understanding of statistics? Or maybe due to a belief that people are not interested in news, which do not rank the parties? Would it be so bad to truthfully say that we don’t know, which party among certain candidates currently is the most popular? I cannot think of a reason, which justifies false statements, when the journalist clearly should know better.

* If there’s anything lost in translation, blame me, I was the one, who translated these from Finnish to English.

Links to original news articles

Margins of error:

  • Yle 2 Dec ±1.4%-points
  • Yle 30 Dec ±2%-points
  • Yle 8 Mar ±1.3%-points
  • Yle 29 Apr ±1.4%-points
  • HS 23 Jan ±”less than 2″%-points –> I assumed 1.9%-points
  • HS 27 Mar ±”less than 2″%-points –> I assumed 1.9%-points
  • HS 24 Apr not reported –> I assumed 1.9%-points