Child and Youth Care is always vulnerable to “inert ideas,” a phrase used by Alfred North Whitehead almost 100 years ago to describe “ideas that are merely received into the mind without being utilized, or tested, or thrown into fresh combinations” (1929). We are infused with inert ideas, especially if we attend poor schools. Yet the opportunities and challenges of being a young person – and how we assist and support them – ought be endlessly interesting to us, and thinking clearly about those ideas ought to be motivating. The ideas that emerge from practice are interesting, yet they become inert when we forget actual young people – and the context in which the ideas arose.
Distractions are numerous; our formal education systems, child welfare, and even informal education has difficulty remembering what we could be doing. It is not intellectually difficult—it is practically difficult to overcome our collective amnesia about what our practices. An example from the study of research methods world illustrates the usefulness of thinking first and foremost about the questions we ask.
In 2015, Silberzahn and Uhlmann published a paper in the journal, Nature, that reported the results of crowd-sourced research. They had given the same research question and the same data to 29 research teams, wanting to see how widely the results might vary. The question was: “Are football (soccer) referees more likely to give red cards to players with dark skin than to players with light skin?” Not surprisingly, the results did vary widely, although everyone found some effect, that is, that darker skinned players were more likely to receive a red card.
In 2021, Auspurg and Brüder published a paper with an alternative theory and analysis of the earlier data. Instead of starting with an analysis of the data while assuming the obviousness of the questions, they began with the question, pointing out that those 29 teams assumed one of four different questions rather than one. One question is literal: Is there a mean or average difference between light and dark-skinned players in the risk of a red card? Researchers call this a bivariate question—there are two variables: skin tone and red cards, and we can count these.
A second way to interpret the question is that it is about discrimination/racial bias and whether one’s skin tone causes harsher penalties, all else equal, as they put it, including player’s position, minutes played, and the baseline rate at which players commit fouls. Third, some researchers focused on whether “… skin tone is among the explaining factors” (p. 4) rather than whether it is a cause. Finally, some researchers deliberately chose exploratory methods, sometimes unusual and idiosyncratic, wanting to increase the variability of the methods.
Auspurg and Brüder chose to answer question two. They used “model specification,” which is a fancy research term for identifying the variables that are likely to influence the likelihood of assigning/receiving a red card and developing a plausible causal explanation. They suggested that the number of games played, age, height, weight, position, club, and number of games played affects the number of red cards received. They “controlled” for these variables, and what is left over is the size of the possible cause of racial discrimination leading to red cards. Using magic (just kidding), they generated 486 models, and the average size of the effect was 1.31, that is, darker skinned players are 1.31 times as likely to receive a red card.
They suggest that first we want to carefully consider whether we understand the question. Like scientists, we are quick to dive into the work, but before we do that we might be better off thinking about what the challenge or question is and thinking about alternative interpretations. In our work, even if we are confident we are doing it right, if we cannot think of alternative approaches it is a sign we might need more thinking and more study. For example, how is it that so many of our work practices look similar across vast geographies and even cultures?
Second, we might want to be sure we understand the context of specific situations before we rush into action. Do we know how good street outreach programs work? Can we identify all the possible influences? Do we know enough about who the young people and the professional staff are and how they interact? Have we carefully read the best descriptions of the work and do we know about the range of possible outreach approaches? Can we explain a plausible causal connection between our work and a more interesting, caring, healthier quality of life? Has anyone done this before?
Finally, to ask better questions we have to know what methods are available. Researchers too often see everything as a nail, because the only tool they have is a hammer. Here too we want to know about the variety of approaches used historically and currently. Practitioners too may have a limited number of skills in their repertoire, and every youth and every youth problem then looks similar.
It’s a big world, and we want to invite that big world into our practices and our questions. Let’s ask better questions, and let us continue to develop our practices.
References
Auspurg, K., & Brüder, J. (2021). Has the credibility of the social sciences been credibly destroyed?
Renalyzing the “Many analysts, one data set” project. SOCIUS, 7, 1-14.
Silberzahn, Raphael, and Eric L. Uhlmann. 2015. “Crowdsourced Research: Many Hands Make Tight Work.” Nature 526(7572):189–91. doi:10.1038/526189a.
Whitehead, A. N. (1929/1959). The aims of education, in Blanshard, B. (ed.), Education in the age of science. New York: Basic Books.