ORIGINAL RESEARCH ARTICLE

Critical literacies for a datafied society: academic development and curriculum design in higher education

Javiera Atenasa,b*, Leo Havemannc,d, and Cristian Timmermanne

aFaculty of Education, Universitat de Barcelona, Barcelona, Spain; bLatin American Initiative for Open Data, London, UK; cInstitute of Educational Technology, The Open University, Milton Keynes, UK; dDigital Education, University College London, London, UK; eInterdisciplinary Centre for Studies in Bioethics, University of Chile, Santiago, Chile

Received: 27 May 2020; Revised: 3 August 2020; Accepted: 19 August 2020; Published: 05 October 2020

Abstract

Participation in democracy, in today’s digital and datafied society, requires the development of a series of transversal skills, which should be fostered in higher education (HE) through critically oriented pedagogies that interweave technical data skills and practices together with information and media literacies. If students are to navigate the turbulent waters of data and algorithms, then data literacies must be featured in academic development programmes, thereby enabling HE to lead in the development of approaches to understanding and analysing data, in order to foster reflection on how data are constructed and operationalised across societies, and provide opportunities to learn from the analysis of data from a range of sources. The key strategy proposed is to adopt the use of open data as open educational resources in the context of problem and research-based learning activities. This paper introduces a conceptual analysis including an integrative overview of relevant literature, to provide a landscape perspective to support the development of academic training and curriculum design programmes in HE to contribute to civic participation and to the promotion of social justice.

Keywords: critical pedagogy; critical data studies; open education; open data; open government; social justice; civic education; human rights; politics; government; policy; capacity building

*Corresponding author. Email: javiera.atenas@idatosabiertos.org

Research in Learning Technology 2020. © 2020 J. Atenas et al. Research in Learning Technology is the journal of the Association for Learning Technology (ALT), a UK-based professional and scholarly society and membership organisation. ALT is registered charity number 1063519. http://www.alt.ac.uk/. This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material for any purpose, even commercially, provided the original work is properly cited and states its license.

Citation: Research in Learning Technology 2020, 28: 2468 - http://dx.doi.org/10.25304/rlt.v28.2468

Introduction

We live in a ‘datafied’ society where almost everything is continuously transcribed into data, quantified and analysed (Van Es and Schäfer 2017), where decisions taken by corporations and governments are increasingly data- and algorithm-driven. Such data are often said to be ‘collected’ (as if pre-existing, and therefore, simply reflecting reality), but the processes through which data are generated, communicated and represented are neither necessarily transparent nor devoid of negative effects. The promised utopia of Big Data has been revealed as an actual dystopia of Big Brother: data-based ‘surveillance capitalism’ has increasingly been adopted as the leading business model of our information age (Zuboff 2015), and the simultaneous ubiquity and opacity of corporate data practices often have a deliberately ‘chilling’ effect on public critical engagement (Draper and Turow 2019).

According to Dalton, Taylor, and Thatcher (2016), people are often unaware why, how or even that data about themselves are being collected, analysed and ‘shared’ with additional parties. For Ozga (2008) and Ball (2015), the data we produce are used to classify us as individuals, allocating us into categories that define our worth in society, our perceived effectiveness and our potential to pose risks. Using algorithms, our behaviours, successes and failures are then predicted according to the categories in which we have been placed (Harel Ben Shahar 2017; Maull, Godsiff, and Mulligan 2014; Schildkamp, Karbautzki, and Vanhoof 2013; Schouten 2017).

In parallel with monitoring and analytics undertaken by external agencies, people are also now increasingly engaging in ‘voluntary’ digitised self-tracking. This set of practices is currently at the centre of consumer interest and industry attention (Haddadi and Brown 2014) and often referred to under the umbrella of the quantified self. For Lupton (2016), such ‘opt-in’ forms of ‘dataveillance’ are ‘now being used in situations where the choice to participate may be limited’ as ‘self-tracking practices are advocated and implemented in many social contexts and institutions’ (p. 103). Beer (2018) notes that this quantification of labour has been associated with and enabled a new precarity in working conditions. According to Moore (2017), such inequalities are worsened by a widespread lack of access to educational opportunities to understand and challenge datafication, as even higher education (HE) has been relatively uncritical of these phenomena of ruthless quantification.

Fostering critical understanding of data in HE is key, as education has been permeated and transformed by data and data practices, a process that has been described as ‘datafication’ of education (Gilliard 2017; Gulson and Sellar 2019; Lupton and Williamson 2017; Selwyn 2015). In HE, a perceived need to quantify learning has justified an ever-increasing metricisation of student and staff activity, re-casting students, educators and learning activities into roles as data-producers. This datafication of learning is providing a steady diet for learning analytics, one the newest diacatholicons promising to improve and enhance education through personalisation and data-driven interventions (Baker and Inventado 2014; Schouten 2017), at the risk of jeopardising complex and critical student-centred pedagogies (Roberts-Holmes 2015) and potentially coercing digital participation in order to ensure data are gathered (Barassi 2019).

In reference to the collection and analysis of data by HE institutions, Shacklock (2016) worryingly argues:

Growing up in a digital world dominated by Google, Facebook, and Amazon, the current generation of young undergraduate students are used to providing their personal data in return for access to services and products, and perhaps see their relationship with their university in the same light. (p. 38)

This statement is something of a red flag, as being ‘used to’ something neither equate to an informed understanding of data and privacy issues (Draper and Turow 2019; Hargittai and Marwick 2016) nor lend such practices legitimacy.

The case of students in HE illustrates a wider point that the acquisition of critical data literacies has a strong relevance for social justice; without them, opportunities to challenge dominant narratives and to influence and change social circumstances and practices will be curtailed. A data literacy divide will likely widen the gap between privileged and underprivileged groups. While certain groups will be well positioned to participate economically and socially, even becoming decision-makers, those who cannot engage with data may remain or become further marginalised, ultimately only playing the role of data points, to be studied ‘from above’ (Atenas and Havemann 2019; Johnson 2014).

Hood and Margetts (2007) argue that governments operate through two sets of agents: detectors and effectors. Detectors gather information (data) from individuals and society, and effectors seek to influence them. The media and other powerful social actors such as corporations must also be understood to play both detecting and effecting roles in society. In order to understand how various organisations track and attempt to manipulate our habits, conduct, political views and relationships, citizens need to be trained to become detectors and effectors themselves. Educational and citizenship development programmes need to bridge civil society, industry, research and politics, promoting the effective and efficient use of data and information to critically participate in democratic and social dynamics (Rychen and Salganik 2003).

Van Es and Schäfer (2017) note that ‘students need to be educated to become critical data practitioners who are both capable of working with data and of critically questioning the big myths that frame the datafied society’ (p. 12). Therefore, academic capacity building programmes must look beyond data capabilities, and include critical thinking, citizenship and innovation skills (Gray, Gerlitz, and Bounegru 2018; Van Es and Schäfer 2017), foster skills to evaluate, analyse and interpret data (Prado and Marzal 2013; Schield 2004), and ground teaching and learning in addressing real problems (Atenas and Havemann 2019; Fung 2017), to understand issues such as commodification, surveillance and privacy (Gray 2016; Kellner and Share 2009; Matthews 2016). In light of this, it is crucial that academics and students across disciplines in HE adopt as foundational a critical data studies perspective (Iliadis and Russo 2016). Such an approach can empower students to question the ethics, structures and economics of data use, and fundamentally, the apparent inevitability of the surveillance and datafication of all aspects of daily life.

In order for students to appreciate and critically analyse ‘the societal embeddedness and constructedness of data’ (Richterich 2018, p. 2), we suggest that it is necessary to work with real data. This presents a challenge, as vast swathes of data remain off-limits in terms of public access. However, recent years have seen an increased focus on and demand for availability and transparency of public and research data produced by international organisations, governments, civil society, scientists and research centres. Furthermore, we argue that it is vitally important that students gain literacies for accessing and working with datasets which are not simply openly available, but which make important truth claims about beings and activities in the world. Such datasets are increasingly released as open data, which represent a nexus of challenge, opportunity and responsibility in HE, as open data can be used as open educational resources (OER) to support the development of research data literacies, transparent and open scientific practices, as well as citizenship and critical thinking, regardless of the research field (Atenas and Havemann 2015).

The use of open data as OER is an emergent strand within a wider realm of open educational practices (OEP) (Atenas and Havemann 2015). OEP are a ‘broad descriptor of practices that include the creation, use, and reuse of OER as well as open pedagogies and open sharing of teaching practices’ (Cronin 2017, p. 15), as well as practices which ‘respect and empower learners as co-producers on their lifelong learning path’ (Andrade et al. 2011). Thus, OEP can be an enabler to foster the development of data skills by promoting students working with real problems through a critical engagement with raw and open data (Atenas and Havemann 2015).

Open data can be analysed by students as citizen researchers, empowering them to frame, ask and investigate socially pertinent questions, and thereby better exercise their rights as citizens (Arzberger et al. 2004; Atenas, Havemann, and Priego 2015; Huijboom and van de Broek 2011; Molloy 2011). Open data can be used across and between disciplines, by promoting a critical engagement with the same raw data that researchers, governments, civil society, international organisations and policy-makers generate and use, supporting the development of information, statistical, scientific, media and political literacies, and critical thinking, collaborative and citizenship skills (Atenas, Havemann, and Priego 2015; Johnson 2014; Manca et al. 2017; Markham 2018).

It is also important to foster coherent, holistic institutional strategies and policies in HE to support educators in developing data literacies, as educators need a solid ground upon which to build innovative pedagogical practices (Atenas et al. 2019), which can often be described as OEP as these are catalysts for design and iteration of complex, collaborative, participatory and transparent teaching and learning processes (Atenas et al. 2019; Conole and Ehlers 2010; Cronin 2017; Havemann 2016, 2020; Manca et al. 2017).

Method

To briefly recap the problem as outlined in the introduction, in an increasingly digital and datafied society, data are often accorded the status of objective fact, despite its constructed, partial and biased nature. Algorithms drawing upon data are used to profile members of society and make crucial decisions which likely disproportionately impact those with less privilege and resources at their disposal. Students entering HE are not necessarily aware of, let alone equipped to research, understand and analyse the resulting issues. Therefore, educators in HE should be supported in embedding the development of transversal data literacies, including both data practices and criticality, into curricula.

While we contend that an approach grounded in the use of open data as OER (Atenas and Havemann 2015, 2019) remains a key strategy, here we are seeking to expand the discussion of how and what students can learn through such critical open data studies, and propose that this question can only be effectively approached from multiple angles of analysis. The purposes of this discussion are as follows: first, to raise awareness of the need for critical data literacies (Markham 2018); second, to highlight the significance and relevance of openly available, real data for educational purposes; and third, to suggest strategies for fostering data literacies and practices that can be adapted for local and disciplinary contexts.

As authors we began by drawing upon some of the diverse disciplinary contexts we are collectively versed in: information, digital and media literacies, digital and open education, open data and applied philosophy. In order to scope the vast size of the potentially relevant literature dataset, we conducted a search using Google Scholar, which has been found to index a wider number of sources than other scholarly databases across a range of disciplines (Martín-Martín, Orduna-Malea, and Delgado López-Cózar 2018). The search terms used and resulting number of records retrieved were ‘data literacy’ (9860), ‘open data’ (255 000), ‘media literacy’ (146 000), ‘critical data studies’ (1230), ‘datafication’ (8710), ‘digital citizenship’ (16 900) and ‘education data’ (150 000).

It became clear to us that an emerging topic, such as the focus of this study, does not lend itself to a ‘systematic’ review of existing literature, instead requiring a more ‘open’, exploratory and interdisciplinary approach. Indeed, there is not, as yet, an extensive body of literature reporting on the outcomes of such activities to be reviewed; rather, we draw on a range of fields for guidance and inspiration in order to consider relevant arguments and evidence available to support the proposed approach. Our review of relevant literature is therefore better understood as exploratory or integrative in nature (Souza, Silva, and Carvalho 2010). As Torraco (2016) notes, integrative reviews address ‘new or emerging topics that would benefit from a holistic conceptualization and synthesis’ (p. 410).

The need for critical data literacies

The key educational challenge presented by the datafied society is an urgent requirement for transversal data literacies amongst educators and learners (Mandinach and Gummer 2013; Prado and Marzal 2013; Schield 2004; Stephenson and Schifter Caravello 2007). Drawing upon Foucault (1980), Giroux (2010) calls for an education which develops and improves people’s abilities to recognise and challenge power dynamics, enabling them to become a committed and critical citizenry, which is able to expand and deepen their participation in the promise of substantive democracies. To become such active citizens, people must develop transversal skills (UNESCO 2016), which are a comprehensive set of abilities for living and working, such as critical thinking and information, data, media and political literacies (Atenas, Havemann, and Priego 2015), to facilitate a long-term democratic commitment (Dudley and Gitelson 2010).

The technical and intellectual tools required to discover, interrogate and interpret datasets are neither widely nor equitably distributed throughout society, despite these being key to enable ‘active citizen participation in public decision processes, for influencing public policies and for social action’ (Engel 2017, p. 44). Failure to learn how to understand, analyse and challenge, data will result in citizens being in a continuously increasing position of informational disadvantage in relation to socio-political and commercial actors. Consequently, data literacy education needs to address a broad vision of data as social as well as technical assemblages, which include all of the ‘technological, political, social and economic apparatuses and elements’ that constitute and frame its production and use (Kitchin and Lauriault 2014, p. 6).

HE has traditionally played a key role in fostering data literacies and practices, but the current moment appears to require a renewed focus on these, which we suggest should be critically oriented and across disciplines. Meanwhile, the open data movement has argued for public data, in particular, to be made accessible and open for public interrogation to ensure transparency and accountability, but as Johnson (2014) argues, the fact that such datasets are openly licensed does not ensure that they come without the problems of reproduction of socially embedded biases; thus, it is a key to foster data capabilities amidst groups and individuals who might wish or need to analyse it, which clearly includes educators and students in HE.

This points to a need for curriculum design, which expressly links the interrogation of data with the possibility of socio-political action. Critical, socially engaged data literacy education can support the realisation of three ideals of social justice: (1) the right to self-determination, which requires the ability to make an informed decision, (2) the right to participate in science and cultural life, which in turn needs access to data for its full realisation and (3) contributive justice, to facilitate an environment that encourages the use and development of individual and community capabilities (Timmermann 2014, 2017).

Academic development on critical data pedagogies

Fostering data literacies within HE requires interdisciplinary pedagogical efforts to design learning activities using problem- and research-based learning approaches (Atenas, Havemann, and Priego 2015; Maybee and Zilinski 2015; Raffaghelli 2018). For Mandinach and Gummer (2013), educators’ data literacy is ‘the ability to understand and use data effectively to inform decisions … composed of a specific skill set and knowledge base that enables educators to transform data into information and ultimately into actionable knowledge’ (p. 30).

Ebbeler et al. (2016) suggest that academic development must be grounded on collaborative learning and in solving problems, which should emerge from the educators’ own interests but that requires the support and active involvement of colleagues. Wayman and Jimerson (2014) argue that training for academics in data literacies needs to be contextual, coherent, resourced and sustainable, while Coburn and Turner (2016) emphasise the importance of providing expert guidance to help educators to develop data-led activities. Mandinach and Gummer (2016) suggest a data-driven workflow with five components: (1) identify problems and frame questions through data; (2) retrieve data; (3) transform data into information; (4) transform information into decision; (5) evaluate outcomes.

Educators’ data literacies can be developed to inform professional practices, including teaching and research evaluation (Rodés, Gewerc-Barujel, and Llamas-Nistal 2019). For Dunlap and Piro (2016), data literate educators can design effective data-based learning activities. According to Kippers et al. (2018), these educators are well placed to help learners to consciously collect and analyse data to construct knowledge; therefore, training programmes should foster research on pedagogical practices towards implementing data literacy activities whose impact can be assessed (Izadinia 2014; Phuong, Cole, and Zarestky 2017).

Halverson et al. (2007) propose to train educators in data projects with dynamics they can extrapolate to their courses, connecting data to support evidence-based approaches for teaching and learning, including activities such as data challenges, considering the guidelines of Piety, Court, and Hickey (2014) who suggest that data-led activities should include elements of ethics, privacy and information architecture.

Innovation in curriculum design: open data as OER

Open pedagogies, media education and data literacy, need to enable students to become data intermediaries (Davies and Edwards 2012; Magalhaes, Roseira, and Strover 2013), thereby making a positive impact on democracy. The adoption of open data as OER (Atenas and Havemann 2015, 2019; Coughlan 2019) could form a strong basis to raise awareness of socio-political issues, promoting learning through critical thinking, which Brookfield (1987) describes in three phases: (1) determine the hypothesis that guides decisions and actions; (2) verify the accuracy of these assumptions by analysing perspectives, data and information; (3) make informed decisions based on evidence and research.

Understanding data requires the development of a range of skills, and curricular design for fostering data literacies must therefore be carefully planned as these tend to be addressed primarily in terms of technical competencies underlying academic information skills (Weinert 2001), but according to Maybee and Zilinski (2015), data literacies can be better understood through a seven axis framework that includes: (1) Awareness: understanding data and its role in the society; (2) Access: understanding how to identify, locate and appropriately use structured data in datasets and databases; (3) Engagement: evaluate, analyse, organise and interpret data to make evidence-based decisions; (4) Management: organise and manage data; (5) Communication: synthesise and create visualisations and representations; (6) Data Ethics: identify diversified data sources, considering the risks of managing such data and the issues implicit in the use of data; (7) Preservation: awareness of long-term practices of storing, using and reusing data.

Critical data literacy approaches need to encompass how-to skills such as data analysis, curation, management, mining and visualisation (Gascó-Hernández et al. 2018) while also engaging with related critical, statistical, political, and media literacies, such as statistical, political, media and data. Statistical literacy is, for Wallman (1993), Schield (2004) and Mandinach and Gummer (2013), the ability to understand and use data effectively for decision-making.

For statistical literacy to be fruitful for citizenship, it needs to be complemented with political literacy, so people learn the basic principles and concepts of democracy and understand the functions and mechanisms of political institutions, as well as common legal language and concepts (De-Shalit 2004; Dudley and Gitelson 2010; Timmermann 2017; Wszalek 2017). To complement statistical and political literacies, citizens require media literacy to access, analyse, evaluate and create information in a wide variety of formats (Aufderheide 1993; Buckingham 2003; Jenkins 2006; Kahne, Lee, and Feezell 2012), and to critically evaluate the information presented in the press and social media networks (Culver and Jacobson 2012; Kellner and Share 2009; Littlejohn, Beetham, and McGill 2012). Furthermore, data literacies programmes need to include elements of critical thinking and research skills to foster public participation (Shirk et al. 2012), using open data in collaborative and multidisciplinary activities (Purwanto, Zuiderwijk, and Janssen 2018) to foster active participation and understanding of democratic issues at national and global level (Olssen 2004).

Davies (2010) states that in the future there will be a greater need for data capabilities in society to debate the meaning of data, and to find responsible ways of using open data. For Gurstein (2011), that the current trend towards public data transparency can create democratic opportunities to use open data for teaching and learning, which can help students to understand social problems and, according to Baack (2015), embrace the idea of open participation (Baack 2015). However, as Johnson (2014) notes, open data alone cannot promote social justice, as it can marginalise those who cannot engage with data effectively, rendering them objects of study.

A critical approach to data literacies must aim to empower educators and learners to be co-producers of knowledge (Andrade et al. 2011; Conole and Ehlers 2010; Cronin 2017; Orr, Rimini, and van Damme 2015), that can be supported with the use of open data to study authentic problems in society (Kasl, Marsick, and Dechant 1997; Piorun et al. 2012), in a collaborative manner with a focus on evaluating information presented in a wide range of media and formats (Barron et al. 1998; Hmelo-Silver 2004) and to foster politically responsible decisions through the understanding of democratic and social processes (Atenas and Havemann 2019; Davies 2010). Strategies to foster pedagogic innovation leveraging open data can enable them to participate as citizens (Baack 2015; Buttiglione and Reggi 2015; Huijboom and van den Broek 2011; Mellouli, Luna-Reyes, and Zhang 2014; Reggi and Dawes 2016).

Discussion and conclusions

The socially responsible role of HE in democracies must not only be to develop competencies for the labour market but also to be agents of social change, and most importantly, become open arenas to foster social participation through inculcation of transversal skills. Universities are key drivers to foster data literacies and must enable students and educators to challenge biased metrics, unethical uses of data, violations of privacy and the interaction of the datafied society with the quantified self.

Academic development programmes in data literacies need to include a wide range of perspectives, issues and challenges, as we have elucidated from the literature, including emergent components such as:

Data ethics can be understood as the morally responsible uses of data, caring for people and society adhering to the principles of human rights and personal data protection.

Data politics encompasses the political aspects of data including ways in which data are collected, accessed and displayed by the governments, and how these data are used to foster participation and policy making.

Data governance can be understood as the policies and regulations in place for deploying and presenting data in regards with its accessibility, usability, integrity and security-based data standards, norms and laws.

Data management is the process of acquiring, validating, storing, protecting and processing data, in order to ensure its accessibility, usability, integrity, security, reliability and timeliness, and to enable users to search, retrieve, appraise, assess, mine, prepare and clean for analysis.

Data analysis is the processes and methods in which data are collected, organised, assessed and studied to obtain and extract useful information from it.

Data narratives are methods such as data journalism techniques and data storytelling that provide an innovative yet rigorous way to communicate research beyond scientific and technical endeavours in an accessible way to inform wider audiences.

Data visualisation is the process of transforming data into visual models to make information understandable and informing to support decision-making or comprehension of processes and phenomena.

These elements have the potential to (1) seek to embed political, media and statistical literacies and to develop transversal skills for lifelong learning; (2) enable students to understand and critically analyse information and data from media and government sources; (3) situate learners as critically engaged data intermediaries who are empowered to act as social detectors and effectors in the service of social justice and democratic values.

Owing to their dual education and research mission, universities and academics are well placed among social institutions to support young citizens to develop the necessary critical literacies to ensure widespread democratic participation and social justice (Timmermann 2018); but while our focus here is on the role of HE in fostering literacies for democratic citizenship, it is important to keep in mind that universities are only one of the many groups of social actors that need to be mobilised for such efforts. Educators should also consider how they and their students might engage wider audiences in such debates through OEP.

A true democracy demands universal participation, and active efforts need to be made to tackle the problems of discrimination and adaptive preferences; therefore, bridging the data divide requires substantial efforts to reach all citizens (Schoonmaker 2018; Warschauer 2011). Working towards social justice will be a lengthy endeavour, but one place universities and educators can start is with critical pedagogies and curricular design, which give students the tools to disentangle the processes, values and power behind data.

References

Andrade, A., et al., (2011) Beyond OER: Shifting Focus from Resources to Practices, University of Duisburg-Essen, Duisburg-Essen, [online] Available at: https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/OPAL2011.pdf

Arzberger, P., et al., (2004) ‘Promoting access to public research data for scientific, economic, and social development’, Data Science Journal, vol. 3 (November), pp. 135–152. doi: 10.2481/dsj.3.135

Atenas, J. & Havemann, L. (eds) (2015) Open Data as Open Educational Resources: Case Studies of Emerging Practice, Open Knowledge, Open Education Working Group – Universities UK, London. doi: 10.6084/m9.figshare.1590031

Atenas, J. & Havemann, L. (2019) ‘Open data and education’, in The State of Open Data: Histories and Horizons, eds T. Davies, S. Walker, M. Rubinstein & F. Perini, African Minds and IRDC, Cape Town. doi: 10.5281/zenodo.2677851

Atenas, J., Havemann, L. & Priego, E. (2015) ‘Open data as open educational resources: towards transversal skills and global citizenship’, Open Praxis, vol. 7, no. 4, pp. 377–389. doi: 10.5944/openpraxis.7.4.233

Atenas, J., et al., (2019) ‘Fostering openness in education: considerations for sustainable policy-making’, Open Praxis, vol. 11, no. 2, pp. 167–183. doi: 10.5944/openpraxis.11.2.947

Aufderheide, P. (1993) Media Literacy. A Report of the National Leadership Conference on Media Literacy, Aspen Institute, Washington, DC, [online] Available at: https://files.eric.ed.gov/fulltext/ED365294.pdf

Baack, S. (2015) ‘Datafication and empowerment: how the open data movement re-articulates notions of democracy, participation, and journalism’, Big Data and Society, vol. 2, no. 2, pp. 1–11. doi: 10.1177/2053951715594634

Baker, R. S. & Inventado, P. S. (2014) ‘Educational data mining and learning analytics’, in Learning Analytics: From Research to Practice, eds J. A. Larusson & B. White, Springer, New York, pp. 61–75. doi: 10.1007/978-1-4614-3305-7_4

Ball, S. J. (2015) ‘Education, governance and the tyranny of numbers’, Journal of Education Policy, vol. 30, no. 3, pp. 299–301. doi: 10.1080/02680939.2015.1013271

Barassi, V. (2019). Coerced Digital Participation, Child Data Citizen, [online] Available at: http://childdatacitizen.com/coerced-digital-participation/

Barron, B. J., et al., (1998) ‘Doing with understanding: lessons from research on problem-and project-based learning’, Journal of the Learning Sciences, vol. 7, no. 3–4, pp. 271–311. doi: 10.1080/10508406.1998.9672056

Beer, D. (2018) ‘The quantified self in precarity: work, technology and what counts’, Information, Communication & Society, vol. 21 no. 12, pp. 1779–1784. doi: 10.1080/1369118X.2018.1442489

Brookfield, S. (1987) Developing Critical Thinkers, Open University Press, Milton Keynes.

Buckingham, D. (2003) Media Education: Literacy, Learning and Contemporary Culture, Polity Press, Cambridge.

Buttiglione, P. L. & Reggi, L. (2015) ‘Il monitoraggio civico delle politiche di coesione e lo sviluppo di comunità civiche’, PRISMA Economia-Società-Lavoro, vol. 17, pp. 81–97. doi: 10.3280/PRI2015-001007

Coburn, C. E. & Turner, E. O. (2016) ‘The practice of data use: an introduction’, American Journal of Education, vol. 118, no. 2, pp. 99–111. doi: 10.1086/663272

Conole, G. C. & Ehlers, U. D. (2010) Open Educational Practices: Unleashing the Power of OER. UNESCO Workshop on OER, Windhoek, Namibia, [online] Available at: https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/OEP_Unleashing-the-power-of-OER.pdf

Coughlan, T. (2019) ‘The use of open data as a material for learning’, Educational Technology Research and Development, vol. 68, pp. 383–411. doi: 10.1007/s11423-019-09706-y

Cronin, C. (2017) ‘Openness and praxis: exploring the use of open educational practices in higher education’, The International Review of Research in Open and Distributed Learning, vol. 18, no. 5, pp. 15–34. doi: 10.19173/irrodl.v18i5.3096

Culver, S. & Jacobson, T. (2012) ‘Media literacy and its use as a method to encourage civic engagement’, Revista Comunicar, vol. 20, no. 39, pp. 73–80. doi: 10.3916/C39-2012-02-07

Dalton, C. M., Taylor, L. & Thatcher, J. (2016) ‘Critical data studies: a dialog on data and space’, Big Data and Society, vol. 3, no. 1, pp. 1–9. doi: 10.1177/2053951716648346

Davies, T. (2010) Open Data, Democracy and Public Sector Reform. A Look at Open Government Data Use from data.gov.uk, [online] Available at: http://www.opendataimpacts.net/report/wp-content/uploads/2010/08/How-is-open-government-data-being-used-in-practice.pdf

Davies, T. & Edwards, D. (2012) ‘Emerging implications of open and linked data for knowledge sharing in development’, IDS Bulletin, vol. 43, no. 5, pp. 117–127. doi: 10.1111/j.1759-5436.2012.00372.x

De-Shalit, A. (2004) ‘Political philosophy and empowering citizens’, Political Studies, vol. 52, no. 4, pp. 802–818. doi: 10.1111/j.1467-9248.2004.00509.x

Draper, N. A. & Turow, J. (2019) ‘The corporate cultivation of digital resignation’, New Media and Society, vol. 21, no. 8, pp. 1824–1839. doi: 10.1177/1461444819833331

Dudley, R. L. & Gitelson, A. R. (2010) ‘Political literacy, civic education, and civic engagement: a return to political socialization?’, Applied Developmental Science, vol. 6, no. 4, pp. 175–182. doi: 10.1207/S1532480XADS0604_3

Dunlap, K. & Piro, J. S. (2016) ‘Diving into data: developing the capacity for data literacy in teacher education’, Cogent Education, vol. 3, no. 1. doi: 10.1080/2331186X.2015.1132526

Ebbeler, J., et al., (2016) ‘The effects of a data use intervention on educators’ satisfaction and data literacy’, Educational Assessment, Evaluation and Accountability, vol. 29, no. 1, pp. 83–105. doi: 10.1007/s11092-016-9251-z

Engel, J. (2017) ‘Statistical literacy for active citizenship: a call for data science education’, Statistics Education Research Journal, vol. 16, no. 1, pp. 44–49, [online] Available at: https://iase-web.org/documents/SERJ/SERJ16(1)_Engel.pdf

Foucault, M. (1980) Power/Knowledge: Selected Interviews and Other Writings 1972–1977, Harvester Press, London.

Fung, D. (2017) A Connected Curriculum for Higher Education, UCL Press, London. doi: 10.14324/111.9781911576358

Gascó-Hernández, M., et al., (2018) ‘Promoting the use of open government data: cases of training and engagement’, Government Information Quarterly, vol. 35, no. 2, pp. 233–242. doi: 10.1016/j.giq.2018.01.003

Gilliard, C. (2017). ‘Pedagogy and the logic of platforms’, Educause Review, July/August, [online] Available at: https://er.educause.edu/articles/2017/7/pedagogy-and-the-logic-of-platforms

Giroux, H. (2010) ‘Rethinking education as the practice of freedom: Paulo Freire and the promise of critical pedagogy’, Policy Futures in Education, vol. 8, no. 6, pp. 715–721. doi: 10.2304/pfie.2010.8.6.715

Gray, J. (2016) ‘Datafication and democracy: recalibrating digital information systems to address broader societal interests’, Juncture, vol. 23, no. 3, pp. 197–201. doi: 10.1111/newe.12013

Gray, J., Gerlitz, C. & Bounegru, L. (2018) ‘Data infrastructure literacy’, Big Data and Society, vol. 5, no. 2, pp. 1–13. doi: 10.1177/2053951718786316

Gulson, K. N. & Sellar, S. (2019) ‘Emerging data infrastructures and the new topologies of education policy’, Environment and Planning D: Society and Space, vol. 37, no. 2, pp. 350–366. doi: 10.1177/0263775818813144

Gurstein, M. B. (2011) ‘Open data: empowering the empowered or effective data use for everyone?’, First Monday, vol. 16. doi: 10.5210/fm.v16i2.3316

Haddadi, H. & Brown, I. (2014) ‘Quantified self and the privacy challenge’, Technology Law Futures, vol. 6, [online] Available at: https://haddadi.github.io/papers/qselfprivacy2014.pdf

Halverson, R., et al., (2007) ‘The new instructional leadership: creating data-driven instructional systems in school’, Journal of School Leadership, vol. 17, no. 2, pp. 159–194. doi: 10.1177/105268460701700202

Harel Ben Shahar, T. (2017) ‘Educational justice and big data’, Theory and Research in Education, vol. 15, no. 3, pp. 306–320. doi: 10.1177/1477878517737155

Hargittai, E. & Marwick, A. (2016) ‘What can I really do? Explaining the privacy paradox with online apathy’, International Journal of Communication, vol. 10, pp. 3737–3757, [online] Available at: https://ijoc.org/index.php/ijoc/article/view/4655

Havemann, L. (2016) ‘Open educational resources’, in Encyclopedia of Educational Philosophy and Theory, ed M. A. Peters, Springer, Singapore, [online] Available at: http://oro.open.ac.uk/56383/1/Havemann-OpenEducationalResources-EEPAT-ms.pdf

Havemann, L. (2020) ‘Open in the evening: openings and closures in an ecology of practices’, in Open(ing) Education: Theory and Practice, eds D. Conrad & P. Prinsloo, Brill Sense, Leiden, Netherlands, pp. 329–344. doi: 10.1163/9789004422988_015

Hmelo-Silver, C. E. (2004) ‘Problem-based learning: what and how do students learn?’, Educational Psychology Review, vol. 16, pp. 235–266. doi: 10.1023/B:EDPR.0000034022.16470.f3

Hood, C. C. & Margetts, H. Z. (2007) The Tools of Government in the Digital Age, 2nd edn, Palgrave Macmillan, London.

Huijboom, N. & van de Broek, T. (2011) ‘Open data: an international comparison of strategies’, European Journal of EPractice, vol. 12, no. 1, pp. 1–13, [online] Available at: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.465.2613&rep=rep1&type=pdf

Iliadis, A. & Russo, F. (2016) ‘Critical data studies: an introduction’, Big Data and Society, vol. 3, no. 2, pp. 1–7. doi: 10.1177/2053951716674238

Izadinia, M. (2014) ‘Teacher educators’ identity: a review of literature’, European Journal of Teacher Education, vol. 37, no. 4, pp. 37–41. doi: 10.1080/02619768.2014.947025

Jenkins, H. (2006) Convergence Culture: Where Old and New Media Collide, New York University Press, New York.

Johnson, J. A. (2014) ‘From open data to information justice’, Ethics and Information Technology, vol. 16, no. 4, pp. 263–274. doi: 10.1007/s10676-014-9351-8

Kahne, J., Lee, N. & Feezell, J. (2012) ‘Digital media literacy education and online civic and political participation’, International Journal of Communication, vol. 6, pp. 1–24, [online] Available at: http://ijoc.org/index.php/ijoc/article/view/999

Kasl, E., Marsick, V. J. & Dechant, K. (1997) ‘Teams as learners a research-based model of team learning’, The Journal of Applied Behavioral Science, vol. 33, no. 2, pp. 227–246. doi: 10.1177/0021886397332010

Kellner, D. & Share, J. (2009) ‘Critical media literacy, democracy, and the reconstruction of education’, in Media Literacy: A Reader, eds D. Macedo & S. R. Steinberg, Peter Lang, New York, pp. 3–23.

Kippers, W. B., et al., (2018) ‘Studies in educational evaluation data literacy: what do educators learn and struggle with during a data use intervention?’, Studies in Educational Evaluation, vol. 56, pp. 21–31. doi: 10.1016/j.stueduc.2017.11.001

Kitchin, R. & Lauriault, T. P. (2014) ‘Towards critical data studies: charting and unpacking data assemblages and their work’, The Programmable City Working Paper, vol. 2, [online] Available at: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2474112

Littlejohn, A., Beetham, H. & McGill, L. (2012) ‘Learning at the digital frontier: a review of digital literacies in theory and practice’, Journal of Computer Assisted Learning, vol. 28, no. 6, pp. 547–556. doi: 10.1111/j.1365-2729.2011.00474.x

Lupton, D. (2016) ‘The diverse domains of quantified selves: self-tracking modes and dataveillance’, Economy and Society, vol. 45, no. 1, pp. 101–122. doi: 10.1080/03085147.2016.1143726

Lupton, D. & Williamson, B. (2017) ‘The datafied child: the dataveillance of children and implications for their rights’, New Media & Society, vol. 19, no. 5, pp. 780–794. doi: 10.1177/1461444816686328

Magalhaes, G., Roseira, C. & Strover, S. (2013) ‘Open government data intermediaries: a terminology framework’, in Proceedings of the 7th International Conference on Theory and Practice of Electronic Governance, eds T. Janowski, J. Holm & E. Estevez, Association for Computing Machinery, New York, pp. 330–333. doi: 10.1145/2591888.2591947

Manca, A., Atenas, J., Ciociola, C., & Nascimbeni, F. (2017) ‘Critical pedagogy and open data for educating towards social cohesion Pedagogia critica e dati aperti come mezzi per educare alla coesione sociale’. Tecnologie Didattiche, vol 25 no. 1, pp. 111–115. doi: 10.17471/2499-4324/917

Mandinach, E. B. & Gummer, E. S. (2013) ‘A systemic view of implementing data literacy in educator preparation’, Educational Researcher, vol. 42, no. 1, pp. 30–37. doi: 10.3102/0013189X12459803

Mandinach, E. B. & Gummer, E. S. (2016) ‘What does it mean for teachers to be data literate: laying out the skills, knowledge, and dispositions’, Teaching and Teacher Education, vol. 60, pp. 366–376. doi: 10.1016/j.tate.2016.07.011

Markham, A. N. (2018) ‘Critical pedagogy as a response to datafication’, Qualitative Inquiry, vol. 25, no. 8, pp. 754–760. doi: 10.1177/1077800418809470

Martín-Martín, A., Orduna-Malea, E. & Delgado López-Cózar, E. (2018) ‘Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison’, Scientometrics, vol. 116, pp. 1–14. doi: 10.1007/s11192-018-2820-9

Matthews, P. (2016) ‘Data literacy conceptions, community capabilities’, The Journal of Community Informatics, vol. 12, no. 3, [online] Available at: http://www.ci-journal.net/index.php/ciej/article/view/1348

Maull, R., Godsiff, P. & Mulligan, C. E. A. (2014) ‘The impact of datafication on service systems’, in Proceedings of the 47th Annual Hawaii International Conference on System Sciences, IEEE, Waikoloa, pp. 1193–1201. doi: 10.1109/HICSS.2014.154

Maybee, C. & Zilinski, L. (2015) ‘Data informed learning: a next phase data literacy framework for higher education’, Proceedings of the Association for Information Science and Technology, vol. 52, no. 1, pp. 1–4. doi: 10.1002/pra2.2015.1450520100108

Mellouli, S., Luna-Reyes, L. F. & Zhang, J. (2014) ‘Smart government, citizen participation and open data’, Information Polity, vol. 19, pp. 1–4. doi: 10.3233/IP-140334

Molloy, J. C. (2011) ‘The open knowledge foundation: open data means better science’, PLoS Biology, vol. 9, no. 12, pp. 1–4. doi: 10.1371/journal.pbio.1001195

Moore, P. V. (2017) The Quantified Self in Precarity: Work, Technology and What Counts, Routledge, New York.

Olssen, M. (2004) ‘Democracy: challenges for education’, Globalisation, Societies and Education, vol. 2, no. 2, pp. 231–275. doi: 10.1080/14767720410001733665

Orr, D., Rimini, M. & van Damme, D. (2015) Open Educational Resources: A Catalyst for Innovation, OECD Publishing, Paris. doi: 10.1787/9789264247543-en

Ozga, J. (2008) ‘Governing knowledge: research steering and research quality’, European Educational Research Journal, vol. 7, no. 3, pp. 261–272. doi: 10.2304/eerj.2008.7.3.261

Phuong, T. T., Cole, S. C. & Zarestky, J. (2017) ‘A systematic literature review of faculty development for teacher educators’, Higher Education Research and Development, vol. 37, no. 2, pp. 1–17. doi: 10.1080/07294360.2017.1351423

Piety, P. J., Court, C. & Hickey, D. T. (2014) ‘Educational data sciences – framing emergent practices for analytics of learning, organizations, and systems’, in LAK Conference, IN, [online] Available at: http://edinfoconnections.com/wp-content/uploads/2014/01/Educational-Data-Sciences-Feb-9.pdf

Piorun, M. E., et al., (2012) ‘Teaching research data management: an undergraduate/graduate curriculum’, Journal of eScience Librarianship, vol. 1, no. 1, pp. 46–50. doi: 10.7191/jeslib.2012.1003

Prado, J. & Marzal, M. A. (2013) ‘Incorporating data literacy into information literacy programs: core competencies and contents’, Libri, vol. 63, no. 2, pp. 123–134. doi: 10.1515/libri-2013-0010

Purwanto, A., Zuiderwijk, A. & Janssen, M. (2018) ‘Group development stages in open government data engagement initiatives: a comparative case studies analysis’, in Electronic Government. EGOV 2018. Lecture Notes in Computer Science, vol. 11020, eds P. Paryceket al. , Springer, Cham, pp. 48–59. doi: 10.1007/978-3-319-98690-6_5

Raffaghelli, J. E. (2018) ‘Open data for learning: a case study in higher education’, in EDEN Conference 2018, Genoa, eds A. Volungeviciene & A. Szűcs, pp. 178–190, [online] Available at: https://www.academia.edu/36926390/OPEN_DATA_FOR_LEARNING_A_CASE_STUDY_IN_HIGHER_EDUCATION

Reggi, L. & Dawes, S. (2016) ‘Open government data ecosystems: linking transparency for innovation with transparency for participation and accountability’, Lecture Notes in Computer Science, vol. 9820, pp. 74–86. doi: 10.1007/978-3-319-44421-5_6

Richterich, A. (2018) The Big Data Agenda: Data Ethics and Critical Data Studies, University of Westminster Press, London. doi: 10.16997/book14

Roberts-Holmes, G. (2015) ‘The “datafication” of early years pedagogy: “if the teaching is good, the data should be good and if there’s bad teaching, there is bad data”’, Journal of Education Policy, vol. 30, no. 3, pp. 302–315. doi: 10.1080/02680939.2014.924561

Rodés, V., Gewerc-Barujel, A., & Llamas-Nistal, M. (2019) ‘University Teachers and Open Educational Resources: Case Studies from Latin America’. The International Review of Research in Open and Distributed Learning, vol. 20, no. 1 doi: 10.19173/irrodl.v20i1.3853

Rychen, D. S. & Salganik, L. H. (2003) ‘Key competencies for a successful life and a well-functioning society’, in OECD Definition and Selection of Competencies Final Report, eds OECD, pp. 1–20, [online] Available at: http://www.oecd.org/pisa/35070367.pdf

Selwyn, N. (2015) ‘Data entry: towards the critical study of digital data and education’, Learning, Media and Technology, vol. 40, no. 1, pp. 64–82. doi: 10.1080/17439884.2014.921628

Schield, M. (2004). ‘Information literacy, statistical literacy and data literacy’, IASSIST Quarterly, vol. 28, no. 2–3, pp. 6–11, [online] Available at: https://iassistquarterly.com/public/pdfs/iqvol282_3shields.pdf

Schildkamp, K., Karbautzki, L. & Vanhoof, J. (2013) ‘Studies in educational evaluation exploring data use practices around Europe: identifying enablers and barriers’, Studies in Educational Evaluation, vol. 42, pp. 15–24. doi: 10.1016/j.stueduc.2013.10.007

Schoonmaker, S. (2018) Free Software, the Internet, and Global Communities of Resistance: Hacking the Global, Routledge, New York.

Schouten, G. (2017) ‘On meeting students where they are: teacher judgment and the use of data in higher education’, Theory and Research in Education, vol. 15, no. 3, pp. 321–338. doi: 10.1177/1477878517734452

Shacklock, X. (2016) From Bricks to Clicks – The Potential of Data and Analytics in Higher Education, eds L. Norton & S. Porter, Higher Education Commission, London, [online] Available at: http://www.policyconnect.org.uk/hec/sites/site_hec/files/report/419/fieldreportdownload/frombrickstoclicks-hecreportforweb.pdf

Shirk, J., et al., (2012) ‘Public participation in scientific research: a framework for deliberate design’, Ecology and Society, vol. 17, no. 2. doi: 10.5751/ES-04705-170229

Souza, M. T. D., Silva, M. D. D. & Carvalho, R. D. (2010) ‘Integrative review: what is it? How to do it?’, Einstein, vol. 8, no. 1, pp. 102–106. doi: 10.1590/s1679-45082010rw1134

Stephenson, E. & Schifter Caravello, P. (2007) ‘Incorporating data literacy into undergraduate information literacy programs in the social sciences: a pilot project’, Reference Services Review, vol. 35, no. 4, pp. 525–540. doi: 10.1108/00907320710838354

Timmermann, C. (2014) ‘An assessment of prominent proposals to amend intellectual property regimes using a human rights framework’, Revista la Propiedad Inmaterial, vol. 18, p. 221, [online] Available at: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2535830

Timmermann, C. (2017) ‘Language impairment and legal literacy: is a degree of perfectionism unavoidable?’, AJOB Neuroscience, vol. 8, no. 1, pp. 43–45. doi: 10.1080/21507740.2017.128582

Timmermann, C. (2018) ‘Contributive justice: an exploration of a wider provision of meaningful work’, Social Justice Research, vol. 31, no. 1, pp. 85–111. doi: 10.1007/s11211-017-0293-2

Torraco, R. J. (2016) ‘Writing integrative literature reviews: using the past and present to explore the future’, Human Resource Development Review, vol. 15, no. 4, pp. 404–428. doi: 10.1177/1534484316671606.

UNESCO. (2016) Assessment of Transversal Competencies: Policy and Practice in the Asia-Pacific Region, UNESCO, Paris, [online] Available at: http://unesdoc.unesco.org/images/0024/002465/246590E.pdf

Van Es, K. & Schäfer, M. T. (eds). (2017) The Datafied Society: Studying Culture through Data, Amsterdam University Press, Amsterdam, [online] Available at: http://www.oapen.org/search?identifier=624771

Wallman, K. K. (1993) ‘Enhancing statistical literacy: enriching our society’, Journal of the American Statistical Association, vol. 88, no. 421, pp. 1–8. doi: 10.2307/2290686

Warschauer, M. (2011) ‘A literacy approach to the digital divide’, in Las multialfabetizaciones en el espacio digital, eds M. A. Pereyra, Ediciones Aljibe, Malaga, [online] Available at: http://education.uci.edu/uploads/7/2/7/6/72769947/lit-approach.pdf

Wayman, J. C. & Jimerson, J. B. (2014) ‘Studies in educational evaluation teacher needs for data-related professional learning’, Studies in Educational Evaluation, vol. 42, pp. 1–10. doi: 10.1016/j.stueduc.2013.11.001

Weinert, F. E. (2001) ‘Concept of competence: A conceptual clarification’. In D. S. Rychen & L.H. Salganik (Eds.), Defining and selecting key competencies (pp. 45–65). Hogrefe & Huber Publishers.

Wszalek, J. (2017) ‘Ethical and legal concerns associated with the comprehension of legal language and concepts’, AJOB Neuroscience, vol. 8, no. 1, pp. 26–36. doi: 10.1080/21507740.2017.1285821

Zuboff, S. (2015) ‘Big other: surveillance capitalism and the prospects of an information civilization’, Journal of Information Technology, vol. 30, no. 1, pp. 75–89. doi: 10.1057/jit.2015.5