Four critiques of open data initiatives

by Rob Kitchin

I’ve been a long time supporter of open data and providing analytic tools to citizens to enable evidence-informed participation in public debate.  Since 2006, when it was initially established as the Cross-Border Regional Research Observatory, I have been PI on the All-Island Research Observatory (, a project that provides access to various government datasets in the Republic of Ireland, Northern Ireland and Europe, along with interactive mapping and graphing tools.  The core project team of Justin Gleeson, Aoife Dowling and Eoghan McCarthy have worked hard to leverage datasets out of various agencies and negotiate more favourable licensing terms, add value and insight to these datasets, promote data journalism through collaboration with the Irish Times and Irish Examiner, and provide open access to a couple of thousand datasets through the AIRO datastore.

The arguments concerning the benefits of open data are now reasonably well established and include contentions that open data lead to increased transparency and accountability with respect to public bodies and services; increases the efficiency and productivity of agencies and enhances their governance; promotes public participation in decision making and social innovation; and fosters economic innovation and job and wealth creation (Pollock 2006; Huijboom and Van der Broek 2011; Janssen 2012; Yiu 2012).

What is less well examined are the potential problems affecting, and negative consequences of, open data initiatives.  Consequently, as a provocation for Wednesday’s (Nov 13th, 4-6pm) Programmable City open data event I thought it might be useful to outline four critiques of open data, each of which deserves and demands critical attention: open data lacks a sustainable financial model; promotes a politics of the benign and empowers the empowered; lacks utility and usability; and facilitates the neoliberalisation and marketisation of public services.  These critiques do not suggest abandoning the move towards opening data, but contend that open data initiatives need to be much more mindful of what data are being made open, how data are made available, how they are being used, and how they are being funded.

Funding and sustainability

Because, to date, attention has been largely focused on the supply-side of accessing data and creating open data initiatives, insufficient attention has been paid to the economics of creating sustainably funded initiatives.  Data might be non-rivalrous in nature, meaning that it can distributed for marginal cost but the initial copy needs to be paid for along with on-going data management and customer service (Pollock 2006).  As such, open data might well be a free resource for end-users, but its production and curation is certainly not without significant cost (especially with respect to appropriate technologies and skilled staffing).  In many cases, the data being opened has to date been a major source of revenue for organisations, and in the case of companies, competitive advantage.  A key question, therefore, centres on how open data projects are funded sustainably in the absence of a direct revenue stream?

A number of different models have been suggested (see Ferro and Osella 2013), but it is generally acknowledged that securing a stable financial base is best achieved by direct government subvention.  Here, it is argued that such a subvention will be offset by two factors.  First, open data will produce diverse consumer surplus value, generating significant public goods which are worth the investment of public expenditure.  Second, open data will lead to new innovative products that will create new markets, which in turn will produce additional corporate revenue and tax receipts (Pollock 2008).  These tax receipts will be in excess of additional government costs of opening the data.  This may well be the case with high value datasets such as mapping and transport data, but much less likely with most other datasets.

de Vries et al. (2011) reported that the average apps developer made only $3,000 per year from apps sales, with 80 percent of paid Android apps being downloaded fewer than 100 times.  In addition, they noted that even successful apps, such as MyCityWay which had been downloaded 40 million times, were not yet generating profits.  Instead, venture capitalists are investing in projects with potential whilst a sustainable business model is sought.  Given austerity and cutbacks across governments finding the necessary funds to open data is a challenge.  And yet, the consequences of reductions or fluctuations in the financial base of open data services are likely to be a decline in data quality, responsiveness, innovation, and general performance (Pollock 2008).  At present, the jury is still out on whether opening up all public sector data is economically viable and sustainable, especially in the short term.

Politics of the benign and empowering the empowered

Another consequence of focusing on gaining access to the data, is to ignore the politics of the data themselves, what the data reveals, or how they are used and for whose interests (Shah 2013).  The open data movement largely seeks to present an image of being politically benign and commonsensical, promoting a belief that opening up data is inherently a good thing in and of itself by democratising data.  For others, making data accessible is just one element with respect to the notion of openness.  Just as important are what the data consist of, how they can be used, and how they can create a more just and equitable society.  If open data merely serves the interests of capital by opening public data for commercial re-use and further empowers those who are already empowered and disenfranchises others, then it has failed to make society more democratic and open (Gurstein 2011; Shah 2013).

Implicit in most discussions on open data is that the data is neutral and objective in nature and that everyone has the potential to access and use such data (Gurstein 2011; Johnson 2013).  However, these are not the case.  With respect to open data themselves, as Johnson (2013) contends, a high degree of social privilege and social values are embedded in public sector data with respect to what data are generated relating to whom and what (especially within domains that function as disciplinary systems, such as social welfare and law enforcement), and whose interests are represented within the data set and whose interests are excluded.  As such, value structures are inherent in data sets and these subsequently shape analysis and interpretation and work to propagate injustices and reinforce dominant interests.

Citizens have differential access to the hardware and software required to download and process open data sets, as well as varying levels of skills required to analyze, contextualize and interpret the data (Gurstein 2011).  And even if some groups have the ability to make compelling sense of the data, they do not necessarily have the contacts needed to gain a public voice and influence a debate, or the political skill to take on a well resourced and savvy opponent.  As such, the democratic potential of open data has been overly optimistic, with most users those with high degrees of technical knowledge and an established political profile (McClean 2011).  Indeed, open data can work to further empower the empowered and to reproduce and deepen power imbalances (Gurstein 2011).  An oft-cited example of the latter is the digitization of land records in Karnataka, India, where an open data project, which was promoted as a ‘pro-poor’ initiative, worked to actively disenfranchise the poor by enabling those with financial resources and skills to access previously restricted data and to re-appropriate their lands (Gurstein 2011; Slee 2012; Donovan 2012).  Far from aiding all citizens, in this case open data facilitated a change in land rights and a transfer of wealth from poor to rich.  In other words, opening data does not mean an inherent democratization of data.  Indeed, open data can function as a tool of disciplinary power (Johnson 2013).

Utility and usability

In a study of a number of different open data projects, Helbig et al. (2012) reported that many are too technically focused amounting to “little more than websites linked to miscellaneous data files, with no attention to the usability, quality of the content, or consequences of its use.”  The result is a set of open data sites that operate more as data holdings or data dumps, lacking the qualities expected in a well organised and run data infrastructure such as clean, high quality, validated and interoperable data that comply with data standards and have appropriate metadata and full record sets (associated documentation); preservation, backup and auditing policies;  re-use, privacy and ethics policies; administrative arrangements, management organisation and governance mechanisms; and financial stability and a long term plan of development and sustainability.  Many sites also lack appropriate tools and contextual materials to support data analysis.  Moreover, the data sets released are often low-hanging fruit, consisting of those that are easy to release and contain non-sensitive data that has relatively low utility.  In contrast, data that might be more difficult and demanding to make open, due to issues of sensitivity or because they require more management work to comply with data protection laws, often remain closed (Chignard 2013).

Part of the issue is that many open data sites have been rough and ready responses to an emerging phenomena.  They have been built by enthusiasts and organisations who have little experience of data archiving or the contextual use of the data being opened.  They have been supported and promoted by hackathons and data dives, which reproduce many of these issues.  As McKeon (2013) and Porway (2013) contend, these events, which invite coders and other interested parties to build apps using open data, can do as much harm as good.  Whilst they do focus attention on the data and are good for networking, those doing the coding often have little deep contextual knowledge with regards to what the data refers, belong to a particular demographic that is not reflective of wider society (e.g., young, educated and tech-orientated), and believe that deep structural problems can be resolved by technological solutions.  In other words, they are “built by a micro-community of casual volunteers, not by people with a deep stake in seeing the project succeed” (McKeon 2013).  Further, hackathon created solutions often remain at version 1.0, with little after event follow-up, maintenance or development.

Because of these various teething issues, rather than creating a virtuous cycle, where the release of more and more data sets, in more formats, produces growing use, and therefore the release of more data, as assumed by the open data movement, Helbig et al. (2013) note that many sites have low and declining traffic as they do not encourage use or facilitate users, and are limited by other factors such as data management practices, agency effort and internal politics.  After an initial spark of interest, data use drops quite markedly as the limitations of the data are revealed and users struggle to work out how the data might be profitably analyzed and used.  McClean (2011), for example, notes that analysis arising from open data has had limited impact on political debates, and concludes with respect to COINS (government financial data in the UK), that after “a brief flurry of media interest in mid-2010, in the immediate aftermath of the release, … reports explicitly mentioning COINS are now extremely rare and those members of the press who were most interested obtaining access to it report that it has not proved particularly useful as a driver of journalism.”   Where data are released periodically (e.g., quarterly or annually), usage tends to be cyclical and often tied to specific projects (such as consultancy reports) rather than to have a more consistent pattern of use.  In such cases, Helbig et al. (2012) observed a set of negative or balancing feedback loops slowed the supply of data and use, thus further decreasing usage.  Thus, after some initial ‘quick wins’, the danger is that any virtuous cycle shifts from being positive to negative, and thus the rationale for central government funding of such initiatives is undermined and in due course cut.

Neoliberalisation and marketisation of public services

Jo Bates (2012) argues, “open initiatives such as OGD [open government data] emerge into a historical process, not a neutral terrain.”  As with all political initiatives, the politics of open data are not simply commonsensical or neutral, but rather are underpinned by political and economic ideology.  The open data movement is diverse and made up of a range of constituencies with different agendas and aims, and is not driven by any one party.   However, Bates makes the case that the open data movement, in the UK at least, had little political traction until big business started to actively campaign for open data, and open government initiatives started to fit into programmes of forced austerity and the marketisation of public services.  For her, political parties and business have appropriated the open data movement on “behalf of dominant capitalist interests under the guise of a ‘Transparency Agenda’” (Bates 2012).

In other words, the real agenda of business interested in open data is to get access to expensively produced data for no cost, and thus a heavily subsidised infrastructural support from which they can leverage profit, whilst at the same time removing the public sector from the marketplace and weakening its position as the producer of such data.  Indeed, because the income from data/data services disappears by opening data (which is especially acute in trading funds where data production and management was largely being funded by fees with some public subsidy), public sector bodies are more likely to be forced outsource such services to the private sector on a competitive basis or cede data production to the private sector which they then have to procure (Gurstein 2013).  Here, data services and data derived from public data has to be purchased back by the data creator.  At the same time the data literacy of the organisation is hollowed out.   Moreover, because open data often concerns a body’s own activities, especially when supplemented by key performance indicators, they facilitate public sector reform and reorganisation that promotes a neoliberal, New Public Management ethos and private sector interests (McClean 2011; Longo 2011).

Such processes, Bates (2013) argues, are part of a deliberate political strategy to open up the “provision of almost all public services to competition from private and third sector providers”, with open data about public services enabling “service users to make informed choices within a market for public services based on data-driven applications produced by a range of commercial and non-commercial developers” (original emphasis).  In such cases, the transparency agenda promoted by politicians and businesses is merely a rhetorical discursive device.  If either party was genuinely interested in transparency then it would be equally supportive of the right to information movement (freedom of information) and the work of whistleblowers (Janssen 2012) and also loosening the shackles of intellectual property rights more broadly (Shah 2013).  Instead, governments and businesses are generally resistant to both.


Open data initiatives hold much promise and value.  They are radically altering access to publicly produced data and making new kinds of analysis possible.  They are creating new forms of transparency and accountability, fostering new form of social participation and evidence-informed modes of governance, and promoting innovation and wealth generation.  At the same time, much more critical attention needs to be paid to how open data projects are developing as complex socio-technical systems with diverse stakeholders and agendas.  To date, efforts have concentrated on the political and technical work of establishing open data projects, and not enough on studying these discursive and material moves and their consequences.  As a result, we lack detailed case studies of open data projects in action, the assemblages surrounding and shaping them, and the messy, contingent and relational ways in which they unfold.  It is only through such studies that are more complete picture of open data will emerge, one that reveals both the positive and negatives of such projects, and which will provide answers to more normative questions concerning how they should be implemented and to what ends.

This post is a modified extract from a forthcoming book by Rob Kitchin, The Data Revolution: Big Data, Open Data, Data Infrastructures and Their Consequences (Sage, London).


Bates, J. (2012) “This is what modern deregulation looks like”: Co-optation and contestation in the shaping of the UK’s Open Government Data Initiative.  The Journal of Community Informatics 8(2). (last accessed 6 February 2013)

Bates, J. (2013) Opening up public data.  SPERI Comment.  May 21st. (last accessed 18 September 2013)

Chignard, S. (2013) A brief history of open data.  Paris Tech Review. March 29th. (last accessed 18 Sept 2013)

de Vries, M., Kapff, L., Negreiro Achiaga, M., Wauters, P., Osimo, D., Foley, P., Szkuta, K., O’Connor, J., and Whitehouse, D. (2011) Pricing of Public Sector Information Study (POPSIS). (last accessed 11 August 2013)

Donovan, K. (2012). Seeing like a slum: Towards open, deliberative development. Georgetown Journal of International Affairs, 13(1), 97-104.

Ferro, E. and Osella, M. (2013)  Eight Business Model Archetypes for PSI Re-Use.  “Open Data on the Web” Workshop, 23rd-24th April 2013, Google Campus, Shoreditch, London. (last accessed 13 August 2013)

Gordon-McKeon, S. (2013) Hacking the hackathon. 10th October (last accessed 21 October 2013)

Gurstein, M. (2011) Open data: Empowering the empowered or effective data use for everyone.  First Monday 16(2) (last accessed 6 February 2013)

Gurstein, M. (2013) Should “Open Government Data” be a product or a service (and why does it matter?)  Gurstein’s Community Informatics, 3 February 2013, (last accessed 6 February 2013)

Helbig, N., Cresswell, A.M., Burke, G.B. and Luna-Reyes, L. (2012) The Dynamics of Opening Government Data: A White Paper.  Centre for Technology in Government, State University of New York, Albany.‎

Huijboom, N. and Van der Broek, T. (2011) Open data: an international comparison of strategies European Journal of ePractice Nº 12, March/April. (last accessed 15 August 2013)

Janssen, K. (2012) Open government data: right to information 2.0 or its rollback version? ICRI Working Paper 8/2012 (last accessed 14 August 2013)

Johnson, J.A. (2013)  From open data to information justice. Paper presented at the Annual Conference of the Midwest Political Science Association April 13, 2013, Chicago, Illinois.  (last accessed 16 August 2013)

Longo, J. (2011)  #OpenData: Digital-Era Governance Thoroughbred or New Public Management Trojan Horse? PP+G Review 2(2) (last accessed 16 Sept 2013)

McClean, T. (2011) Not with a bang but a whimper: The politics of accountability and open data in the UK. Paper prepared for the American Political Science Association Annual Meeting. Seattle, Washington, 1-4 September 2011. (last accessed 19th August 2013)

Pollock, R. (2006) The value of the public domain.  IPPR (last accessed 13 August 2013)

Pollock. R. (2009)  The economics of public information.  Cambridge Working Papers in Economics 0920.  (last accessed 13 August 2013)

Porway, J. (2013) You can’t just hack your way to social change.  Harvard Business Review Blog, 7 March 2013 (last accessed 9 March 2013)

Shah, N. (2013) Big data, people’s lives, and the importance of openness. DMLcentral, June 24th. (last accessed 25 July 2013)

Slee, T. (2012) Seeing like a geek. Crooked Timber. June 25th (last accessed 18 September 2013)

Yiu, C. (2012) A right to data: Fulfilling the promise of open public data in the UK.  Policy Exchange Research Note (last accessed 14 August 2013)

5 thoughts on “Four critiques of open data initiatives

  1. Steven Adler


    This is a well researched and well written article and I think you’ve hit on a number of important issues in the way Open Data is evolving. However, i have to take issue with a few of your points:

    1. Funding and Sustainability. Governments publishing Open Data are doing nothing more than making information that they collect from citizens easily accessible. The already collect taxes to fund the data collection, therefore the data is already a public asset. Not publishing this information as Open Data is in fact a public disservice. That developers do or do not make money creating applications based on Open Data is a valid criticism of the kinds of apps, the immaturity of the market, and the kinds of developers who so far have devoted time to working with Open Data. But it is not a valid criticism of the governments who are embracing transparency to give back the to the public that which they have already taken.

    I think you are correct in pointing out that few Open Data ecosystems have created sustainable models of economic growth. But I would argue that this will develop and in fact IBM is actively working to help governments to develop new business models which leverage Open Data to encourage economic growth.

    Give it time. It is coming.

    2. Politics of the benign and empowering the empowered. Here again, you raise an important point. In a panel I chaired on Open Data at the Global Forum in Trieste we discussed the urban vs rural disparities about Open Data. Large cities have the skills, infrastructure, and resources to publish and use Open Data, but rural communities don’t. They often have poor access to bandwidth, lack advanced computing resources, and few application developers. Yet it is these rural communities that economic growth the most.

    So far, cities have been doing the most Open Data publishing. At IBM we want to help State and National Governments to begin analyzing the Open Data of their Cities to understand comparative differences in urban economies, societies, and experiences. We think there are tremendous opportunities in regional data analytics and comparative benchmarking that will help States and National Governments to see across urban environments, find the gaps in rural communities, and develop data-based decision-making.

    But of course, you can’t do any of this without the data, and we can’t empower the unempowered without the information to know who is unempowered and how to best empower them. Its just fantastic that so many cities around the world are embracing this Open Data trend and contributing so much public information to enable so many to discover new ways to improve our societies.

    3. Utility and Usability. I’m not aware of any organization in the world that tracks the Utility of their information – that is, how it is used, by whom, for what purpose, how often, and what that usage produces. Banks don’t do this. Insurers don’t. Hospitals certainly don’t. How can we expect governments to do it?

    Until very recently I wasn’t even aware there was an infrastructure to do it. But at IBM’s Information on Demand Conference I met some folks from a company we recently acquired call The Now Factory. The Now Factory makes tools for tracking how people use data on their smartphones. It can tell how long you waited to view a youtube video, how many clicks it took you to get it, how often you use the same data, with whom you shared it, etc. It sounds like a syping application, but it isn’t tracking you. its tracking the data as a reflection of user experiences and preferences.

    Lots of Cities are publishing Open Data around the world without much regard for the Utility of this information because there haven’t been convenient ways to monitor utility and compare that to organizational goals, strategy, and expectations. But I expect this to change quickly.

    4. Neoliberalisation and marketisation of public services

    Here I think your concerns are misplaced. Governments are publishing our data. We fund the government and it represents the interests of society. One of those interests is economic growth. It is consistent with that interest when the government publishes public data in Open Data repositories and enables or empowers others to create economic growth using this data as a resource.

    It would be wrong and economically inefficient for governments to charge citizens or business to use Open Data for fees.

    However, governments should monitor the new business services that are enabled by Open Data to ensure that public services provided measure up to or exceed the laws and standards society expects. So far, what I have seen are new kinds of data analytical services on City Data that help Cities overcome their own organizational stovepipes to discover cost savings, efficiencies, and other public goods beyond the capabilities of the Cities themselves.

    But I expect that this too will change. I expect Cities will themselves invest in Open Data Analytics to discover in their own data things they missed prior to publishing. And that will create new kinds of x-urban public services heretofore impossible without Open Data.


    We’ve just begun. No one knows everything. Of course there are shortcomings and concerns. But isn’t it exciting that a remarkable, transformative, innovation in Information Management is coming so fast from one of the least likely industries – Government. It’s going to change the world.

  2. Rob Kitchin Post author

    Steve, sorry in the slowness of the reply. I’ve been busy and wanted to give a considered response.

    With respect to your comments on funding and sustainability. I think there are two sides to this. On the one hand is the funding related to the state with respect to making data open. The other is the funding to keep citizen-led initiatives going, which are reliant on volunteer labour and grants, and business models that will enable companies using open data to flourish. I’m going to focus on the first here as it most relates to your reply.

    It has to be recognised that the funding of government data services varies between countries. It is certainly the case taxes do pay for the generation of much of the data. In some places, however, data services are complicated by four factors. First, they have been contracted out to third parties to manage and run on behalf of the state, where the third party adds propriety value or makes the data available at a fee. This has recently happened with the forthcoming Irish postcodes that are going to be managed by a company on behalf of the state and they will fund the operation by selling the data. Second, third-party resellers are actively lobbying to stop data being made open as it destroys their business model. Third, some state agencies operate as trading funds. They do not in fact receive all of their funding from the tax pot, but raise a substantial portion of their income from sales of data. Ordnance Survey Ireland, for example, operates in this way with less than half of its income coming directly from the state. Admittedly some of the payments it receives comes from other state agencies, but it also comes from private enterprise and individual purchases. Making all of its data available for free undermines its ability to operate and fund on-going services. Fourth, making data open is not simply a case of handing it over. Much of the data needs to be repurposed and curated to enable it to be made open (e.g., anonymised, aggregated) and new systems put in place to enable this to happen. This is not a trivial exercise and in a time of austerity and cutbacks it means re-allocated funding to pay for this work which is also needed for essential services. All of this complicates the notion that all data has already been paid for and should be free.

    Concerning your comments re. the politics of the benign and empowering the empowered. I am still of the opinion that much thinking has to be done with respect to what data are released. There are two main kinds of data at stake here, I think. The first is data relating to the performance of state agencies and the second is state-held data relating to citizens, places and business.

    With respect to the first, I am in agreement that the state should be transparent and be accountable for how it operates and spends taxpayer money. At the same time, the measures it uses for this have to be sensible and not have the counter-effect of skewing service provision and negatively impacting what services are being delivered or making the lives of those people receiving the services worse. In my own sector, it is clear that KPIs have radically altered the higher education landscape, often in ways that have not had the desired outcome. Indeed, KPIs are a political tool and are used as such to try and leverage particular outcomes. We therefore need to think carefully about how to measure state performance and how that information is used and for who’s benefit.

    With regards the latter, government data is generated for the purposes of governance. Much of them consist of highly sensitive personal and institutional records. They were not created with the intention being shared. Indeed, citizens expect them to be protected by privacy and data protection laws. Even when anonymized and aggregated such data can be quite sensitive and political. Consider, for example, social welfare and health data aggregated to relatively refined spatial units (e.g., neighbourhood level). Such data have utility for directing targeted interventions aimed at addressing social disadvantage. They also make useful inputs into data analytics that seek to socially sort and profile citizens with respect to credit and insurance risk, and can be used to create area profiles that stigmatize a locale and reduce inward investment. The data can be repurposed in different ways which have differential outcomes. There are legitimate reasons then to be cautious with respect to what government data are released and to resist the rather simplistic mantra used by some open data advocates of ‘they’re our data, we’ve paid for them, and we should have access to them.’ Yes, the taxpayer has paid for them, but it is not necessarily in the interest of the citizens the data refer to that the data are released, or they need to released in such a way that the data are less likely to be used to make vulnerable citizens more vulnerable or disempowered. Data holders therefore need to be mindful of the potential repurposing of data and its consequences and to think carefully about how best to release data that complies with data protection and privacy and which best serves citizens.

    I think these two responses pretty much also cover your points relating to my points 3 and 4. I do think it is legitimate critique to examine the motivations of companies in seeking government data and to be concerned about the possible effect of undermining and privatising state services. At the same time I am comfortable with open data being used to support and grow business. Different countries have different ideas about the relationship between state, civil society and business and this has to be respected. A one-sized, global, universal vision of open data is therefore, I think, problematic.

    Many thanks for engaging with the piece. It has helped me refine my thinking and I’ll certainly be rejigging some of the text in the forthcoming book to address some of your observations and that of others.

  3. Pingback: Key Concepts for Doing Social Work in the Digital Age | [ (Public) Fragments ]

  4. Pingback: ‘Data Revolution’ – Background Readings | ajantriks

  5. Pingback: Stop Looking Into Mine! | Nicola-Marie O'Riordan

Leave a Reply