Tag Archives: open data

Sketching the Open Data Landscape in Ireland

by: Tracey P. Lauriault

Note – I have received some feedback since last night and have updated the post accordingly.  Thanks to those who provided it!

DPERThe Republic of Ireland, Department of Public Expenditures and Reform (DPER) launched its first Open Data Pilot Portal data.gov.ie on July 22nd.  The new portal was created by INSIGHT Galway who answered the DPER call for tender of January 24, 2014.  The following suite of products were delivered on April 7th and officially approved by the Government on July 1st.  This is an important milestone.

data.gov.ie DPER/INSIGHT Research Documents:

  1. Best Practice Handbook
  2. Data Audit Report
  3. Roadmap
  4. Evaluation Framework
  5. Open Data Publication Handbook

On the following day, July 23rd, the Government released Ireland’s first Open Government Partnership (OGP) National Action Plan.  The newly launched data.gov.ie portal falls within Ireland’s OGP Plan under section 4 entitled: Open Data and Transparency – opening-up Government data for greater accountability, improving public services and achieving economic growth.  It was also something civil society, academia and government have been advocating for, for some time.

OGPIreladThe first draft of this plan was released at the OGP European Regional Meetings held in Dublin in May of 2014, and part of the package of deliverables listed above are related to Ireland’s May 2013 commitments to join the OGP.  The Government also aspires to sign onto the G8 Open Data Charter.  The OGP plan was informed by a number of stakeholders from civil society, academia and the public and private sectors.  The documentation related to this process is available on the OGP page for Ireland and on the Open Knowledge Foundation Ireland website.  There are many strategies in these reports, if implemented, will greatly make government more accessible and transparent to the public.

Subsequently, the DPER invited members of the public service, involved with the production and dissemination of public sector data in Ireland, to attend an information session, held on the 29th of July, to discuss the documents, the portal, to solicit feedback on the development of an open data strategy for the Republic and to seek support.  A public briefing will also be held September 8th with civil society stakeholders and the public who have been actively engaged in the production of the OGP DRAFT Plan and engaged in Open Data and open government in Ireland.

This blog post is the first of a three part series on open data.

  1. This post sketches part of the open data landscape for the past 5 years.
  2. The next post will discuss the DPER/INSIGHT documents, the portal and provide recommendations.
  3. The final will discuss the open government plan.

Sketching the Open Data Landscape in Ireland

Members of the Programmable City Project have been actively engaged in the theory and practice of open data and making data accessible in both Ireland and Canada for 15 years.  As part of this ERC funded Project researchers are producing open data genealogies and data assemblages for Ireland, Canada and Boston in the US.  The following is but a sketch of the open data landscape in Ireland.  In the last 5 years much important work has been done prior to the DPER launch and it important to feature some of this work as it provides context to the Irish Open Data Story.

The public sector in collaboration with the private and academic sectors have been advocating for both open data and open government for some time.  opendatawkggrp-576x432For example, In June of 2011, National Cross Industry Working Group was formed “to support and inform government in the delivery of their Open Data objectives.  [They were] committed to realising Open Data opportunities for Government, society and industry while simultaneously re-enforcing [Ireland’s] international reputation as a global technology hub”.  Their Report includes recommendations, many of which were included in the DPER/INSIGHT reports and a history of open data activities from 2009-2011.  WG members also held a number of events as part of Open Data Week between Nov. 7-11 in 2011.  Shrotly thereafter, on November 17, 2011, the DPER as part of its 2011 Public Sector Reform Plan includes making data more accessible and opening government more broadly.  The current DPER/INSIGHT reports are therefore not the first time the government announces open data and open government plans.

data.gov.ie is also not the first portal as other levels of government, civil society and academia, as well as the private sector have: produced their own portals, have integrated portals; have shared some of their own datasets; have added value to some; have produced some civic apps and have helped shape the discourse of openess.

Many of the early public and academic sector data dissemination initiatives, in Ireland would not be considered as pure ‘open data’ according to the Open Definition.  Some of the County level portals listed below might not meet all of the open criteria, since many stipulate that data cannot be used for commercial purposes or passed onto third party entities.  The Fingal Open Data portal is the exception.  These would be classified as open access to data projects.  They are nonetheless precursors to the ‘open data’ DPER launch. These initiatives have  been sharing their data as part of their normal dissemination practices or as an institutional policy.  For example, statistical and geospatial data producing communities in particular are renowned for their good practices in Ireland and internationally.

The following is a selection of open access, open data and transparency initiatives in Ireland:

County Level Public Sector Data Portals: Fingal

Civil Society Initiatives:

  • Open Street Map (OSM) Ireland and Maps.openstreetmap.ie (mapping since 2005). osm_logo OSM volunteers produce framework geospatial datasets and disseminate them under an open licence;
  • Kildare Street (launched 2009) makes parliamentary records accessible and records what parliamentarians say and do;
  • Active Citizen (founded 2010) has been working with andOKILogo advocating for Ireland becoming a member of the Open Government Partnership since 2011, and develop.  In 2012 an OGP Business Case which included the fostering of an open data ecosystem was provided to DPER. It founded the Open Knowledge Foundation Ireland local group (2013) which became OKF Ireland Chapter (2014);odi-logo
  • CKan Open Data Portal (launched September 2013), it is no longer on line.  An inventory of close to 200 public sector data initiatives were added into this demo portal during a one day hackathon;
  • Open Data Ireland held numerous civic hackathons and meetups.

Academic

  • AIRO.ie (All-Island Research Observatory launched 2010), disAIROlogoseminates datasets from agencies both from the North and the South as interactive online graphs and maps  and also in an open data store.  It was initially the Cross-Border Regional Research Observatory founded in 2006.

Public, Academic and Private Sector Partnership

Dublinked.ie dublinkedLogo(Launched June 2011), a partnership project which disseminates a variety of static and real time data.

Public & Private Sector

There are far too many open access to data initiatives in Ireland to list here, the DPER/INSIGHT Data Audit Report provides a partial list, organizations like AIRO have created their own inventories which they make accessible in their Data Store, the Irish Spatial Data ExchangeISDE(ISDE) has integrated the metadata of a number of important data catalogs, dublinked.ie lists hundreds in their portal and the Ckan portal, now offline, listed close to 200 initiatives in a one day hackathon.  The private sector also disseminates data on behalf and with the public sector.  ESRIIrelandESRI Ireland for examples disseminate data in a number of ways, as products and as web services services.  Finally, there is also the GeoPortal.ie which was developed by the Department of Environment, Community & Local Government (DECLG) and Ordnance Survey Ireland (OSi) with guidance and oversight fromIrish public bodies on the Irish Spatial Data Infrastructure (ISDI) project steering committee.GeoportalLogo

 

The following is a very small list of how some public sector organization open access to data initiatives disseminate their data:

Shaping the Terrain:

There a number of initiatives that help shape debates on openness and transparency and some of these are:

  • TheStory.ie sheds light on law, policy and freedom of information in Ireland (based on Gavin’s Blog launched in 2002);
  • Creative Commons Ireland produces open licences enabling data producers to share their data more openly (founded in 2003);
  • Transparency International Ireland is involved in work related to transparency and accountability (founded in 2004);
  • Coder Dojo builds capacity by teaching people to code and to understand open source and open data (founded in 2011);
  • advocating open access publishing, Open Access Ireland (committee formed in 2012).
  • Code for Ireland (launched January 2014), apps are voluntarily created in a hackathon type of environment with open data, or data are produced to address civic issues and these are rendered into apps.
  • A number of app contests and hackathons have been taking place since 2010.

Indicators and Evaluation

Ireland’s openness has also been ranked according to a number of measures, and these too have inspired action within and outside the public service.  These ranking schemes were discussed in an earlier post entitled on Mapping Openness and Transparency.

Research

Finally, there are research projects which are part of a new emerging field called critical data studies, The Programmable City Project being one of the few doing so internationally, and data discovery and semantic interoperability projects such as the INSIGHT Linked Data project based at NUIG.

Open Data Assemblage

The above is by no means complete nor exhaustive list of projects and activities.   EngineYardFor instance the open source community; the private sector (e.g., IBM); lawyers, geomaticians, scientists, programmers, journalists, business associations, citizen scientists, and other individuals; are part of this landscape.  As are those who provide collaborative working spaces (e.g., T-Cube); tcubelogosponsors of open data events (i.e., ESRI) or donate space (i.e., the Engine Yard, Facebook); informal virtual server use arrangements, or the library community.  Furthermore, only the OGP, EU and OKF are mentioned as international influences, yet there are other national programs (e.g., UK, US), NGOs, standards organizations, and data infrastructures that are a part of this story.  A data assemblage analysis will be used as a way to situate these actors in the open data and the data landscape in Ireland in general.

Some motivating factors and issues:

Open data stakeholders prior to the launch of the DPER/INSIGHT documents and the portal, were motivated into action because of a number of issues beyond transparency, efficiency and collaboration.  The following is a sample of some of the more high level issues:

  • the disappointment and missed public benefit opportunity of the postal code system (eircode.ie) in Ireland, both how it is being deployed, the cost recovery model and the regressive licencing regime (See Map Scribbles for details).  the fees, and general lackadaisical approach to fulfilling Freedom of Information requests, See The Story for backgrounder.
  • the cost recovery and licencing practices of the Ordnance Survey Ireland (OSI).  OSI produces important framework data that are mostly inaccessible to civil society, and are costly even to the public sector, who also have to pay for them.  The OSI has however begun to share some of its data to some academic institutions.  Beyond access, it means that important work is not being done, effort is being duplicated, and framework data standards are being undermined as people are creating their own datasets.  Open Street Map in Ireland is an OSI workaround, and in the UK, the lack of access to OS data spearheaded the UK Guardian open data campaign.
  • Uncertainty about the procurement agreements between the city and the private sector regarding access to data and the science behind the deployment of smart city like sensor initiatives.

These issues have not gone away, and some were debated during the Open Government Partnership meetings in Dublin, have been discussed in the media, and the DPER/INSIGHT Best Practice Handbook briefly addresses others.

Local Context:

Finally, the local context matters, the history of the public sector and its reform, the political economy which includes foreign direct investment and the political system in general provide a backdrop for the unique made in Ireland version of open data.  This will be studied more fully as part of the Programmable City genealogical and data assemblage research.

Until then, this sketch of the Irish open data landscape illustrates the rich culture of openness in Ireland, has identified some programs, stakeholders and issues that pre-existed release of data.gov.ie and the DPER/INSIGHT documents.  The documents did not discuss these projects in any great detail, which is unfortunate as much expertise exists in and outside of the public sector in Ireland and capturing best practices and mobilizing that knowledge would be beneficial.  Others were very briefly addressed in the Open Government Plan.

The DPER did however invite some of these actors to their July 29th and the up and coming September meetings and there is now a mandate for greater collaboration between stakeholders and the government.  And DPER is soliciting feedback more generally on these plans.

Mapping Openness and Transparency

by: Tracey P. Lauriault

I attended the European Regional Meeting of the Open Government Partnership at the Dublin Castle Conference Centre in May of this year.  The meeting was a place for performance and evaluation wonks to show their wares, especially at the following sessions: Open Government Standards and Indicators for Measuring Progress, The EU’s Role in Promoting Transparency and Accountability and Engagement with the OGP, and Open Contracting: Towards a New Global Norm.  I did not attend the Independent Reporting Mechanism (IRM) sessions, but having read the IRM report for Canada, I know that it too is an emerging performance evaluation indicator space, which is affirmed by a cursory examination of the IRMs two major databases.  The most promising, yet the most disappointing session was the Economic Impact of Open Data session.  This is unfortunate as there are now a number of models by which the values of sharing, disseminating and curating data have been measured.  It would have been great to have heard either a critical analysis or a review of the newly released Ordinance Survey of Ireland report, Assessment of the Economic Value of the Geospatial Information Industry in Ireland, the many economic impact models listed here in the World Bank Toolkit, or the often cited McKinsey Global Institute Open data: Unlocking innovation and performance with liquid information report.  Oh Well!

While there I was struck by the number of times maps were displayed.  The mapping of public policy issues related to openness seems to have become a normalized communication method to show how countries fare according to a number of indicators that aim to measure how transparent, prone to corruption, engagemed civil society is, or how open in terms of data, open in terms of information, and open in terms of government nation states are.

What the maps show is how jurisdictionally bound up policy, law and regulatory matters concerning data are.  The maps reveal how techno-political processes are sociospatial practices and how these sociospatial matters are delineated by territorial boundaries.  What is less obvious, are the narratives about how the particularities of the spatial relations within these territories shape how the same policies, laws and regulation are differentially enacted.

Below are 10 world maps which depict a wide range of indicators and sub-indicators, indices, scorecards, and standards.  Some simply show if a country is a member of an institution or is a signatory to an international agreement.  Most are interactive except for one, they all provide links to reports and methodologies, some more extensive than others.  Some of the maps are a call to action; others are created to solicit input from the crowd, while most are created to demonstrate how countries fare against each other according to their schemes.  One map is a discovery map to a large number of indicators found in an indicator portal while another shows the breadth of civil society participation.  These maps are created in a variety of customized systems while three rely on third party platforms such as Google Maps or Open Street Maps.  They are published by a variety of organizations such as transnational institutions, well resourced think tanks or civil society organizations.

We do not know the impact these maps have on the minds of the decision makers for whom they are aimed, but I do know that these are often shown as backdrops to discussions at international meetings such as the OGP to make a point about who is and is not in an open and transparent club.  They are therefore political tools, used to do discursive work.  They do not simply represent the open data landscape, but actively help (re)produce it.  As such, they demand further scrutiny as to the data assemblage surrounding them (amalgams of systems of thought, forms of knowledge, finance, political economies, governmentalities and legalities, materialities and infrastructures, practices, organisations and institutions, subjectivities and communities, places, and marketplaces), the instrumental rationality underpinning them, and the power/knowledge exercised through them.

This is work that we are presently conducting on the Programmable City project, which will  complement a critical study concerning city data, indicators, benchmarking and dashboards, and we’ll return to them in future blog posts.

1.       The Transparency International Corruption by Country / Territory Map

Users land on a blank blue world map of countries delineated by a thick white line, from which they select a country of interest.  Once selected a series of indicators and indices such as the ‘Corruption measurement tools’, ‘Measuring transparency’ and ‘Other governance and development indicators’ appear.  These are measured according rankings to a given n, scored as a percentage and whether or not the country is a signatory to a convention and if it is enforced.  The numbers are derived from national statistics and surveys.  The indicators are:

  • Corruption Perceptions Index (2013), Transparency International
  • Control of Corruption (2010), World Bank dimension of Worldwide Governance Indicators
  • The Bribe Payer’s Index (2011), Transparency International
  • Global Corruption Barometer (2013), Transparency International
  • OECD Anti-Bribery Convention (2011)
  • Financial Secrecy Index (2011), Tax Justice Network
  • Open Budget Index (2010), International Budget Partnership
  • Global Competitiveness Index (2012-2013), World Economic Forum Global Competitiveness Index
  • Judicial Independence (2011-2012), World Economic Forum Global Competitiveness Index
  • Human Development Index (2011), United Nations
  • Rule of Law (2010), World Bank dimension of Worldwide Governance Indicators
  • Press Freedom Index (2011-2012) Reporters Without Borders
  • Voice & Accountability (2010), World Bank dimension of Worldwide Governance Indicators

By clicking on the question mark beside the indicators, a pop up window with some basic metadata appears. The window describes what is being measured and points to its source.

The page includes links to related reports, and a comments section where numerous and colourful opinions are provided!

2.      Open Government Standards

Users land on a Google Map API mashup of Government, Citizen and Private Open Government initiatives.  They are given the option to zoom in to see local initiatives.  In this case, users are led to a typology of initiatives which define what Open Government means from civil society’s point of view.

Initiatives are classified with respect to the following categories 1) Transparency, 2) Participation and 3) Accountability.  The development of the Open Government Standards are being coordinated by “Access Info Europe, a human rights organisation dedicated to the promotion and protection of the right of access to information in Europe and the defence of civil liberties and human rights with the aim of facilitating public participation in the decision-making process and demanding responsibility from governments”.

Definitions, parameters and criteria for a number of sub-indicators are being crowsourced in the online forms like the following for Openness:

The following is a list of standards that are a currently under development.

  • Recognition of the Right to Know
  • Openness
  • Codes of Conduct: Clear standards of behaviour
  • All information available from all public bodies
  • Clear and reasonable Timelines
  • Conflict of Interest Prevention Mechanisms
  • Access is the Rule – Secrecy is the Exception
  • Clear and comprehensive information
  • Assets Disclosure
  • Proactive Publication of Information
  • Active collaboration
  • Transparency and Regulation of Lobbying
  • Free of charge and free for reuse
  • Appropriate and Clear Procedures
  • Whistleblower mechanisms and protections
  • Open Formats
  • Empowerment
  • Procurement Transparency
  • Compilation of information
  • Transparency and Accountability
  • Independent Enforcement Bodies
  • Independent review mechanism

3.      The Global Integrity Report Map

This is an interactive Open Street Map (OSM) Mapbox map depicting the locations where there is Global Integrity fieldwork national reports arranged by the year these were published.  Reports are called Country Assessments and each includes: a qualitative Reporter’s Notebook and a quantitative Integrity Indicators scorecard.

The Integrity Indicators scorecard assesses “the existence, effectiveness, and citizen access to key governance and anti-corruption mechanisms through more than 300 actionable indicators. They are scored by a lead in-country researcher and blindly reviewed by a panel of peer reviewers, a mix of other in-country experts as well as outside experts. Reporter’s Notebooks are reported and written by in-country journalists and blindly reviewed by the same peer review panel”.

Users select a country, and below the map a number of scorecard indicators appear.  Scorecard indicators are arranged into 6 major categories:

  1. Non-Governmental Organizations, Public Information and Media
  2. Elections
  3. Government Conflicts of Interest Safeguards & Checks and Balances
  4. Public Administration and Professionalism
  5. Government Oversight and Controls
  6. Anti-Corruption Legal Framework, Judicial Impartiality, and Law Enforcement Professionalism

Users can then access how each score was derived by following sub-category links.  Below is an example of legislation and the score associated with the Political Financing Transparency indicator which is a sub-class of the Elections category.

PDF copies of the reports are also available, as are spreadsheets of the data used to derive them.

4.      The World Bank Global Integrity Index Map

This is an interactive map depicting the World Bank’s Global Integrity Index, which is one of its Actionable Governance Indicators (AGIs).  AGIs “focus on specific and narrowly-defined aspects of governance, rather than broad dimensions. These indicators are clearly defined, providing information on the discrete elements of governance reforms, often capturing data on the “missing middle” in the outcome chain”.  The map allows users to select from a drop down menu which includes a subset of AGI indicator – the portal contains thousands.  The interactive and downloadable map aims to graphically demonstrate the progress of governance reform worldwide.  The map is but a small picture of what the Portal contains and below is a Governance At A Glance country report for Ireland.

And here is a data availability table, also for Ireland.

5.      The Open Government Partnership Participating Countries map

The interactive map depicts the countries that have signed onto the Open Government Partnership and in which cohort they belong.  Users can select their country of choice which hyperlinks to that country’s membership status and its progress to date in meeting the criteria for membership, where it ranks in terms of commitment and links to related documents such as action plans and progress reports.  It is interesting to note, that the Independent Review Mechanism reports are not included in this list.  Canada’s IRM report was submitted in 2014.

6.      The Open Data Barometer Data Map

The Open Data Barometer map depicts the 77 countries the Open Data Institute has evaluated.  This map assesses how open data policies are implemented in these countries according to three main indicators:

  • Readiness of:
    • government,
    • citizens and civil society and
    • entrepreneurs and business,
    • Implementation based on the availability a variety of datasets within the following sub-categories:
      • accountability
      • social policy
      • Innovation
    • The following Emerging Impacts :
      • Political
      • Social
      • Economic

These are also graphically depicted in a radar chart, as well as a bubble chart where the size of the bubble represents the availability of the datasets per category and if these sets meet the Open Definition Criteria.  The data and associated methodologies are explained in the website about the report.

7.      Open Contracting Implementation and Supporting Tools Map

This is a static map depicting where Open Contracting Support and Tools are implemented.  Sadly, the 5 indicators depicted on the map were not explained or described.  I would have to contact them at a later time to find out!

8.      Reporters Without Borders World Press Freedom Index Map

This map is depicting the findings of the World Freedom Index Report for 2014, with a particular focus on how countries rose and fell from the previous year.  180 Countries are scored against the following criteria which are based partly on a questionnaire, violence committed against journalists the algorithm of which is clearly defined in the PDF copy of the report.  Data and the report are fully downloadable, and more detailed maps with a legend are provided in the report itself and a methodology report.

  • Pluralism
  • Media independance
  • Environment and self-censorship
  • Legislative framework
  • Transparency
  • Infrastructure

9.      Politics for People Not Profit Map

This is an interactive map that depicts the pledges made by nationally elected political officials to the European Parliament and asking them to commit to “stand-up for citizens and democracy against the excessive lobbying influence of banks and big business in the EU?” Mousing over a country triggers a pop-up menu which lists which party has made a commitment, while clicking on the map directs users to the page below which is a tool whereby citizens can fill in a form letter and have it sent to their elected officials to solicit them to pledge.

10.      The OGP Civil Society Hub Map

This is a partially curated and partially crowsourced map on the OGP Civil Society Hub Website.  The starred drops represent countries that are official OGP members, while the red drops represent any number of civil society organizations that have in some way engaged with the OGP, some of which are transnational while others are national or sub-national entities.  Once a location is selected, a pop-up menu appears that includes a national flag, a link to that nation state’s official OGP member site, and provides users with the option to pick from who is involved, a selection of topic areas or a list of information resources.  The map is a means to find people and activities and also a means by which to have people self identify and be recognized as civil society actors but also to connect people.

Unfortunately, the very popular and often discussed Open Knowledge Foundation Open Data Index, the Open Corporate Data indices and the Open Data Study by the Open Society Foundation have not been mapped, even though the latter includes quite a lovely world map on the cover of its report.

Slides for "Urban indicators, city benchmarking, and real-time dashboards" talk

The Programmable City team delivered four papers at the Conference of the Association of American Geographers held in Tampa, April 8-12.  Here are the slides for Kitchin, R., Lauriault, T. and McArdle, G. (2014). “Urban indicators, city benchmarking, and real-time dashboards: Knowing and governing cities through open and big data” delivered in the session “Thinking the ‘smart city’: power, politics and networked urbanism II” organized by Taylor Shelton and Alan Wiig.  The paper is a work in progress and was the first attempt at presenting work that is presently being written up for submission to a journal.  No doubt it’ll evolve over time, but the central argument should hold.

Presentation Videos from ‘Open Data and Evidence Informed Decision Making’ seminar

Here are the videos of the seminars and links to the slides, as only presenters are seen in the videos.

1. An Open Data Story (Slides, Bio), by Dr Tracey P. Lauriault, Programmable City Project, NUIM

Open Data Event Talk One from The Programmable City on Vimeo.

2. Open Government Data: The Fingal Story (Slides, Bio), by Dominic Byrne, Head of Information Technology with Fingal County Council.

Open Data Event Talk Two from The Programmable City on Vimeo.

3. Experiences as a producer, consumer and observer of open data (Slides, Bio), By Dr Peter Mooney, Environmental Protection Agency (EPA) funded Research Fellow at the Department of Computer Science, NUIM

Open Data Event Talk Three from The Programmable City on Vimeo.

Thanks to Alam Moore and to James White, both Programmable City PhD candidates for editing and posting the videos.

Putting public data to work and putting the I back in IT

The Silicon Republic is “Ireland’s No 1 resource for technology news”.  Along with delivering the news about technology innovation in Ireland they orchestrate fantastic industry events to amplify emerging discussions of importance with the irish indigenous and foreign technology sectors.  Tracey P. Lauriault has attended three of their events to date, and participated in their latest, the Irish Data Forum.  Their events feature a cross section of industry, academic and public sector experts to discuss trends, issues and innovations. The discussions are frank and audience participation is skillfully moderated by Ann O’Dea CEO, Editor-at-large of the paper.

The Irish Data Forum Putting “I” back in “IT” discussed cloud, big data, data analytics, open data, data science and public data.  It also examined the data revolution and how Ireland can be at its heart.

Below is a selection of media from the event.

Panel 2 Part 1 Video

Panel 2 Part 2 Video

Silicon Republic Panel: Extracting Value from Big Data for Business, Government and Society

I am looking forward to participating in the Silcon Republic panel about putting data to work at the Irish Data Forum on Friday morning with:

  • Phil Townsend, Director of Communications, Manchester United
  • Stephen Moffatt, Cloud Computing and Business Analytics Leader, IBM
  • Andrew Maybin, Managing Director, Tibus