Irish OpenSpending research

this is research for the possiblilty of Irish gov spending data, not that i have or could do it myself :/ this was originally written as email apologies for the poor formatting, pls comment to ask for clarification



Ok that's this info
http://per.gov.ie/revised-estimates-for-public-service-2011-excel-format/,
yes they are improving their formatting

Aiden Kane and Hugh Sheehy had already been doing some work here
http://www.irisheconomy.ie/index.php/2010/10/08/the-csos-detailed-public-finance-data/

I have been gathering links here http://bitly.com/igUg8U looking at
the CSO Household Budget and Survey and Income and Living but only
finding reports from 2004/5 and 2009

Open spending and WDMMG are working towards what they call Spending
Stories to make large financial figures more meaningful to people such
as this Daily Bread interactive infographic.
http://wheredoesmymoneygo.org/dashboard/#income=27542&yearlyTax=8795.532735426008&code=null&view=daily-bread

the UK people were quite lucky to get this table that laid out average
persons outgoings by decile all in one go,
http://http://www.statistics.gov.uk/articles/nojournal/Taxes_Benefits_0809.pdf

Don't know if find all the pieces for an Irish equivalent..., that's
what i need to find now.

------

the source
code is available
http://wheredoesmymoneygo.org/dailybread/?income=10000&visualize=Your+Daily+Spend+%C2%BB
I reference this link in my two emails but it is dead
http://www.statistics.gov.uk/articles/nojournal/Taxes_Benefits_0809.pdf
table 14 is the basis of the daily bread viz ,it is now at
http://www.ons.gov.uk/ons/rel/household-income/the-effects-of-taxes-and-benefits-on-household-income/2008-09/article--the-effects-of-taxes-and-benefits-on-household-income--2008-09.pdf
if you need to find the equivalent Irish figures, I sought out as many
as I could to fill in this formula
https://bitbucket.org/okfn/wdmmg/src/6e3bfefa41dc/wdmmg/lib/calculator.py

----------------------------------------

Department of Public Expenditure & Reform - Databank http://databank.per.gov.ie/
only goes two levels deep and isn't detailed enough to start to
recreate the spending tree maps, the next level of details are still
in horribly formatted, long and complicated pdfs.


ok I'll detail which figures are needed for the Daily bread Gov
spending by department vs Income Viz
http://wheredoesmymoneygo.org/dashboard/#focus=TOTAL&year=2009&view=uk-bubble-chart

its the flashy front to the openspending
http://openspending.org/dataset/cra line by line spending data,(
technical details http://wiki.openspending.org/Main_Page , where
treemaps are the better representation of data along with tables
below.)

These figures look like it was difficult for the UK gov to gather* I
know its a long shot but one can only search and ask, and keep an eye
out for when and if the figures are calculated.

Their calculator
https://bitbucket.org/okfn/wdmmg/src/6e3bfefa41dc/wdmmg/lib/calculator.py
requires, by decile

# Row 1 is average gross income per decile - including benefits,
pensions etc (Irish figures SILC 2009
http://www.cso.ie/releasespublications/documents/silc/current/silc.pdf
table 1.5 )
# Row 2 is average direct taxation - income tax, employee NI and
council tax (Irish figures SILC 2009
http://www.cso.ie/releasespublications/documents/silc/current/silc.pdf
table 1.5 )
# Row 3 is average total indirect taxation MINUS VAT, tobacco,
alcohol, & car costs (Irish figures ?) https://www.google.ie/search?hl=en&q=Indirect+Tax+as+a+Percentage+of+Gross+income+by+Decile+(Source%3A+NERI).&gws_rd=ssl
# Row 4 is average total VAT paid (Irish figures ?)

viz does not use figures below yet but would make the viz more
accurate for lower incomes if they included

# Row 5 is average total tobacco tax paid (Irish figures ?)
# Row 6 is average total alcohol tax (beer, cider, wine & spirits)
paid (Irish figures ?)
# Row 7 is average total car-related costs (petrol & car tax) (Irish figures ?)



# We connect the data points by linear interpolation.




the UK designers of WWDMMG got their figures from

National statistics for tax paid per household income decile, 2008/9.
Table 14 in http://www.statistics.gov.uk/CCI/article.asp?ID=2440
*discussion of methodology is in 'Data sources' section on p.4 onwards


Here WWDMG discusses the figures
http://ask.wheredoesmymoneygo.org/questions/37/total-tax-paid-as-a-function-of-income-and-other-variables

I tried to compare these UK figures to Ireland to point out
differences and similarities
https://spreadsheets1.google.com/spreadsheet/ccc?hl=en_GB&key=ta8i70qiEYq7feGi9Z8iVvw&hl=en_GB#gid=4
and calculate results.


here is the js versions dailybread of
https://github.com/okfn/openspendingjs/tree/master/app replacing a few
urls should get some of these working if you copy them onto your own
server, Rufus Pollack is the genius behind it all, at
http://www.openspending.org and http://wheredoesmymoneygo.org/

indirect taxes 2012 http://www.finance.gov.ie/documents/exchequerstatements/2012/Taxprofile.pdf

Fusion Tables, Occupations Ireland map

I've been looking for a reason to use google fusion tables. Here is the result Occupations in Ireland map by Electoral District

Inspired by Guardian Datablog and this example by @manaboutcouch 2006-2011 population change and with a guide fusiontables with Irish census data by rusty at dt106ers blog.

I looked back at using openheatmaps but it easier in fusiontables to upload custom polygons, one could set up openheatmaps yourself and add new boundaries but I'd need more information on how to do that.

I got the broad occupations in the
CSO Database by Electoral districts

• Farming, fishing and forestry managers
• Other agricultural workers
• Manufacturing workers
• Building and construction workers
• Clerical and office workers
• Administrative and Government workers
• Transport workers
• Sales workers
• Professional workers
• Services workers
• Other workers
• Total

I change the raw numbers in percentages of the total in each area so the compared across all areas.

Using 2006 data as the 2011 isn't available yet.
Boundaries files
2006 Census Boundaries shp files

There is an error in files, a Roscommon ED Lough Allen/Altagowlan is listed as 20 not 30, have to change.

The cso data doesn't have the full 5 number CSO code, county electoral area so you have to go down the list add that the county code if you using open office make sure you format and open that row by text to keep the leading zeros.

You can use the free Quantum GIS programme setting projection as TM75/Irish Grid.
Select just the EDs and save as ESRI shapefile, pack the 4 associated files into a zip and upload to shpescape, which will convert it fusion tables kml format.

I converted the CSO data to precentages so I could compare all EDs. Merge with the CSO data with the geometry data by the common CSO Code.

Occupation by County It seems that higher values should be darker but to me the lighter shades jump out more and you can read the location. I took advice to be careful with choropleth maps and used equidistant colors from a HSV gradients.

I tried to adapt these two examples from fusiontables developers blog advanced fusiontables

dynamic styling template
Based on this table
Occupation by ED




You can't show all the map as fusion tables won't load that many polygons. I had trouble hand making gradients to match the varying max numbers in each sector so I used the out of range red to highlight areas with particularily high numbers of that occupation.



I adapted this fusion table to this example with both map and chart.

Fusiontable Occupation Map and chart.

Looking to put all the occupations type in the one view.
Reading about Choropleth maps of the multivariate type like the famous Pop vs Soda map.

I made a map with highest of each type of occupation in each ED.



Created a highest occupation with chart by cso town and by county.

NIUM's AIRO Mapping has similar maps and stats down to small areas.

thoughts and links about opennews at the guardian etc

trying to collect thoughts and links into a blog post with storify

Schools Exhibit

Secondary Schools DublinTo display schools by religion


Primary Schools Dublin


Sources
Education Open Data on Dublinked


Dept of Ed Find a School


Data-on-Individual-Schools

Eoin Mahoney who works for the Irish Bishops Council research department describes how only in 2008 did fellow NUIM geography student Omar Sarhan start the diffcult task of creating modern GIS maps of Ireland Diocese and parishes, that had never been properly defined before. The department of Education should have contributed to this work because they can't do any forward planning on schools without this information and neither can parents.

People often say if you want a less religious school then parents should just go start one, but it very hard to do especially when Department of Education previously never collected the info you need as it should, and then won't share it with you when it does. For example a Fine Gael Councillor highlighting how the Dept of Education won't share its GIS school-place demand data when they are trying to approve the development plan. The only people that can really create a mass education system are the government, that's what we pay our taxes for.

References to Departments GIS system
2008
2009
2009
2011
40 new schools
03 October, 2008 - Colour-coded map technology identifies where new school places are needed most - Minister O'Keeffe
2011
2009
2008
2012

A study was published in around 2010 with some maps for new schools but I can't find it again.

The forward planning section of Department of Education

The Forum on School Patronage was started under Hanafin and restarted in 2011 Under Minister for Education Ruari Quinn. Based on demographic GIS work it put out a survey to potential parents in 40 areas to see school demand. The dept of education has started some Community National Schools as emergency measure in new areas of high demand but these schools are still Catholic in all but name.

Schools Catchments

standard PQ answer

Catchment boundaries have their origins in the establishment of free post-primary education in the late 1960s and were determined following consultation with local educational interests. For planning purposes the country was divided into geographic districts each with several primary schools feeding into a post-primary centre with one or more post-primary schools. The intention was and continues to be that these defined districts facilitate the orderly planning of school provision and accommodation needs.

http://debates.oireachtas.ie/dail/2011/10/18/00121.asp 2011
http://debates.oireachtas.ie/dail/2005/10/11/00005.asp 2005
Feeder schools
http://www.into.ie/ROI/Publications/TransitionsPrimarySchool.pdf
http://www.kildarestreet.com/wrans/?id=2010-11-16.683.0

Transport catchment areas
http://www.mayovec.ie/index.php?option=com_content&task=view&id=30&Itemid=60
http://193.178.1.238/DDebate.aspx?F=DAL20090409.xml&Node=2260
http://debates.oireachtas.ie/EDJ/2005/09/29/00003.asp committee presentation 2005
http://www.oco.ie/complaints/investigations-and-case-studies/school-transport.html

I take it that the Deputy is seeking copies of each catchment area map in the country.

By way of general background information, catchment boundaries have their origins in the establishment of free post primary education in the late 1960’s.

For planning purposes, the country was divided into about 300 geographic districts, each with several primary schools feeding into a post primary education centre with one or more post primary schools. The intention was that these defined districts would facilitate the orderly planning of school provision and accommodation needs. They also facilitated the provision of a nationwide school transport service, enabling children from remote areas to get to their nearest school.

In view of the number of catchment area maps involved, the Deputy will understand that it would be a major logistical exercise to collate and send all of these maps to him. However, if the Deputy has a particular area in mind I will arrange to have the map forwarded to him.

http://debates.oireachtas.ie/dail/2009/04/09/00126.asp

here's children ombudsman case study with more detail

http://www.oco.ie/complaints/investigations-and-case-studies/school-transport.html

The issue of which was the correct map to be used in 2005 could have been determined conclusively if the Planning Section of the Department of Education and Science had furnished the Ombudsman for Children’s Office with a copy of a master map to include all catchment boundaries which was identical to that held by the relevant Bus Éireann office or that which was in place in the Local VEC office in 2005, or as near to identical in so much as the variation was negligible.

The Department of Education and Science did not supply a map to meet this standard as required. The map provided to this Office by the Planning Section in June 2006:
1. is different to what is currently being used by Bus Éireann and the VEC;
2. is questionable as to its suitability as it appears to be incomplete;
3. appears to be a large scale map scaled on a ratio of approximately 1:62500 and, as such, does not provide the required detail to administer such a scheme effectively and accurately; and
4. contains excessively thick boundaries for the purposes of clarity and accuracy.

http://www.kildarestreet.com/debate/?id=2012-07-04.413.5
Report or trasnport for schools
http://oireachtasdebates.oireachtas.ie/debates%20authoring/debateswebpack.nsf/takes/dail2012070400017?opendocument


school enrolement
http://www.kildarestreet.com/wrans/?id=2011-12-13.1040.0 discussion paper 2011
http://education.ie/en/Press-Events/Press-Releases/2013-Press-Releases/PR13-09-02.html
the admission policy draft plans

Dublin's rivers map

Dublin's rivers google map draft http://www.boards.ie/vbulletin/showthread.php?t=2055478219

The Rivers of Dublin by Clair L Sweeney published by Dublin Corporation 1991 was out of print.

The Rivers of Dublin new Revised Edition is now available via Irish Academic Press.