Irish OpenSpending research

this is research for the possiblilty of Irish gov spending data, not that i have or could do it myself :/ this was originally written as email apologies for the poor formatting, pls comment to ask for clarification



Ok that's this info
http://per.gov.ie/revised-estimates-for-public-service-2011-excel-format/,
yes they are improving their formatting

Aiden Kane and Hugh Sheehy had already been doing some work here
http://www.irisheconomy.ie/index.php/2010/10/08/the-csos-detailed-public-finance-data/

I have been gathering links here http://bitly.com/igUg8U looking at
the CSO Household Budget and Survey and Income and Living but only
finding reports from 2004/5 and 2009

Open spending and WDMMG are working towards what they call Spending
Stories to make large financial figures more meaningful to people such
as this Daily Bread interactive infographic.
http://wheredoesmymoneygo.org/dashboard/#income=27542&yearlyTax=8795.532735426008&code=null&view=daily-bread

the UK people were quite lucky to get this table that laid out average
persons outgoings by decile all in one go,
http://http://www.statistics.gov.uk/articles/nojournal/Taxes_Benefits_0809.pdf

Don't know if find all the pieces for an Irish equivalent..., that's
what i need to find now.

------

the source
code is available
http://wheredoesmymoneygo.org/dailybread/?income=10000&visualize=Your+Daily+Spend+%C2%BB
I reference this link in my two emails but it is dead
http://www.statistics.gov.uk/articles/nojournal/Taxes_Benefits_0809.pdf
table 14 is the basis of the daily bread viz ,it is now at
http://www.ons.gov.uk/ons/rel/household-income/the-effects-of-taxes-and-benefits-on-household-income/2008-09/article--the-effects-of-taxes-and-benefits-on-household-income--2008-09.pdf
if you need to find the equivalent Irish figures, I sought out as many
as I could to fill in this formula
https://bitbucket.org/okfn/wdmmg/src/6e3bfefa41dc/wdmmg/lib/calculator.py

----------------------------------------

Department of Public Expenditure & Reform - Databank http://databank.per.gov.ie/
only goes two levels deep and isn't detailed enough to start to
recreate the spending tree maps, the next level of details are still
in horribly formatted, long and complicated pdfs.


ok I'll detail which figures are needed for the Daily bread Gov
spending by department vs Income Viz
http://wheredoesmymoneygo.org/dashboard/#focus=TOTAL&year=2009&view=uk-bubble-chart

its the flashy front to the openspending
http://openspending.org/dataset/cra line by line spending data,(
technical details http://wiki.openspending.org/Main_Page , where
treemaps are the better representation of data along with tables
below.)

These figures look like it was difficult for the UK gov to gather* I
know its a long shot but one can only search and ask, and keep an eye
out for when and if the figures are calculated.

Their calculator
https://bitbucket.org/okfn/wdmmg/src/6e3bfefa41dc/wdmmg/lib/calculator.py
requires, by decile

# Row 1 is average gross income per decile - including benefits,
pensions etc (Irish figures SILC 2009
http://www.cso.ie/releasespublications/documents/silc/current/silc.pdf
table 1.5 )
# Row 2 is average direct taxation - income tax, employee NI and
council tax (Irish figures SILC 2009
http://www.cso.ie/releasespublications/documents/silc/current/silc.pdf
table 1.5 )
# Row 3 is average total indirect taxation MINUS VAT, tobacco,
alcohol, & car costs (Irish figures ?) https://www.google.ie/search?hl=en&q=Indirect+Tax+as+a+Percentage+of+Gross+income+by+Decile+(Source%3A+NERI).&gws_rd=ssl
# Row 4 is average total VAT paid (Irish figures ?)

viz does not use figures below yet but would make the viz more
accurate for lower incomes if they included

# Row 5 is average total tobacco tax paid (Irish figures ?)
# Row 6 is average total alcohol tax (beer, cider, wine & spirits)
paid (Irish figures ?)
# Row 7 is average total car-related costs (petrol & car tax) (Irish figures ?)



# We connect the data points by linear interpolation.




the UK designers of WWDMMG got their figures from

National statistics for tax paid per household income decile, 2008/9.
Table 14 in http://www.statistics.gov.uk/CCI/article.asp?ID=2440
*discussion of methodology is in 'Data sources' section on p.4 onwards


Here WWDMG discusses the figures
http://ask.wheredoesmymoneygo.org/questions/37/total-tax-paid-as-a-function-of-income-and-other-variables

I tried to compare these UK figures to Ireland to point out
differences and similarities
https://spreadsheets1.google.com/spreadsheet/ccc?hl=en_GB&key=ta8i70qiEYq7feGi9Z8iVvw&hl=en_GB#gid=4
and calculate results.


here is the js versions dailybread of
https://github.com/okfn/openspendingjs/tree/master/app replacing a few
urls should get some of these working if you copy them onto your own
server, Rufus Pollack is the genius behind it all, at
http://www.openspending.org and http://wheredoesmymoneygo.org/

indirect taxes 2012 http://www.finance.gov.ie/documents/exchequerstatements/2012/Taxprofile.pdf

Fusion Tables, Occupations Ireland map

I've been looking for a reason to use google fusion tables. Here is the result Occupations in Ireland map by Electoral District

Inspired by Guardian Datablog and this example by @manaboutcouch 2006-2011 population change and with a guide fusiontables with Irish census data by rusty at dt106ers blog.

I looked back at using openheatmaps but it easier in fusiontables to upload custom polygons, one could set up openheatmaps yourself and add new boundaries but I'd need more information on how to do that.

I got the broad occupations in the
CSO Database by Electoral districts

• Farming, fishing and forestry managers
• Other agricultural workers
• Manufacturing workers
• Building and construction workers
• Clerical and office workers
• Administrative and Government workers
• Transport workers
• Sales workers
• Professional workers
• Services workers
• Other workers
• Total

I change the raw numbers in percentages of the total in each area so the compared across all areas.

Using 2006 data as the 2011 isn't available yet.
Boundaries files
2006 Census Boundaries shp files

There is an error in files, a Roscommon ED Lough Allen/Altagowlan is listed as 20 not 30, have to change.

The cso data doesn't have the full 5 number CSO code, county electoral area so you have to go down the list add that the county code if you using open office make sure you format and open that row by text to keep the leading zeros.

You can use the free Quantum GIS programme setting projection as TM75/Irish Grid.
Select just the EDs and save as ESRI shapefile, pack the 4 associated files into a zip and upload to shpescape, which will convert it fusion tables kml format.

I converted the CSO data to precentages so I could compare all EDs. Merge with the CSO data with the geometry data by the common CSO Code.

Occupation by County It seems that higher values should be darker but to me the lighter shades jump out more and you can read the location. I took advice to be careful with choropleth maps and used equidistant colors from a HSV gradients.

I tried to adapt these two examples from fusiontables developers blog advanced fusiontables

dynamic styling template
Based on this table
Occupation by ED




You can't show all the map as fusion tables won't load that many polygons. I had trouble hand making gradients to match the varying max numbers in each sector so I used the out of range red to highlight areas with particularily high numbers of that occupation.



I adapted this fusion table to this example with both map and chart.

Fusiontable Occupation Map and chart.

Looking to put all the occupations type in the one view.
Reading about Choropleth maps of the multivariate type like the famous Pop vs Soda map.

I made a map with highest of each type of occupation in each ED.



Created a highest occupation with chart by cso town and by county.

NIUM's AIRO Mapping has similar maps and stats down to small areas.