Updated with Tableau Public dashboard below for years 2010/11.
I did get some help from coders, via scraperwiki although the poor formatting on president.ie frustrated the ability to scrape past engagements,.. need a mass geocoder.
https://scraperwiki.com/scrapers/irish_president_engagements/
https://scraperwiki.com/scrapers/ie_pres_events_details/
Rough presidential engagements data google spreadsheets data garbled after spreadsheet failed
Functions of the President of Ireland - Citizen Information Board of Ireland.
The President is the Irish Head of State, although he or she plays a mainly ceremonial role in the running of the State. The current President of Ireland is Mary McAleese, who commenced serving her second term as President on 11th November, 2004, and which ends in November 2011 with an election campaign beginning in Autumn 2011.
The Government must approve all Presidential communications, messages or addresses, both to the Oireachtas (Irish houses of Parliament) and to the public.
Many of the powers of the President can only be exercised on the advice of the Government. This means that if the President wishes to exercise a power, he or she must first obtain the advice and agreement of the Government.
The President also possesses some powers that he or she cannot exercise without first consulting with the Council of State.
The President's powers include
Appointing members of the Government, judges and other officials
Summoning and dissolving the Dáil
Convening the Oireachtas
Representing the people
Signing Bills and referring Bills to the Supreme Court
Acting as Supreme Commander of the Defence Forces.
Generally the Presidents role is split into three parts, upholding the constitution, representing Ireland internationally and meeting and speaking to communities, charities, services and industry.
There is a lot of skepticism in Ireland as to why a politician or professional who would have made great effect in the previous political life would agree to be so restricted to not be able to make further great change in the role of President separate to the policy of the government of the day. while hoping to show how genuinely busy the President with many many engagements each and week, it also seems strange to have someone so highly qualified and experienced spending so much time meeting people and opening buildings rather then spending their time publicly debating and drafting laws and legislation as opposed as to much more discretely as President in reviewing laws passed by the government in power. New candidates for the President are making pronouncements are how they will carry out the role while there's still little much awareness, scrutiny or critique of the details of the President's work. I think the President role is to shake the hands of other foreign heads of state, presidents and kings on deals made by their governments, the weight of the decisions is on the President, similarly with the domestic laws. So I thought I would visualise the President's official diary to see how much time they spend on each role and sub-categorize their acts and engagements.
The President is one of the few Irish politicians who with regularity publishes their diary in public ahead of time on publically accessible web site rather then only directed towards the press. I think the impression of the Presidents would be improved if there were more ways to find out and keep track of their work. The diary should be put in well formatted and reusable format (such as .ics calendar file) and the license that could be spread around to be reused in whole or in part to keep people informed.
Scraperwiki
I have tried to code a scraper puts its such a steep learning curve with so much presumed knowledge, I've previously failed to grasp the looping and syntax needed and there are few examples that you can apply generally. So I put in a request to scraperwiki for some help, a user finddb wrote a ruby scraper which scraped the 2011 engagements. This gave me a csv file I could download and import into a google spreadsheet Although grateful for somebody to write the code for me, I need to split up the time_place variable to possibly geocode the address via Scraperwiki and figure out how scrape all past and future dates and to output and receive the information as it updates daily and weekly, and find the ideal way to share and display the stream of data.
Two coders attempted to scrape the badly formatted engagements data from the president website, but it was too onerous a task and is incomplete. They are about 6,000 records.
Matt's irish_president_engagements scrapper.
Owl's ie_pres_events_details scrapper.
Engagements
I have categorised the engagements as date, year, time, destination, region (destf), day, address, latlng, arasnotaras, details, place, act, issue, constitutional, month. This need further review, further accuracy in geocoding and further judgement on the types of engagement and category which should be applied, I could probably categories more of the foreign affairs as economics trips. I've tried to isolate the active verb, the location, the place, the parties met in each engagement and a more general category of the issue associated with the event. I have categories whether this was constitutional act in regard to reviewing laws, appointing members of government after elections, receiving and appointing ambassador and carrying out state visits or more general public engagements.
Entity Extraction
Entity extraction still isn't easy or perfect, web services come and go, I have used Alchemy API, using the importxml formula in my google spreadsheet. Have to find someway of using all these API's on my spreadsheets beyond the google import limit of 50.
Tagclouds
Word clouds have a bad reputation as anything in chart junk, particularly with word length exaggerating or undermining the importance of a word, but the more I look at the above the more I think it might a useful way to see straight away the keywords of the engagements, school, community centre, Ambassador from Brazil, signed Justice act etc without having to drill down or match colours with issues. I have been looking at the following examples, making it in R or Prefuse seems be the best bet for it, if I can find anyone who done similar.
text analysis election08 stump speeches Tableau word clouds example
geography of presidential campaign rhetoric
Maple – a Web Map Service for Verbal Visualisation Using Tag Clouds Generated from Map Feature Frequencies
timecloud by stef
carto junk
mapping londons surnames
tagmaps discontinued - yahoo
Building a better word cloud Vidi tagmap
tag map using engagement data ugh.
Exhibit
As I have used many, times, before again I used MIT's Simile Exhibit, the faceted browsing dashboard which allows you to map, list and timeline and drill down through data and which is relative easy to make. I used the calendar extension for the first time, make sure you get all the files it needs. Exhibit receives data in JSON form which you can output from a google spreadsheet so that you can edit it by hand.
Irish Presidential Engagements Exhibit. Unfortunately this doesn't work anymore I went over the formula limit in the spreadsheet and now can't revert the document. Google spreadsheets is both great and crap.You can click on any of the word clouds or select any facet from the sidebar to focus on the engagements on the map or the timeline. Click on the calendar tab or the details tables for further info.
I know there too much info on the screen but I use these exhibit as working visualizations to sort through the information and add categories to chop up the data, and figure out how it works, I'm using the in-google spreadsheet geocoding which is restricted to 50 addresses geocoded at a time, I still need to review each address again.
TimeFlow
TimeFlow by Flowingmedia is desktop program for viewing large amounts of information, it was bought by google and its public development stopped but you can download and use an alpha release by importing csv files.
Tableau Public
Used the freemium visualization dashboard Tableau Public to show map and timeflow style overview of engagements with some interactivity.
