tag:blogger.com,1999:blog-27316414683702144472024-02-19T06:31:38.532+00:00This week I've been mostly reading ...Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.comBlogger84125tag:blogger.com,1999:blog-2731641468370214447.post-15761045138150091012012-11-29T17:11:00.003+00:002012-11-29T17:11:48.585+00:00Key Clouds for the four-volume Leveson Inquiry ReportAnd just in case you haven't had time to read all 1,078,416 words in the Leveson Inquiry Report, here are the Key Clouds produced by Wmatrix for all four volumes conflated together. I took the reports available from the Inquiry website (<a href="http://www.levesoninquiry.org.uk/">http://www.levesoninquiry.org.uk/</a>), downloaded the PDFs, converted them to text using PDFbox ExtractText tool (<a href="http://pdfbox.apache.org/commandlineutilities/ExtractText.html">http://pdfbox.apache.org/commandlineutilities/ExtractText.html</a>) and then loaded them in to Wmatrix (<a href="http://ucrel.lancs.ac.uk/wmatrix/">http://ucrel.lancs.ac.uk/wmatrix/</a>) and compared them to the BNC written sampler.<br />
<br />
The statistically most significant key words (i.e. not just the most frequent words) are:<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhFqRsQApzpRhd8O-x6gY-bGhlt-33V8YjUfYb4S-NfaEnKK9S8k_fEjUhYIGMK3RPs3QOo-RiFjKB3fiXDJq8JXTwYhFqWBYXStawqUJGsGIpO1x19nq0Wc7byGfg72JxHPe9EnDuMJcE/s1600/All4VolsWords.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="260" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhFqRsQApzpRhd8O-x6gY-bGhlt-33V8YjUfYb4S-NfaEnKK9S8k_fEjUhYIGMK3RPs3QOo-RiFjKB3fiXDJq8JXTwYhFqWBYXStawqUJGsGIpO1x19nq0Wc7byGfg72JxHPe9EnDuMJcE/s640/All4VolsWords.png" width="640" /></a></div>
<br />
And the statistically most significant key semantic categories are:<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg96gfTwGjgQ71Yv1XUV8inrSoHH21mU-zUTVnta8kI9Y40yIWlQqFi6pN1IjxUxPUSb847EvgdoYCLPZ8tGrrTPkyMWNZSXp6j0Yw-_p5lojPLphSSd0Lf1TBG0AzSBgZw8sqDGNrwHs0/s1600/All4VolsTags.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="314" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg96gfTwGjgQ71Yv1XUV8inrSoHH21mU-zUTVnta8kI9Y40yIWlQqFi6pN1IjxUxPUSb847EvgdoYCLPZ8tGrrTPkyMWNZSXp6j0Yw-_p5lojPLphSSd0Lf1TBG0AzSBgZw8sqDGNrwHs0/s640/All4VolsTags.png" width="640" /></a></div>
<br />
All these items are significant, but the larger the font, the more significant they are. If you want to have a look at these texts in Wmatrix, just let me know and I can share the folders with you. You'll then be able to click through the clouds to see each example of the word and tags in context.<br />
<br />Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-8803565450284293752012-11-29T16:00:00.001+00:002012-11-29T16:00:28.249+00:00Clouds for Leveson Inquiry Executive SummaryIf you don't have time to read even the Executive Summary of the Leveson report (26345 words) published today, then here's what Wmatrix shows as the key words compared to the BNC sampler written reference corpus:<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgiFcjIUoFrUikoMAuV8sv1Bb1RXRnOZmM7V-Dobw-H_pfjb6D8mQjuPp4QheS2LO7CJpvl5dQPtamSMUu3MbvWaKonrZT1wDdG3-5tm5-leG5oFzsEw50cQ_CYfvpwbhMF_8vFyq6QXJY/s1600/ExecSumWords.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="297" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgiFcjIUoFrUikoMAuV8sv1Bb1RXRnOZmM7V-Dobw-H_pfjb6D8mQjuPp4QheS2LO7CJpvl5dQPtamSMUu3MbvWaKonrZT1wDdG3-5tm5-leG5oFzsEw50cQ_CYfvpwbhMF_8vFyq6QXJY/s640/ExecSumWords.png" width="640" /></a></div>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<div class="separator" style="clear: both; text-align: left;">
<br /></div>
<div class="separator" style="clear: both; text-align: left;">
And now for the key semantic tags:</div>
<div class="separator" style="clear: both; text-align: left;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiXVzs0tUGpTXrRWYkhbfV3CcYkPOw6F9yOAePsSeFAnMXIYqhEfkap-t5pYOgvUedYGdmbh-pnTkuQGpjWhKZNNA6Rd6yN5NJtzhAadHC4xu8o6rtf0g4_U5y_z4Le4jgruUg9WjQLQEs/s1600/ExecSumTags.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="234" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiXVzs0tUGpTXrRWYkhbfV3CcYkPOw6F9yOAePsSeFAnMXIYqhEfkap-t5pYOgvUedYGdmbh-pnTkuQGpjWhKZNNA6Rd6yN5NJtzhAadHC4xu8o6rtf0g4_U5y_z4Le4jgruUg9WjQLQEs/s640/ExecSumTags.png" width="640" /></a></div>
<br />Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-68016708391427155892012-08-05T08:10:00.001+01:002012-08-05T08:11:50.091+01:00Mac tips part 7: moving your iTunes library to a new computerI decided to blog this one rather than tweet it. I needed to shift my iTunes library from my old MacBook to the new MacBook Pro so that I can sync with my shiny new iPad. Follow these instructions if you need to do so. Note that it shifts everything in your library not just your music: <a href="http://support.apple.com/kb/HT4527">http://support.apple.com/kb/HT4527</a>Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-66639409242661111192011-02-14T21:19:00.000+00:002011-02-14T21:19:13.488+00:00IBM computer Watson plays JeopardyIBM are in the <a href="http://www.bbc.co.uk/news/technology-12424403">news</a> again in relation to AI. Their computer (Watson) is playing in the American TV programme Jeopardy.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-45436022969809543512010-11-05T08:28:00.000+00:002010-11-05T08:28:40.701+00:00Review of UK copyright lawsA change in <a href="http://www.bbc.co.uk/news/uk-politics-11695416">fair use in UK law</a> might help corpus-based language researchers?Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-73243829003463940542010-10-31T21:07:00.000+00:002010-10-31T21:07:45.610+00:00BBC News: How do you pronounce 'H'?The British Library is carrying out a survey of how spoken English is changing: <a href="http://www.bbc.co.uk/news/magazine-11642588">http://www.bbc.co.uk/news/magazine-11642588</a>Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-50847560029887805902010-09-29T14:02:00.000+01:002010-09-29T14:02:34.601+01:00Fred Jelinek RIPIt has been reported elsewhere (<a href="http://googleresearch.blogspot.com/2010/09/remembering-fred-jelinek.html">Google research blog</a>, <a href="http://www.nytimes.com/2010/09/24/business/24jelinek.html">New York Times</a>, <a href="http://languagelog.ldc.upenn.edu/nll/?p=2631">Language Log</a>, <a href="http://domino.research.ibm.com/comm/research.nsf/pages/d.compsci.fred.jelinek.obit.html">IBM Research</a>) that Fred Jelinek passed away on September 14th, 2010. I heard Fred (at a talk in Prague I think) repeat his famous 'quote' about the accuracy of his MT system going up when the linguists left the room!Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-51509571912183313602010-08-28T23:11:00.000+01:002010-08-28T23:11:32.296+01:00The Little Book of Sustainable LivingProduced by the Recycling Forum in the Lancaster area. Lots of interesting tips in <a href="http://www.lancaster.gov.uk/community-and-living/sustainable-living/little-book-of-sustainable-living">this booklet</a>.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-16347164337322341932010-08-21T16:56:00.000+01:002010-08-21T16:56:52.125+01:00David Lodge: Deaf sentence<a href="http://www.amazon.com/Deaf-Sentence-A-Novel-ebook/dp/B002N83H1G?ie=UTF8&tag=thisweekivebe-21&link_code=bil&camp=213689&creative=392969" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;" target="_blank"><img alt="Deaf Sentence: A Novel" src="http://ws.amazon.com/widgets/q?MarketPlace=US&ServiceVersion=20070822&ID=AsinImage&WS=1&Format=_SL160_&ASIN=B002N83H1G&tag=thisweekivebe-21" /></a><img alt="" border="0" height="1" src="http://www.assoc-amazon.com/e/ir?t=thisweekivebe-21&l=bil&camp=213689&creative=392969&o=1&a=B002N83H1G" style="border: medium none ! important; margin: 0px ! important; padding: 0px ! important;" width="1" />And the other book I read on the beach (two books in a week!) was David Lodge's Deaf Sentence. Although the UK cover quotes the Guardian "Very funny" and the New Statesman "Seriously funny", I'd probably pick out the following key words: death, suicide and obviously deafness. Okay, so corpus linguistics gets a mention (page 32 in my edition).Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-6516625816713345902010-08-21T16:46:00.000+01:002010-08-21T16:46:14.857+01:00Iain M Banks: Feersum Endjinn<a href="http://www.amazon.com/Feersum-Endjinn-Iain-M-Banks/dp/0553374591?ie=UTF8&tag=thisweekivebe-21&link_code=bil&camp=213689&creative=392969" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;" target="_blank"><img alt="Feersum Endjinn" src="http://ws.amazon.com/widgets/q?MarketPlace=US&ServiceVersion=20070822&ID=AsinImage&WS=1&Format=_SL160_&ASIN=0553374591&tag=thisweekivebe-21" /></a><img alt="" border="0" height="1" src="http://www.assoc-amazon.com/e/ir?t=thisweekivebe-21&l=bil&camp=213689&creative=392969&o=1&a=0553374591" style="border: medium none ! important; margin: 0px ! important; padding: 0px ! important;" width="1" />While sitting on the beach recently, I read Feersum Endjinn by Iain M. Banks, recommended by Stuart. Okay, it did have something to do with work: one of the main character's thoughts are written in SMS-style shortenings and abbreviations.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-37691410063605588282010-07-01T16:19:00.002+01:002010-07-01T16:22:14.466+01:00What are you doing here?A fantastic montage of clips from Doctor Who over the last 11 doctors:<br /><br /><a href="http://www.youtube.com/watch?v=DtG5dK_HaGg">http://www.youtube.com/watch?v=DtG5dK_HaGg</a><br /><br />Thanks to Jam for spotting that one.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-37636885744394543252010-04-28T21:41:00.002+01:002010-04-28T21:42:37.009+01:00Libdem manifesto key concepts<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhmZat_k62iu0eIu9hvVjnB6IGgneEdMYDmOuf4r_G5hMqsDl0pRBZutzQJa8OWy51I85K5YzU8eO_6wELRxOU-a39hY-7SDtGVL0pbox7qThKHSJ9px8eiktaXaYTtkv4sJmMFI0wsDmk/s1600/LibdemKeyConcepts.png"><img style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 400px; height: 170px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhmZat_k62iu0eIu9hvVjnB6IGgneEdMYDmOuf4r_G5hMqsDl0pRBZutzQJa8OWy51I85K5YzU8eO_6wELRxOU-a39hY-7SDtGVL0pbox7qThKHSJ9px8eiktaXaYTtkv4sJmMFI0wsDmk/s400/LibdemKeyConcepts.png" alt="" id="BLOGGER_PHOTO_ID_5465291551693744290" border="0" /></a><br />And finally the key concepts for the Libdem manifesto.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-3879593773062027622010-04-28T21:38:00.003+01:002010-04-28T21:41:19.067+01:00Labour key concept cloud<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgI0Vevd1NNEl31t79UDDlTvD6wNo6GI40ztr834-RY_ctiJwolkXyWmcB1ZkgXg6pbQzDo7JVDSL6U1S4VQ0QSfKkvhBDbxMqT1uac2RIZ9J1g0JnxoBkFo1DNlvWIdMblYznWSO0BuOk/s1600/LabourKeyConcepts.png"><img style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 400px; height: 161px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgI0Vevd1NNEl31t79UDDlTvD6wNo6GI40ztr834-RY_ctiJwolkXyWmcB1ZkgXg6pbQzDo7JVDSL6U1S4VQ0QSfKkvhBDbxMqT1uac2RIZ9J1g0JnxoBkFo1DNlvWIdMblYznWSO0BuOk/s400/LabourKeyConcepts.png" alt="" id="BLOGGER_PHOTO_ID_5465290759475850962" border="0" /></a><br />And here's the key concept cloud from the Labour manifesto ... there seems to be much more variety of concepts here and hence the cloud is much bigger. I had to shrink it further to get it all in one screenshot.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-51296713364362491702010-04-28T21:33:00.003+01:002010-04-28T21:37:48.014+01:00Conservative key concept cloud<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiTY1_nMGrVrdNdQBTBhyKwXKwQSNrW57bnmLoOMFgMUz9B9N1Cn9xvyFdCNdzmwjOczWX7Rk0HNyIJELDUgemvSUmIv-qUsqqTidjEXc5W6v5b1hBftIVsc4mzG5bTYc4MZWctcdyhsXU/s1600/ConservativeKeyConcepts.png"><img style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 400px; height: 202px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiTY1_nMGrVrdNdQBTBhyKwXKwQSNrW57bnmLoOMFgMUz9B9N1Cn9xvyFdCNdzmwjOczWX7Rk0HNyIJELDUgemvSUmIv-qUsqqTidjEXc5W6v5b1hBftIVsc4mzG5bTYc4MZWctcdyhsXU/s400/ConservativeKeyConcepts.png" alt="" id="BLOGGER_PHOTO_ID_5465290283542923394" border="0" /></a><br />In addition to key words, <a href="http://ucrel.lancs.ac.uk/wmatrix/">Wmatrix</a> can produce key concepts by comparing a frequency list of semantic fields automatically tagged in the data with a reference corpus, again here the BNC written sampler. This shows statistically key concepts in the Conservative manifestoPaulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-49237872869298217592010-04-20T22:54:00.004+01:002010-04-20T23:08:27.785+01:00TEI versions of UK election manifestosMeanwhile, somewhere deep in France with a laptop, <a href="http://users.ox.ac.uk/%7Elou/">Lou Burnard</a> has created TEI encoded versions of the UK election manifestos, tagged and lemmatised them with TreeTagger. Download from <a href="http://ucrel.lancs.ac.uk/wmatrix/ukmanifestos2010/TEIversion/">http://ucrel.lancs.ac.uk/wmatrix/ukmanifestos2010/TEIversion/</a><br /><br />Thanks Lou!Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-18078393112059722452010-04-20T11:31:00.004+01:002010-04-20T11:36:23.233+01:00Updated Libdem manifesto and cloud<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhYPWxewPWlPehB3_iwSW4JSm237d1N47OCsUhvmB0iRzihiLTLZdaZggevLn7iWHhVPlKh3bK4fjIrp-WGTl0cHl2cfp6-AqEKTEPgdYW5Gzm6QfbEzVudW8Spp3UFgyIClEblQFuQShA/s1600/LibdemKeyWordsv2.png"><img style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 603px; height: 244px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhYPWxewPWlPehB3_iwSW4JSm237d1N47OCsUhvmB0iRzihiLTLZdaZggevLn7iWHhVPlKh3bK4fjIrp-WGTl0cHl2cfp6-AqEKTEPgdYW5Gzm6QfbEzVudW8Spp3UFgyIClEblQFuQShA/s400/LibdemKeyWordsv2.png" alt="" id="BLOGGER_PHOTO_ID_5462166332361568786" border="0" /></a><br />Lou Burnard spotted some conversion errors in the Libdem manifesto (extra spaces after ligatures e.g. 'fi') and Martin has now fixed smart quotes to straight ones. The new text version of the Libdem manifesto is at <a href="http://ucrel.lancs.ac.uk/wmatrix/ukmanifestos2010/">http://ucrel.lancs.ac.uk/wmatrix/ukmanifestos2010/</a> and here is the updated key word cloud. You'll notice the main difference is that "Britains" is no longer key because it was actually "Britain's" and the apostrophe now being fixed means that it combines its frequency with "Britain".Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-24681269257905417712010-04-15T22:36:00.003+01:002010-04-15T22:39:56.647+01:00Libdem manifesto key words<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhEQr3ZJvpQMpjQqPOgL0BuHl9-kM9di-aSEImHQ4_jyuTniKEp8QWa7kxmXOv8SzZSEYyhXICPghYHQ29KMueJOM9fL9cg8qTbxTiQf_vEh8H6ZSua5YqyBNnbKWQseRrjVTx9G3jholU/s1600/LibdemKeyWords.png"><img style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 622px; height: 255px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhEQr3ZJvpQMpjQqPOgL0BuHl9-kM9di-aSEImHQ4_jyuTniKEp8QWa7kxmXOv8SzZSEYyhXICPghYHQ29KMueJOM9fL9cg8qTbxTiQf_vEh8H6ZSua5YqyBNnbKWQseRrjVTx9G3jholU/s400/LibdemKeyWords.png" alt="" id="BLOGGER_PHOTO_ID_5460481668000436578" border="0" /></a><br />And finally the Liberal Democrat manifesto key word cloud.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-80677969708890379082010-04-15T22:33:00.003+01:002010-04-15T22:35:20.224+01:00Labour key word cloud<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiGKEfpJ7rlZy2V7n0aqvsW6Ue4KMgRctGTd3O1QlWGNcrrRrTY_MVTgj8j6Hz8y7RgW2A6y_CSMybqbcPkc7frOrRlEhxEPgn_ivFsN_zFTNQumiVPHZitiY5Y0KywM_2vfxjlO-G98fU/s1600/LabourKeyWords.png"><img style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 649px; height: 251px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiGKEfpJ7rlZy2V7n0aqvsW6Ue4KMgRctGTd3O1QlWGNcrrRrTY_MVTgj8j6Hz8y7RgW2A6y_CSMybqbcPkc7frOrRlEhxEPgn_ivFsN_zFTNQumiVPHZitiY5Y0KywM_2vfxjlO-G98fU/s400/LabourKeyWords.png" alt="" id="BLOGGER_PHOTO_ID_5460480746270095250" border="0" /></a><br />And here's the Labour key word cloud ...Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-3202697836104926722010-04-15T22:24:00.005+01:002010-04-15T22:32:16.647+01:00Conservative key word cloud<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEipKRdLxBxuZE4NFGr3zOuBxprv1R32RbRyBAzeC-ioIHRHOhJ44XcByFHyWWzzruXg9JO4Mhyphenhyphenzfd-QeCVgx13B1SyMTnyxv0vWS2-eQbkXkgV3uhWSKhjfiJzoFipK2kvJDK7AWD0ip7g/s1600/ConservativeKeyWords.png"><img style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 596px; height: 243px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEipKRdLxBxuZE4NFGr3zOuBxprv1R32RbRyBAzeC-ioIHRHOhJ44XcByFHyWWzzruXg9JO4Mhyphenhyphenzfd-QeCVgx13B1SyMTnyxv0vWS2-eQbkXkgV3uhWSKhjfiJzoFipK2kvJDK7AWD0ip7g/s400/ConservativeKeyWords.png" alt="" id="BLOGGER_PHOTO_ID_5460479857200016322" border="0" /></a><br />Unlike tag clouds or those produced by Wordle where the size of a word depends on its frequency, the Wmatrix key word clouds show words where their size is related to their statistical keyness i.e. how different their frequency is from what it is expected to be (based on a large reference corpus). Here's the conservative key word cloud.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-20579862583084718812010-04-15T21:49:00.003+01:002010-04-15T22:23:23.700+01:00UK election manifestos 2010This week I've been reading the UK election manifestos, or rather I've set <a href="http://ucrel.lancs.ac.uk/wmatrix/">Wmatrix</a> to read them for me. First, you have to convert the online versions in PDF or HTML into plain text. Saving automatically from Acrobat as plain text leaves unwanted headers and footers and some lost capitalisation. Thanks to <a href="http://users.ox.ac.uk/%7Emartinw/">Martin Wynne</a> for editing the Libdem and Conservative files. I've edited the Labour manifesto by taking the HTML version from their website and marking the chapter boundaries with a pseudo-XML tag. The edited full plain text versions are available to download at: <a href="http://ucrel.lancs.ac.uk/wmatrix/ukmanifestos2010/">http://ucrel.lancs.ac.uk/wmatrix/ukmanifestos2010/</a><br /><br />Labour's manifesto is 29,508 words long. The Conservative manifesto is 27,562 words and the LibDem one is shorter at 18,433 words.<br /><br />Next, I loaded the files into Wmatrix and compared them to a general reference corpus for written British English. Key word clouds coming up ...Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-6771645210373355102010-04-09T12:07:00.002+01:002010-04-09T12:09:39.631+01:00Windows to mac tips part 6: control-alt-delete for OSXTwo years later and I'm still finding out new shortcuts!<br /><br />If you want the equivalent of control-alt-delete on OSX then use command-option-escape and you can force an application to quit.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-42535178766638680192010-03-21T17:18:00.003+00:002010-03-21T17:21:37.837+00:00NLP blog reports weird results in Google 5-gram listHas anyone else spotted similar stuff to <a href="http://nlpers.blogspot.com/2010/02/google-5gram-corpus-has-unreasonable.html">this</a>?<br /><br />Recently Oliver Charles (an undergrad at Lancaster University) has been comparing Google, Bing and Yahoo word counts for several thousand single words and MWEs. Paper coming soon!Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-21100705142460746052010-03-06T17:05:00.003+00:002010-03-06T17:10:19.540+00:00Windows to mac tips part 5: zip with passwordIf you're used to Winzip or the Windows built in possibility to add a password to a zip file, then this can be done on OSX with "zip -e zipfile.zip /dir/files*" on the command line. You're then prompted for a password. To unzip, I've found it best to use Stuffit expander rather than the default archive utility.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-79319902594367771292010-01-09T10:02:00.001+00:002010-01-09T10:04:32.165+00:00Computing in the newsAI and chatbots are made famous in a <a href="http://news.bbc.co.uk/1/hi/technology/8426523.stm">BBC News story about game design</a>.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0tag:blogger.com,1999:blog-2731641468370214447.post-83827607294228633102010-01-09T09:53:00.004+00:002010-01-09T10:01:00.296+00:00Apple Forum posts on iPod Touch crashing appsIt seems that this is happening a lot with third party apps on the iPod Touch. It begins with one app crashing as soon as you open it and eventually all the other third party apps stop working. There are a lot of solutions offered on the forums <a href="http://discussions.apple.com/thread.jspa?threadID=1813696&start=0&tstart=0">here</a> and <a href="http://discussions.apple.com/thread.jspa?threadID=1717546&start=0&tstart=15">here</a>, but the only thing that worked for me was a complete reset.Paulhttp://www.blogger.com/profile/11615950836740623686noreply@blogger.com0