<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>ulken.com &#187; Derek Willis</title>
	<atom:link href="http://ulken.com/tag/derek-willis/feed/" rel="self" type="application/rss+xml" />
	<link>http://ulken.com</link>
	<description>Just another WordPress weblog</description>
	<lastBuildDate>Fri, 20 Aug 2010 15:09:29 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Making sense of data at The New York Times</title>
		<link>http://ulken.com/2009/01/08/making-sense-of-data-at-the-new-york-times/</link>
		<comments>http://ulken.com/2009/01/08/making-sense-of-data-at-the-new-york-times/#comments</comments>
		<pubDate>Thu, 08 Jan 2009 21:41:25 +0000</pubDate>
		<dc:creator>Eric Ulken</dc:creator>
				<category><![CDATA[Profiles]]></category>
		<category><![CDATA[Amazon.com]]></category>
		<category><![CDATA[Aron Pilhofer]]></category>
		<category><![CDATA[Center for Public Integrity]]></category>
		<category><![CDATA[Derek Willis]]></category>
		<category><![CDATA[Marc Frons]]></category>
		<category><![CDATA[Matthew Ericson]]></category>
		<category><![CDATA[Ruby on Rails]]></category>
		<category><![CDATA[The New York Times]]></category>

		<guid isPermaLink="false">http://ulken.com/?p=325</guid>
		<description><![CDATA[(After a long holiday hiatus, I&#8217;m finally getting around to posting this write-up of my visit with Aron Pilhofer at the NYT.)

Tuesday, Dec. 23, 2008: The digital art installation in the lobby of the new New York Times building says more, I think, about the future of news and of the Times Company than its [...]]]></description>
			<content:encoded><![CDATA[<p>(After a long holiday hiatus, I&#8217;m finally getting around to posting this write-up of my visit with Aron Pilhofer at the NYT.)</p>
<p><a href="http://flickr.com/photos/eulken/3151066259/"><img src="http://ulken.com/w/wp-content/uploads/2008/12/nyt.jpg" alt="&quot;Movable Type&quot; at The New York Times building" title="&quot;Movable Type&quot; at The New York Times building" width="420" height="221" class="size-full wp-image-326" /></a></p>
<p><b>Tuesday, Dec. 23, 2008:</b> The digital art installation in the lobby of the new New York Times building says more, I think, about the future of news and of the Times Company than its creators may have intended. Yes, we know that the future is digital and real-time and kinetic, like the work by <a href="http://www.youtube.com/watch?v=WfZQf1983iw">Mark Hansen and Ben Rubin</a>. But, more than that, the journalism of the future will be defined by its capacity to extract meaning from countless bits of data. The work, titled <a href="http://www.nytco.com/pdf/Moveable_Type.pdf">Movable Type</a>, elegantly illustrates the bits. Making sense of them is <a href="http://twitter.com/pilhofer/">Aron Pilhofer</a>&#8217;s domain.</p>
<p>It is my first visit to the <a href="http://newyorktimesbuilding.com/">new building</a>, directly across 8th Avenue from the Port Authority Bus Terminal. I am meeting Pilhofer, who leads the paper&#8217;s interactive news technology team, for a quick tour and chat. His group of 10 developers, assembled over the last year or so, works on editorial projects (such as the Times&#8217; <a href="http://elections.nytimes.com/2008/results/president/votes.html">live election results</a>) but doesn&#8217;t report to the newsroom. Their boss is <a href="http://www.nytimes.com/2008/07/28/business/media/28askthetimes.html">Marc Frons</a>, the website&#8217;s CTO.</p>
<p>Over cups of caffeinated liquid in the Times&#8217; airy 14th-floor cafeteria, Pilhofer tells me about <a href="http://prototype.nytimes.com/represent/">Represent</a>, a newly launched project from his team that, as the name suggests, lets you &#8220;keep track of what <a href="http://prototype.nytimes.com/represent/98-Rivington-St-New-York-NY-10002/">the people who represent you</a> are doing.&#8221; Though still in <a href="http://open.blogs.nytimes.com/2008/12/22/represent/">soft launch</a>, it&#8217;s already <a href="http://blog.wired.com/business/2008/12/new-york-times.html">generating</a> <a href="http://maphawk.blogspot.com/2008/12/ny-times-goes-beta-with-represent.html">some</a> <a href="http://www.mediabistro.com/fishbowlny/newspapers/the_nytcom_is_representing_104167.asp">nice</a> <a href="http://blog.programmableweb.com/2008/12/27/the-new-york-times-rolls-its-own-map-mashup-represent/">buzz</a>. (A <a href="http://blog.thescoop.org/archives/2008/12/19/represent-and-geodjango/">bit on the tech specs</a> from co-creator Derek Willis: They&#8217;re using <a href="http://geodjango.org/">GeoDjango</a> to drive the mapping features.)</p>
<p>Pilhofer is an archetypal journo-techie, raised in the computer-assisted reporting school and fluent both in the cadences of the newsroom and in the technical lingo used by his fellow geeks. Before joining the Times&#8217; computer-assisted reporting team, he honed his skills at the <a href="http://www.publicintegrity.org/">Center for Public Integrity</a>, a D.C. nonprofit that seems to have been a sort of proving ground for smart, webby CAR folks (<a href="http://blog.thescoop.org/">Willis</a> and my former LAT colleague, <a href="http://www.palewire.com/">Ben Welsh</a>, are also alums).</p>
<p>This is the breed of journalist that web-oriented newsrooms would like to find more of. The problem is, &#8220;they just don&#8217;t exist,&#8221; Pilhofer says of his ilk. When I throw out the old question about whether it&#8217;s easier to teach a journalist programming skills or to teach a techie the principles of journalism, he tells me it&#8217;s not so much a question of trainability. Rather, he says, &#8220;there are more programmers out there that will find journalism interesting to learn&#8221; than vice-versa. He tells me that, with a couple of exceptions, the people on his team have either &#8220;very limited journalism experience or none whatsoever.&#8221;</p>
<p>Given that most of Pilhofer&#8217;s group comes from a hardcore tech background, I wonder whether they&#8217;ve acceded to rigid product development conventions like wireframes and detailed requirements documents. His response: &#8220;Hell no.&#8221; (Actually, he uses a more colorful four-letter word, but you get the point.)</p>
<p>He does throw out a lot of prod-dev terms like <a href="http://en.wikipedia.org/wiki/Agile_software_development">agile development</a>, <a href="http://en.wikipedia.org/wiki/Scrum_(development)">scrums</a>, <a href="http://en.wikipedia.org/wiki/Extreme_programming">Extreme Programming</a> and <a href="http://en.wikipedia.org/wiki/Pair_programming">pair programming</a>, but he uses newsroom analogies to describe them. Agile development methodology, for example, which stresses frequent deadlines and shuns long meetings, has a lot in common with the rhythm of a newsroom. And pair programming, an unconventional workflow in which two coders work in tandem on the same problem and test each other&#8217;s work as they go, is analogous to team reporting.</p>
<p>Some other highlights from our chat:</p>
<p>+++<br />
<b>Software:</b> Pilhofer says his team relies heavily on <a href="http://en.wikipedia.org/wiki/Open_source">open-source</a> solutions. <a href="http://rubyonrails.org/">Ruby on Rails</a> is the workhorse in this shop, but it&#8217;s been adapted to produce flat files when necessary (as opposed to rendering pages on the fly), a performance tweak that enabled the Times to keep up with <a href="http://www.journalism.co.uk/5/articles/532757.php">unprecedented traffic</a> to its election results data.<br />
+++</p>
<p>+++<br />
<b>Hosting:</b> Amazon&#8217;s <a href="http://aws.amazon.com/ec2/">EC2</a> service, used for most of the team&#8217;s data projects, has enabled them to scale with demand.  &#8220;Amazon has been the savior of this group,&#8221; Pilhofer says.<br />
+++</p>
<p>+++<br />
<b>Newsroom geography:</b> The interactive news technology group sits on the Times building&#8217;s second floor, in close proximity to the graphics and CAR teams, the two groups Pilhofer says his team works most closely with. (The paper&#8217;s business desk takes up much of the rest of the floor.) The graphics desk, in particular, has been a close collaborator, bringing sophisticated visual interpretations to many of the team&#8217;s projects. Pilhofer calls deputy graphics director <a href="http://www.ericson.net/home/index.php">Matthew Ericson</a> the &#8220;de facto co-manager&#8221; of the interactive news technology team.<br />
+++</p>
<p>+++<br />
<b>Roles and hierarchy:</b> Responsibility for the Times&#8217; interactive projects is shared among Pilhofer&#8217;s team, the graphics department and other groups in the newsroom (a highly collaborative, loosely organized structure that reminds me of how interactive projects got done at the L.A. Times, but on a much larger scale). &#8220;I kind of like the way it&#8217;s working right now, where there isn&#8217;t some big, centralized, one-person-in-charge-of-everything,&#8221; Pilhofer says. &#8220;I think it&#8217;s healthier.&#8221; Each group brings certain strengths. For instance, the graphics folks want to do really intense, deep immersive online interactives, but they can&#8217;t do that without back-end help from Pilhofer&#8217;s team, so the two groups work together. Organizationally, Pilhofer says his team benefits from a direct connection to the website&#8217;s software and infrastructure folks while other teams are more closely tied to the newsroom. The downside to this setup, of course, is that it&#8217;s sometimes hard to know who owns what.<br />
+++</p>
<p><b>More Pilhofer:</b> Old Media, New Tricks recently published an <a href="http://www.oldmedianewtricks.com/old-media-interview-Pilhofer-pilhofer-interactive-guru-editor-at-the-new-york-times/">interview with Pilhofer</a>.</p>
<p><b>Update 2009.01.13:</b> Emily Nussbaum has a <a href="http://nymag.com/news/features/all-new/53344/">feature on Pilhofer, Ericson and other NYT geeks</a> in New York Magazine.</p>
<p><b>Coming next week:</b> A look at <a href="http://generalapp.newschallenge.org/SNC/ViewItem.aspx?pguid=4a4f8c6a-d2c2-4545-82db-c8ed4b415eba&#038;itemguid=902c283a-144d-4f7c-8287-3b44565312fd">DocumentCloud</a>, a promising Knight News Challenge proposal from Pilhofer and ProPublica&#8217;s Eric Umansky and Scott Klein.</p>
<p><i>Photo by <a href="http://flickr.com/photos/eulken/3151066259/">Eric Ulken</a>.</i></p>
]]></content:encoded>
			<wfw:commentRss>http://ulken.com/2009/01/08/making-sense-of-data-at-the-new-york-times/feed/</wfw:commentRss>
		<slash:comments>9</slash:comments>
		</item>
	</channel>
</rss>
