Researching and developing non-traditional analytic methods and communications tools for journalism.

Ver 1.0 Proceedings ON SALE NOW!
Co-directors:
  • Steve Doig - Tempe
  • Tom Johnson - Santa Fe
  • Steve Ross - Boston
    Fellows:
  • Patrick Mattimore - San Francisco & Geneva, Switzerland
  • John R. Sadd - Boston & Santa Fe
  • George T. Duncan - Pittsburgh, PA & Santa Fe

    Recent IAJ publications,
    presentations and workshops
    Postings This Month
    October 2005
    Sun Mon Tue Wed Thu Fri Sat
    1
    2 3 4 5 6 7 8
    9 10 11 12 13 14 15
    16 17 18 19 20 21 22
    23 24 25 26 27 28 29
    30 31
    Year Archive
  • View Article  So how do we measure sprawl? With precision?
    Kenneth Chang, of the NYTimes, had an interesting "Ideas & Treands" piece yesterday.  He was writing about the evolution of standards and precision in measurement.  Just how long is a meter -- a REAL meter?  There can be measurement of physical things, of course, like distance or weight.  But perhaps journalists should be talking about the standard defintion of concepts such as "urban sprawl" or a "landslide victory."

    "October 16, 2005

    Measuring the World: From Material to Ethereal

    LOCKED in a vault in Paris is a cylinder about the size of a plum. Its mass is ...   more »

    View Article  War and Power Laws and Journalism
    The concept of Power Law distributions is attracting growing interest, especially among folks in the Complexity and Complex Adaptive Systems communities.  For journalists, some of the math involved is somewhat more complex than the elementary descriptive statistics we deal with, but it's not that tough to grasp the implications of research probing Power Laws as they apply to various phenomena.

    Here's a perspective on global warfare that might prompt some deep contemplation for journalists.

    Original source:

    http://globalguerrillas.typepad.com/globalguerrillas/2005/09/wars_new_equili.html

    WAR'S NEW EQUILIBRIUM

    "In technology, particularly in information based systems, advances can occur almost overnight. This likely applies to warfare as it becomes more information-based. As in technology, patterns and methods of warfare tend to stay within bounded equilibria depending on the type of war being fought. When an improvement arrives, the equilibrium point changes and warfare undergoes a rapid shift.

    One of the ways to measure a equilibrium point was first demonstrated by Lewis Richardson over 50 years ago. He calculated that the distribution of casualties in conventional wars follow a power law distribution. Updates to his work show that this pattern of distribution continues to hold.

    In a new paper by Johnson, Spagat, and others called "From Old Wars to New Wars and Global Terrorism," ( PDF) -- http://xxx.lanl.gov/pdf/physics/0506213/ -- the authors demonstrate that a new pattern of war is emerging. To do this, they analyzed the frequency-intensity distributions of wars (including terrorism) and examined their power law curves. They found that conventional wars had a power law exponent of 1.8. An analysis of terrorism since 1968 found that the exponents were 1.71 (for G7 countries) and 2.5 (for non-G7 countries). This makes sense, conventional wars and G7 terrorism are both characterized by periods of relative non-activity followed by high casualty events (highly orchestrated battles). Non-G7 terrorism is a more decentralized and ad hoc type of warfare characterized by numerous small engagements and fewer large casualty events.

    Powerlaw

    Here's where the analysis gets interesting. When the author's examined the data from Colombia and Iraq, they found that both wars evolved towards the coefficient for non-G7 terrorism (although from different directions). This finding doesn't fit the prevailing theories of warfare. A conventional understanding of fourth generation warfare , such the one posited by Thomas Hammes in the Sling and the Stone posit that 4th generation warfare began in earnest with Mao. However, within Mao's formulation (and Ho Chi Minh's variant), guerrilla wars are but a prelude to conventional war to seize control of the state. The power law for these wars should, based on this theory, tend towards the coefficient we see for conventional wars. In fact, we see the opposite. Guerrilla wars in both Colombia and Iraq have stabilized at a coefficient far from conventional warfare.

    This has broad implications for 4th generation warfare theory -- which clearly dominated the types of wars we saw in the latter half of the twentieth century. The patterns of conflict we see today in Colombia and Iraq are a break from the previous framework (which may be an example of punctuated equilibrium). Unlike the previous models of guerrilla wars which sought to replace the state, these new wars have moved to a level of decentralization that makes them both unable to replace the state and extremely hard to eliminate. Is this new evolutionary equilibrium a fifth generation of warfare? It is extremely likely. This new form of warfare, or what I call open source warfare, is what this site (and my book) is dedicated to understanding."


    View Article  Searching podcasts? Yes, the tools are coming along.
    Print journalists often ignore audio (and video) content when researching a story.  Partially there is the "medium bias" at play (i.e. "Hey, I work in print, so that must be the most important source."), but that bias also has something to do with the lack of search tools and the difficulty of getting those audio words into a transcript that can flow into text.  Still, there is gold in those sight-and-sound files for a reporter who can find them and take the time to extract the ore.

    The always helpful blog
    "PI News Link" run by Tamara Thompson posts the following:

    "A new form of audio files called podcasts, so named because they can be downloaded from the Internet to a portable digital listening device (such as an iPod), are searchable through many search engines. Yahoo has just rolled out their podcast search. A keyword search of "legal" returned Involuntary Manslaughter: A Double Standard?, a broadcast with the editor of Massachusetts Lawyers Weekly. The Podcast Search Service catalogs a more extensive collection of websites with podcasts, searching terms within the site title or description. Pod Spider includes international audio files. Individual podcasts are beginning to be tagged, which will enable the searcher to uncover specific relevant audio files."


    View Article  Finnally, somebody is starting to get it. Sorry, Yanks, it's in the UK
    A posting today announcing an academic chair at the University of Central Lancashire Department of Journalism seems to indicate that someone in the industry there is starting to ask the right questions and seeking to leverage the strengths of the profession and its academic counterpart.

    In a time when the U.S. journalism establishment is just contributing to academic redundancies (see "Columbia and CUNY Get Grants in Journalism"),  UK Publisher Johnston Press is asking if there might not be a better way to think about, understand and deliver journalism.

    From a press release:

    "SPONSORED CHAIR IN DIGITAL JOURNALISM ...   more »
    View Article  About maps and blogs and vlogs. (But no cabbages or kings.)
    Here at the IAJ, there is growing curiosity about vlogs, blog sites that carry video.  And, of course, we're always interested in maps.

    We recently ran across "Vlogmap.org," a cool mash-up that integrates vlog sites with Google's mapping tools.  Worth a visit, we think, and some consideration about how journalism organizations might apply the technology.

    "What is Vlogmap.org?
    VlogMap.org is an online resource which shows where participating vloggers are located around the world, along with links to key information about their video blogs. Anyone can submit info to VlogMap.org to be listed on the map, as long as you run a video blog.

    Why Vlogmap.org?
    VlogMap.org is intended to be a fun and interesting way to learn about and explore the vlogging community and its online offerings.

    How does it work?
    VlogMap visitors can click on any red pin to get links to the web address, the RSS feed, and the contact information for that location. Additionally, a user of VlogMap is able to zero in, and examine areas of vlogger concentration, such as New York City, Los Angeles, and London. Anyone can submit info to VlogMap.org to be listed on the map."



    View Article  Grumbling (again) about only getting half the story
    We've long appreciated Ford Fessenden's forceful analytic journalism at the NYTimes, but a piece he has in today's Week in Review section leaves us yearning for more. 

    In "Where Home Prices Rise Steeply, Bankruptcies Fall," Ford raises some interesting -- and appropriately inconclusive questions -- about the relationship between real estate prices and the number of bankruptcies.  And we're given a nicely colored map of U.S. counties and their changes in bankruptcy rates, 2000 to 2005.  The quartile scale is huge: zero to 35 percent and greater than 35 percent, both up and down.  The problem is there are no hard numbers to put the bankruptcies in context related to county population.  And one or two counties down in southeastern Arizona have a greater than 35 percent decline in bankruptcies, but we know they have very sparce populations. 

    "OK," you might say, "there's simply no room to put all those numbers in the newspaper." 

    Right, but they surely could be put online in a variety of ways.  If there were three bankruptcies in 2005 and two in 2005, that's pretty close to a 35 percent decline, but hardly statistically significant.


    I'm sure this isn't Ford's fault; he has the data and is probably far more aware of its analytic pitfalls than we are.  But editors -- Editors! -- have to begin thinking of stories as having many fascets, and work to deliver the richest amount of data as possible that is related to the stories and their context.



     
    View Article  Getting mapping files at an affordable price: GeoTorrent.org
    One of the real challenges for journalists wanting/needing to do GIS is getting the software and map files.  Often the major roadblock is the newsroom budget.  We recently learned of a project that uses the file-sharing capabilities of Bittorrent (the peer-to-peer file sharing program) to make maps available at our favorite  price -- free.

    Check out GeoTorrent.org 

    "GeoTorrent.org information

    What types of data are shared?
    All different types of geospatial data is shared here. For example Air and satellite photo's, as well as attribute data.

    What formats is the data in?
    Imagery is in either ECW or JPEG 2000 format. Both formats allow high levels of compression. For example 1 terabyte (1,000 gigabytes) of raw data can be compressed to just 50 GB. JPEG 2000 also provides a lossless compression algorithm, allowing for pixel-for-pixel fidelity with the original dataset.
    Attribute (vector) data can be distributed in any common data format e.g. shape, tab files or native data formats. "

    The files are often large, like the 5.5gb "North America Landsat Mosaic," but there appears to be a growing number of non-US data.

    This looks to be a tool with potential.  Click here for the opening press release.




    View Article  Overview of the Google Maps overview
    Technology Review's senior editor Wade Rousch delivers a fine overview of Google Earth in the magazine's October issue.  The piece would be especially good as an introcuction to the tool/concept for someone who is relatively new to online mapping.  See "Killer Maps." 



    View Article  Web scraping with Excel [Saturday highlights from the Global Investigating Journalism conference]


     
    Tommy Kaas, of the Danish International Center for Analytical Reporting, just presented a fascinating session on how to use Excel tools to "scrape"data off the web an import it into Excel, at least Excel XP.  This is typically helpful where one needs to extract data from standardized tables on dynamic web sites, for example those with demographic, economic or crime data.

    He has posted some handouts at dicar.org/global2005 or
    http://www.dicar.org/global2005/exercise_macroscraper2.htm
    . It's not yet clear to us if this is more efficient than writing PERL or PHP scripts, but it's still an elegant hack.

     
    Guests are encouraged to browse and search through all of this blog and its subdirectories. Please sign in or register and then add comments to the blog.
    Login
    User name:
    Password:
    Remember me 
    Search
    Helpful Publications
    Recent Book Reviews
    Listed on BlogShares