Posted:August 19, 2006

The image "http://www.sr.se/press/bilder/sommar2005/thumbnails/25juli_Hans_Rosling.JPG" cannot be displayed, because it contains errors.“Why are we not using the data we have?”

So asks Hans Rosling, a professor of international health at Sweden’s world-renowned Karolinska Institute, in a recent TED 2006 talk, now available on the Web. (The specific link is
http://www.ted.com/tedtalks/tedtalksplayer.cfm?key=hans_rosling&flashEnabled=1, recorded in February 2006.) This 20 minutes video is perhaps the most cogent and entertaining presentation you will ever see regarding how data can be made real and meaningful through appropriate visualization. Professor Rosling inspires us to unlock understanding from the manifest data all around us.

Fortunately, the data visualization techniques he uses can be obtained from the non-profit organization he has founded, Gapminder, which brings global health and demographic data to life using the free Trendalyzer software.

The TED (Technology Entertainment Design) annual conference draws about 1,000 attendees to Monterey, CA, for the bargain price of $4400 per
attendee. TED 2007 is already oversubscribed.

Jewels & Doubloons An AI3 Jewels & Doubloon Winner

Posted by AI3's author, Mike Bergman Posted on August 19, 2006 at 3:45 pm in Adaptive Information | Comments (1)
The URI link reference to this post is: https://www.mkbergman.com/258/data-visualization-at-warp-speed/
The URI to trackback this post is: https://www.mkbergman.com/258/data-visualization-at-warp-speed/trackback/
Posted:August 12, 2006
This AI3 blog maintains Sweet Tools, the largest listing of about 800 semantic Web and -related tools available. Most are open source. Click here to see the current listing!

The W3C‘s ESW wiki has just consolidated a listing of RDF and OWL tools. This SemanticWeb Tools listing contains references to about 70 distinct tools, some open source and some proprietary, in areas such as:

  • General Development Environments, Editors, Content Management Systems
  • RDF Triple Store Systems
  • Programming Environments (in about a dozen different languages)
  • OWL Reasoners
  • On-line Validators
  • SPARQL Systems and Support.

The best thing about this listing is that it is available in wiki format and therefore is updated frequently by practitioners in the field. My only complaint is that the listing does not include information extractors (IE) or metadata generators. At any rate, I highly recommend bookmarking this site and re-visiting it frequently.

Posted:August 6, 2006

Well, my blog has just celebrated its official one year birthday.  Happy Birthday, AI3!

In the past year I’ve posted a new entry about every three days (128 total) and about half have a user comment.  The posts have been placed into 16 different categories.  My posts tend to be much, much longer than a "standard" blog in keeping with my intent to have this site be an early release point for substantive musings and research.  In that regard, I rate the site a high success, but it does come at a bit of a cost in packaging what had normally been my own internal drafts.

My Pro Blogging Guide has been very popular, with about 10,000 downloads from various venues (including about 2,500 from this site). The site is ranked about 100,000 in popularity on Technorati, pretty remarkable given its narrow and targeted focus.  Thanks!

I find that my posts tend to very episodic.  Fortunately, I post when my natural work flow and research dictates.  I have certainly read about "blogging burnout" quite a bit in the past year.  I suspect that blog authors who see themselves as needing to fufill popular expectations or to build audiences feel such pressures.  I just dawdle along, with my own weird musings and according to my own weird muses.

What’s Coming

I am very excited about the pending release of my semantic Web expert’s reference portal, SWISHer.  It is done and presently resides in the background; I am just working out some publicaton and blog integration details.  Stay tuned!  For those of you in this space, I think you will find its 200,000 or so definitive articles an invaluable reference library.

Other than SWISHer, I expect more of the same from the AI3 blog in the coming year:  a few, long posts per week, most of a research nature or based on analysis, with an occasional PDF or white paper summarizing an active research topic or series of posts.

I’d like to thank you for taking the occasional time to look at my stuff.  I again invite all of you to comment and interact as much as you’d like.

Posted by AI3's author, Mike Bergman Posted on August 6, 2006 at 12:29 pm in Site-related | Comments (0)
The URI link reference to this post is: https://www.mkbergman.com/256/happy-first-birthday-ai3/
The URI to trackback this post is: https://www.mkbergman.com/256/happy-first-birthday-ai3/trackback/
Posted:July 30, 2006

There has been some real silliness recently questioning whether the semantic Web will ever happen.  Simply because an idea does not get popularly embraced within five or ten years does not mean it will never succeed.  Some ideas — including, I submit, the semantic Web — respond to true underlying imperatives and drivers of change.

Henry Story in a recent post on RDF and Metcalf’s law poses the interesting thesis that "the value of your information grows exponentially with your ability to combine it with new information."  I could not agree more.

And that is why the semantic Web, or something very similar to it that might come to be known by a different name, is inevitable.  The Web has given global humanity the access and incentive to post all information accumulated through human history online.  But your glad may be my happy and there is always that leveraged value from combining stuff ("mashups") from different sources and realms.  Those issues are among the classic ones in data federation and a key driver for adoption of means to resolve semantic heterogeneities.  How the semantic Web and its tools and infrastructure actually develops today remains opaque.  But its need and eventual use is not.

Posted by AI3's author, Mike Bergman Posted on July 30, 2006 at 11:29 am in Adaptive Information, Semantic Web | Comments (1)
The URI link reference to this post is: https://www.mkbergman.com/255/the-exponential-driver-of-combining-information/
The URI to trackback this post is: https://www.mkbergman.com/255/the-exponential-driver-of-combining-information/trackback/
Posted:July 27, 2006

For a while now I have been ruminating on one of the great intellectual mysteries of human development: Why, roughly beginning in 1820, did the historical economic growth patterns of all prior history suddenly take off? Many of us (now) older people can recall grandparents talking about their first sight of a car or airplane. In my own life (born 1952) I can recall the first instance of color TVs, electronic calculators, personal computers and now the Internet. The fact is, the pace of development and technological change is now so constant that its very existence seems unremarkable — part of the daily background noise. But, for 99.9% of human history, this has not always been so.

Part of what I have been reading recently, and reporting in part with a few book reviews and many others to come, has been focused on what some of our leading thinkers have to say about the WHY of this growth and new historical discontinuity. Earlier posts, for example, have discussed Paul Ormerod’s ‘Reasonably Good Strategies’ in the Face of Failure, Knowledge and the Wealth of Nations: A Story of Economic Discovery, Scrolling Forward: Making Sense of Documents in the Digital Age, to my most recent read with a post to come on Elizabeth Eisenstein’s classic Printing Press and later to come the Technologies of Knowledge in 1700-1850.

The Open and Imprecise Historical Record

In our daily lives we are bombarded by statistics: quarterly economic growth rates, sports scores, weather precipitation likelihoods and daily temperatures, in a constant and thus unrecognized stream of numeric immersion. But it is interesting to note that statistics (originally derived from the concept of information about the state) really only began to be collected in France in the 1700s. The first true population census (as opposed to the enumerations of biblical times) occurred in Spain in that same century, with the United States being the first country to set forth a decennial census beginning around 1790.

Because no data was collected — indeed, the idea of data and statistics did not exist — attempts in our modern times to re-create economic and population assessments in earlier centuries are truly a heroic — and estimation-laden exercise. Nonetheless, the renowned economic historian who has written a number of definitive OECD studies, Angus Maddison, and his team have prepared economic and population growth estimates for the world and various regions going back to AD 1.[1] One summary of their results shows:

Year Ave Per Capita Ave Annual Yrs Required
AD GDP (1990 $) Growth Rate for Doubling
1 461
1000 450 -0.002% N/A
1500 566 0.046% 1,504
1600 596 0.051% 1,365
1700 615 0.032% 2,167
1820 667 0.067% 1,036
1870 874 0.542% 128
1900 1,262 1.235% 56
1913 1,526 1.470% 47
1950 2,111 0.881% 79
1967 3,396 2.836% 25
1985 4,764 1.898% 37
2003 6,432 1.682% 42

Note that through at least 1000 AD economic growth per capita (as well as population growth) was approximately flat. Indeed, up to the nineteenth century, Maddison estimates that a doubling of economic well-being per capita only occurred every 3000 to 4000 years. But, by 1820 or so onward, this doubling accelerated at warp speed to every 50 years or so.

A Couple of Historical Breakpoints

The trends in the table above can be plotted out for a more dramatic view:

But there are actually a couple of different discontinuities indicated by the estimated historical record. The first shift occurs roughly about 1000 AD, when flat or negative growth begins to accelerate slightly. The growth trend looks comparatively impressive, but that is only because the doubling of economic per capita wealth has now dropped to about every 1000 to 2000 years. These are annual growth rates about 30 times lower than today, which, with compounding, prove anemic indeed.

But, in the early 1820s, an absolutely fundamental break occurred. growth now headed straight up, with even steeper growth after about 1950 or so. The early portions of this period are what are traditionally associated with the Industrial Revolution in Western Europe and North America.

But, Again, Why?

It is silly, of course, to point to single factors or offer simplistic slogans about why this growth occurred. Indeed, the scientific revolution, industrial revolution, increase in literacy, electrification, printing press, Reformation, rise in democracy, and many other plausible and worthy candidates have been brought forward to explain this historical singularity of accelerated growth. For my own lights, I believe each and every one of these factors had its role to play.

But at a more fundamental level, I believe the drivers for this growth change came from the global increase and access to prior human information. Surely, the printing press helped to increase absolute volumes. Declining paper costs (a factor I believe to be greatly overlooked but also conterminous with the growth spurt and the transition from rag to pulp paper in the early 1800s), made information access affordable and universal. With accumulations in information volume came the need for better means to organize and present that information — title pages, tables of contents, indexes, glossaries, encyclopedia, dictionaries, journals, logs, ledgers,etc., all innovations of relatively recent times — that themselves worked to further fuel growth and development.

If the nature of the biological organism is to contain within it genetic information from which adaptations arise that it can pass to offspring via reproduction — an information volume that is inherently limited and only transmittable by single organisms — then the nature of human cultural information is a massive breakpoint. With the fixity and permanence of printing and cheap paper — and now cheap electrons — all prior discovered information across the entire species can be accumulated and passed on to subsequent generations. Our storehouse of available information is thus growing in a geometric way, and available to all, factors that make the fitness of our species a truly quantum shift from all prior biological beings, including early humans.

There is much, much more to say on these topics. There are implications regarding our new electronic and Internet age as well. There are books and thousands of learned pages devoted to this most central of human questions. I look forward to exploring and expanding various aspects of these topics in posts to come, and, of course, your comments.

[1] The historical data were originally developed in three books by Angus Maddison: Monitoring the World Economy 1820-1992, OECD, Paris 1995; The World Economy: A Millennial Perspective, OECD Development Centre, Paris 2001; and The World Economy: Historical Statistics, OECD Development Centre, Paris 2003. All these contain detailed source notes. Figures for 1820 onwards are annual, wherever possible. For earlier years, benchmark figures are shown for 1 AD, 1000 AD, 1500, 1600 and 1700. These figures have been updated to 2003 and may be downloaded by spreadsheet from the Groningen Growth and Development Centre (GGDC), a research group of economists and economic historians at the Economics Department of the University of Groningen headed by Maddison. See http://www.ggdc.net/.

Posted by AI3's author, Mike Bergman Posted on July 27, 2006 at 11:09 pm in Adaptive Information, Adaptive Innovation, Information Automation | Comments (0)
The URI link reference to this post is: https://www.mkbergman.com/250/the-biggest-disruption-in-history-massively-accelerated-growth-since-the-industrial-revolution/
The URI to trackback this post is: https://www.mkbergman.com/250/the-biggest-disruption-in-history-massively-accelerated-growth-since-the-industrial-revolution/trackback/