Posted:October 2, 2005

Shortly after its release, I posted information on how to get your blog postings listed on Google’s blog search (GBS) (prior to Google itself providing a submission path, which it claims is forthcoming).

While the information on that earlier post is correct, it needs some updating.

Despite having some of the reference sites and Ping-o-matic listed in my ping Update Services, and despite that my WordPress software is currently up to date with version 1.5.2, I was NOT seeing new listings appear in GBS.

However, if you go to Ping-o-matic itself and manually force a ping update, within minutes your new posts will appear in GBS.  Go figure ….

Posted by AI3's author, Mike Bergman Posted on October 2, 2005 at 2:36 pm in Blogs and Blogging, Searching | Comments (0)
The URI link reference to this post is: https://www.mkbergman.com/133/update-google-blog-search-wordpress-ping-o-matic/
The URI to trackback this post is: https://www.mkbergman.com/133/update-google-blog-search-wordpress-ping-o-matic/trackback/
Posted:October 1, 2005

In my daytime life at BrightPlanet we do a lot of work for the intelligence community that we really can’t say anything about.  However, I recently came across a blog that I have been monitoring (and am still the only subscriber to on Bloglines) called Intelligence and Technology and National Security that I have been finding quite useful.  Recommended.

Thus, my interest was piqued when it referred to a Web site called Intelligence Search:  That Web site claims:

“Intelligence Search is the only totally free spy and intelligence web site that searches through creditable web sites to deliver quality information to its visitors. Intelligence Search is free of adware, spyware and pop-ups and does not ask its visitors for donations. Intelligence Search also allows freedom of speech in the written word, so visitors get the purest form of intelligence information possible. “

Hmmm, sounds useful and interesting.  So, I tried ‘ODNI’ as a search term (for Office of the Director of National Intelligence — the new intel oversight position created by the Intelligence Reform and Terrorism Prevention Act of 2004, with Ambassador John D. Negroponte its first director) and only got one result (and that one not even the ODNI’s home page!).  A similar Yahoo! search turns up 84,200 hits, of which 200 are excellent results after applying further query refinements.  (Of course, Yahoo! does not include any deep Web content, so a truly useful compendium would likely have 1,000 documents or more.)  Numerous other searches I tried produced similarly meager results from Intelligence Search in comparison to what is available.

I think the intent of Intelligence Search is laudable and I like its clean interface.  However, I can not recommend it at this time until content coverage actually becomes useful.  Perhaps the site’s developers need to consider better tools for harvesting and building content on their site.  I just may have some recommendations   ….

Posted by AI3's author, Mike Bergman Posted on October 1, 2005 at 11:36 am in Blogs and Blogging, Deep Web, OSINT (open source intel), Searching | Comments (1)
The URI link reference to this post is: https://www.mkbergman.com/131/recommended-intel-blog-and-disappointing-intelligence-search/
The URI to trackback this post is: https://www.mkbergman.com/131/recommended-intel-blog-and-disappointing-intelligence-search/trackback/
Posted:September 28, 2005

An earlier posting described a step-by-step process for converting a Word doc to clean HTML for posting on your site. Today’s posting updates that information, with specific reference to creating multi-part HTML postings.

A multi-part posting may make sense when the original document is too long for a single posting on your site, or if you wish to serialize its presentation over postings on multiple days.

Multi-part HTML postings pose a number of unique differences from a single page posting, namely in:

  • Needing to deal with multiple internal document cross-references (not only for a table of contents but also any Word doc cross-references ((Insert –> Reference –> Cross-reference) such as for internal headers, figures, tables, etc.
  • Organizing and splitting the table of contents (TOC) itself, and
  • Image naming and referencing.

So, how does one proceed with a multi-part HTML conversion in preparation for posting?

Specific Conversion Steps

  1. The first requirement is that you must create your baseline Word document with a table of contents (TOC) (Insert –> Reference–> Index and Tables –> Table of Contents). You should give great care to the construction and organization of the TOC because it will dictate your eventual multi-part HTML pages and splits
  2. When the Word doc is absolutely complete (and only then!), follow the steps in the earlier posting on Word docs to HTML to get absolutely as clean an HTML code base as possible. Include all global search and replaces (S & R) as the earlier post instructed. UNTIL THE ABSOLUTELY LAST SPECIFIC CONVERSION STEP #6 BELOW YOU WILL CONTINUE TO WORK WITH THIS SINGLE HTML DOCUMENT! For example, you may end up with clean HTML code for your TOC such as the following:
  3. <p><a href=”#_Toc106767203″>EXECUTIVE SUMMARY. 1</a></p>

    <p><a href=”#_Toc106767204″>I. INTRODUCTION. 3</a></p>

    <p><a href=”#_Toc106767205″>Knowledge Economy. 3</a></p>

    <p><a href=”#_Toc106767206″>Corporate Intellectual Assets. 4</a></p>

    <p><a href=”#_Toc106767207″>Huge Implications. 4</a></p>

    <p><a href=”#_Toc106767208″>Data Warehousing?. 6</a></p>

    <p><a href=”#_Toc106767209″>Connecting the Dots. 6</a></p>

    <p><a href=”#_Toc106767210″>II. INTERNAL DOCUMENTS. 7</a></p>

    <p><a href=”#_Toc106767211″>&#8216;Valuable&#8217; Documents. 7</a></p>

    <p><a href=”#_Toc106767212″>&#8216;Costs&#8217; to Create. 8</a></p>

    <p><a href=”#_Toc106767213″>&#8216;Cost&#8217; to Modify. 9</a></p>

    <p><a href=”#_Toc106767214″>&#8216;Cost&#8217; of a Missed. 9</a></p>

    <p><a href=”#_Toc106767215″>Other Document &#8216;Cost&#8217;. 9</a></p>

    <p><a href=”#_Toc106767216″>Archival Lifetime. 10</a></p>

    <p><a href=”#_Toc106767217″>III. WEB DOCUMENTS AND SEARCH. 10</a></p>

    <p><a href=”#_Toc106767218″>Time and Effort for Search. 11</a></p>

    <p><a href=”#_Toc106767219″>Lost Searches. 11</a></p>

    <p><a href=”#_Toc106767220″>&#8216;Cost&#8217; of a Portal. 14</a></p>

    <p><a href=”#_Toc106767221″>&#8216;Cost&#8217; of Intranets. 16</a></p>

    <p><a href=”#_Toc106767222″>IV. OPPORTUNITIES AND THREATS. 18</a></p>

    <p><a href=”#_Toc106767223″>&#8216;Costs&#8217; of Proposals. 18</a></p>

    <p><a href=”#_Toc106767224″>&#8216;Costs&#8217; of Regulation. 21</a></p>

    <p><a href=”#_Toc106767225″>&#8216;Cost&#8217; of Misuse. 24</a></p>

    <p><a href=”#_Toc106767226″>V. CONCLUSIONS. 25</a></p>

  4. Do global S & R on the TOC references, replacing with internal page link (e.g., “./ …) references, as this example for the Intro shows:
  5. Find and Replace Screen

    There will need to be as many S & R replacements throughout the document as there are entries in the TOC. You should be careful to name your internal pages according to your anticipated final published structure for the multi-part HTML pages. Upon completion of the global S & R, you should then remove earlier Word doc page numbers and clean up spaces or other display issues. Thus, using the example above, you could end up with revised code for the TOC as follows:

    <p><a href=”./summary.html”>EXECUTIVE SUMMARY</a></p>

    <p><a href=”./intro.html”>I. INTRODUCTION</a></p>

    <p><a href=”./intro.html#knowledge”>Knowledge Economy</a></p>

    <p><a href=”./intro.html#assets”>Corporate Intellectual Assets</a></p>

    <p><a href=”./intro.html#huge”>Huge Implications</a></p>

    <p><a href=”./intro.html#data”>Data Warehousing?</a></p>

    <p><a href=”./intro.html#dots”>Connecting the Dots</a></p>

    <p><a href=”./internal.html”>II. INTERNAL DOCUMENTS</a></p>

    <p><a href=”./internal.html#docs”>&#8216;Valuable&#8217; Documents</a></p>

    <p><a href=”./internal.html#create”>&#8216;Costs&#8217; to Create</a></p>

    <p><a href=”./internal.html#modify”>&#8216;Cost&#8217; to Modify</a></p>

    <p><a href=”./internal.html#missed”>&#8216;Cost&#8217; of a Missed</a></p>

    <p><a href=”./internal.html#etc”>Other Document &#8216;Cost&#8217;</a></p>

    <p><a href=”./internal.html#archive”>Archival Lifetime</a></p>

    <p><a href=”./web.html”>III. WEB DOCUMENTS AND SEARCH</a></p>

    <p><a href=”./web.html#time”>Time and Effort for Search</a></p>

    <p><a href=”./web.html#lost”>Lost Searches</a></p>

    <p><a href=”./web.html#portal”>&#8216;Cost&#8217; of a Portal</a></p>

    <p><a href=”./web.html#intranets”>&#8216;Cost&#8217; of Intranets</a></p>

    <p><a href=”./opps.html”>IV. OPPORTUNITIES AND THREATS</a></p>

    <p><a href=”./opps.html#proposals”>&#8216;Costs&#8217; of Proposals</a></p>

    <p><a href=”./opps.html#regs”>&#8216;Costs&#8217; of Regulation</a></p>

    <p><a href=”./opps.html#misuse”>&#8216;Cost&#8217; of Misuse</a></p>

    <p><a href=”./conclusion.html”>V. CONCLUSIONS</a></p>

  6. You may also need to do additional code cleanup. For example, in the snippet below, the first href refers to the TOC entry that will be replaced via steps #3 and #6. However, the second href is an internal cross-reference from another location (not the TOC) in the Word doc. For these additional cross-references, you will need either to chose to keep them and rename logically with S & R or to remove them. (Generally, since you are already splitting a long Word doc into multiple HTML pages such additional cross-references are excessive and unnecessary; you can likely remove.):
  7. <h1><a name=”_Toc106767204″></a><a name=”_Toc90884898″> I. INTRODUCTION</a></h1>

    <p>How many documents does your organization create each year? What effort does this represent in terms of total staffing costs? Etc., etc.</p>

  8. You will then need to rename your images using global S & R, which were given sequential image numbers (not logical names) in the Word doc to HTML conversion. For example, you may have an image named:
  9. <img width=”664″ height=”402″ src=”Document_files/image001.jpg”>

    You will need to give that image a better logical name, and perhaps put it into its own image subdirectory, like the following:

    <img width=”664″ height=”402″ src=”./images/CostChart1.jpg”>

  10. Finally, your HTML is now fully prepped for splitting into multiple pages. You need to do three more things in this last step.

First, via cut-and-paste take your TOC and any intro text from the main HTML document and place it into an index.html HTML document. That should also be the parent directory for any of your subsequent split pages. Thus, in our example herein, you would have a directory structure that looks like:

MAIN (where index.html is located)

Summary

Intro

Internal

Web

Opps

Conclusion

Second, cut-and paste the HTML sections from the main HTML document that correspond to the five specific split pages (summary.html to conclusion.html) and place each of them into their own named, empty HTML shells with header information, etc. Thus, the pasted portions are what generally corresponds to the <body> . . .  </body> portion of the HTML. This is how the various subparts.html get created.

Third, and last, delete each of the main page cross-references changed during global S & R (these are all of the references without internal anchor # tags); these references are now being handled directly via the multiple, split HTML page documents. For clarity, these deleted references are thus for our example:

<p><a href=”./summary.html”>EXECUTIVE SUMMARY</a></p>

<p><a href=”./intro.html”>I. INTRODUCTION</a></p>

<p><a href=”./intro.html#knowledge”>Knowledge Economy</a></p>

<p><a href=”./intro.html#assets”>Corporate Intellectual Assets</a></p>

<p><a href=”./intro.html#huge”>Huge Implications</a></p>

<p><a href=”./intro.html#data”>Data Warehousing?</a></p>

<p><a href=”./intro.html#dots”>Connecting the Dots</a></p>

<p><a href=”./internal.html”>II. INTERNAL DOCUMENTS</a></p>

<p><a href=”./internal.html#docs”>&#8216;Valuable&#8217; Documents</a></p>

<p><a href=”./internal.html#create”>&#8216;Costs&#8217; to Create</a></p>

<p><a href=”./internal.html#modify”>&#8216;Cost&#8217; to Modify</a></p>

<p><a href=”./internal.html#missed”>&#8216;Cost&#8217; of a Missed</a></p>

<p><a href=”./internal.html#etc”>Other Document &#8216;Cost&#8217;</a></p>

<p><a href=”./internal.html#archive”>Archival Lifetime</a></p>

<p><a href=”./web.html”>III. WEB DOCUMENTS AND SEARCH</a></p>

<p><a href=”./web.html#time”>Time and Effort for Search</a></p>

<p><a href=”./web.html#lost”>Lost Searches</a></p>

<p><a href=”./web.html#portal”>&#8216;Cost&#8217; of a Portal</a></p>

<p><a href=”./web.html#intranets”>&#8216;Cost&#8217; of Intranets</a></p>

<p><a href=”./opps.html”>IV. OPPORTUNITIES AND THREATS</a></p>

<p><a href=”./opps.html#proposals”>&#8216;Costs&#8217; of Proposals</a></p>

<p><a href=”./opps.html#regs”>&#8216;Costs&#8217; of Regulation</a></p>

<p><a href=”./opps.html#misuse”>&#8216;Cost&#8217; of Misuse</a></p>

<p><a href=”./conclusion.html”>V. CONCLUSIONS</a></p>

Voilà. You now have multiple HTML pages from a Word document!

Posted:September 27, 2005

Though it has been out since June, I just today came across an interview with Tim Berners-Lee on the Semantic Web that was conducted by Andrew Updegrove for the Consortium Standards Bulletin.  I highly recommend this piece for any interested in an insider’s view to the creation and use of the semantic Web.  Here are some highlights.  All are direct quotes from Berners-Lee.

Here are some excerpts relating to the vision of the semantic Web:

The goal of the Semantic Web initiative is to create a universal medium for the exchange of data where data can be shared and processed by automated tools as well as by people. The Semantic Web is designed to smoothly interconnect personal information management, enterprise application integration, and the global sharing of commercial, scientific and cultural data.

Many large-scale benefits are, not surprisingly, evident for enterprise level applications. The benefits of being able to reuse and repurpose information inside the enterprise include both for savings and new discoveries. And of course, more usable data brings about a new wave of software development for data analysis, visualization, smart catalogues… not to mention new applications development. The point of the Semantic Web is in the potential for new uses of data on the Web, much of which we haven’t discovered yet.

As for status of the initiative, Berners-Lee directly addresses some critics by emphasizing the importance of automated tools and not author tagging:

It’s not about people encoding web pages; it’s about applications generating machine-readable data on an entirely different scale. Were the Semantic Web to be enacted on a page-by-page basis in this era of fully functional databases and content management systems on the Web, we would never get there. What is happening is that more applications — authoring tools, database technologies, and enterprise-level applications — are using the initial W3C Semantic Web standards for description (RDF) and ontologies (OWL).

Berners-Lee goes on to say:

One of the criticisms I hear most often is, “The Semantic Web doesn’t do anything for me I can’t do with XML”. This is a typical response of someone who is very used to programming things in XML, and never has tried to integrate things across large expanses of an organization, at short notice, with no further programming. One IT professional who made that comment around four years ago, said a year ago words to the effect, “After spending three years organizing my XML until I had a heap of home-made programs to keep track of the relationships between different schemas, I suddenly realized why RDF had been designed. Now I used RDF and its all so simple — but if I hadn’t have had three years of XML hell, I wouldn’t ever have understood.”

Many of the criticisms of the Semantic Web seems (to me at least!) the result of not having understood the philosophy of how it works. A critical part, perhaps not obvious from the specs, is the way different communities of practice develop independently, bottom up, and then can connect link by link, like patches sewn together at the edges. So some criticize the Semantic Web for being a (clearly impossible) attempt to make a complete top-down ontology of everything.

Others criticize the Semantic Web because they think that everything in the whole Semantic Web will have to be consistent, which is of course impossible. In fact, the only things I need to be consistent are the bits of the Semantic Web I am using to solve my current problem.

The web-like nature of the Semantic Web sometimes comes under criticism. People want to treat it as a big XML document tree so that they can use XML tools on it, when in fact it is a web, not a tree. A semantic tree just doesn’t scale, because each person would have their own view of where the root would have to be, and which way the sap should flow in each branch. Only webs can be merged together in arbitrary ways. I think I agree with criticisms of the RDF/XML syntax that it isn’t very easy to read. This raises the entry threshold. That’s why we wrote N3 and the N3 tutorial, to get newcomers on board with the simplicity of the concepts, without the complexity of that serialization.

Some of the other insights in the interview is that early adoption is likely to be internally by enterprises on their intranets, that there will definitely be first-mover advantages for software applications that embrace RDF and OWL, and that a more widely embraced rules-based language (think of a successor to Prolog) may likely emerge.

Highly recommended reading!

Posted by AI3's author, Mike Bergman Posted on September 27, 2005 at 9:33 am in Adaptive Information, Semantic Web | Comments (0)
The URI link reference to this post is: https://www.mkbergman.com/128/tbl-on-the-semantic-web/
The URI to trackback this post is: https://www.mkbergman.com/128/tbl-on-the-semantic-web/trackback/
Posted:September 19, 2005

Author’s Note: I am pleased to offer this comprehensive guide prepared from my “Preparing to Blog” series covering the first four months of learning in creating this AI3 blog site.

The citation for this effort is:

Michael K. Bergman, “Comprehensive Guide to a Professional Blog Site:  A WordPress Example,” A Guide Book from the AI3 Blog Site, September 2005, 80 pp.

Download PDF file Click here to obtain a copy of this free guide (80 pp, 1016 K)

Gone beyond Blogger? Want to really be aggressive in functionality and scope of content for your personal, professional or corporate blog? If so, this Comprehensive Guide to a Professsional Blog Site may be useful to you.

This Guide is the result of 350 hrs of learning and experimentation to test the boundaries of blog functionality, scope and capabilities. I myself began this process as a total newbie about six months ago — which likely shows in gaps and naïveté — but I have been aggressive in documenting as I have gone. The learning from my professional blog journey, still ongoing, is reflected in these pages.

This Guide addresses about 100 individual “how to” blogging topics and lessons, all geared to the content-focused and not occasional blogger. More than 140 citations from more than 80 experts provide additional guidance.  The Guide itself occupies 80 pages. It is all free with no sign up required.

But there is hopefully more than one pony under the pile for those needing to join the “1% club” of purposeful, content-oriented, professional bloggers. In this Guide you will find discussion of these useful topics:

  • How to choose blogging software and add-on tools
  • Taking control of the blogging process by hosting your own site
  • Getting your blog to display and perform right
  • Effective techniques for converting existing documents to your blog site HTML
  • Being efficient in posting, organizing and work-flowing to allow your diarist activities to flow naturally and productively
  • Keeping the blog site pump primed with fresh and relevant content.

I created this Guide as a discipline in learning how to be a diarist or journalist, akin to the heyday era of “persons of letters” prior to the telegraph. In part, I undertook this discipline to rekindle those daily journal skills of the past. But, for the most part, I undertook the effort because I believe a fundamentally new means and mechanism for adaptive advantage is being created with social computing, of which blogging is a part.

Enjoy! And I welcome your corrections or suggestions for improvements.