SIOC Post profile for "AI3:::Adaptive Information"
type: Document
description: A SIOC profile describes the structure and contents of a weblog in a machine readable form. For more information please refer to http://sioc-project.org/.
primary topic: Tutorial: Internet Languages, Character Sets and Encodings
generator agent: http://rdfs.org/sioc/wp-sioc.php

Tutorial: Internet Languages, Character Sets and Encodings
type: Post
has container: weblog
has creator: Mike Bergman
maker: Mike Bergman
created: 2006-03-23T15:42:29Z
content: Author's Note: This is an on line version of a paper that Mike Bergman recently released under the auspices of BrightPlanet Corp The citation for this effort is: M.K. Bergman, "Tutorial: Internet Languages, Character Sets and Encodings," BrightPlanet Corporation Technical Documentation, March 2006, 13 pp. Click here to obtain a PDF copy of this posting (13 pp, 79 K) Broad-scale, international open source harvesting from the Internet poses many challenges in use and translation of legacy encodings that have vexed academics and researchers for many years. Successfully addressing these challenges will only grow in importance as the relative percentage of international sites grows in relation to conventional English ones. A major challenge in internationalization and foreign source support is "encoding." Encodings specify the arbitrary assignment of numbers to the symbols (characters or ideograms) of the world's written languages needed for electronic transfer and manipulation. One of the first encodings developed in the 1960s was ASCII (numerals, plus a-z; A-Z); others developed over time to deal with other unique characters and the many symbols of (particularly) the Asiatic languages. Some languages have many character encodings and some encodings, for example Chinese and Japanese, have very complex systems for handling the large number of unique characters. Two different encodings can be incompatible by assigning the same number to two distinct symbols, or vice versa. So-called Unicode set out to consolidate many different encodings, all using separate code plans into a single system that could represent all written languages within the same character encoding. There are a few Unicode techniques and formats, the most common being UTF-8. The Internet was originally developed via efforts in the United States funded by ARPA (later DARPA) and NSF, extending back to the 1960s. At the time of its commercial adoption in the early 1990s via the Word Wide Web protocols, it wa…
encoded: Author’s Note: This is an on line version of a paper that Mike Bergman recently released under the auspices of BrightPlanet Corp The citation for this effort is: M.K. Bergman, “Tutorial: Internet Languages, Character Sets and Encodings,” BrightPlanet Corporation Technical Documentation, March 2006, 13 pp. Click here to obtain a PDF copy of this posting (13 pp, 79 K) Broad-scale, international open source harvesting from the Internet poses many challenges in use and translation of legacy encodings that have vexed academics and researchers for many years. Successfully addressing these challenges will only grow in importance as the relative percentage of international sites grows in relation to conventional English ones. A major challenge in internationalization and foreign source support is “encoding.” Encodings specify the arbitrary assignment of numbers to the symbols (characters or ideograms) of the world’s written languages needed for electronic transfer and manipulation. One of the first encodings developed in the 1960s was ASCII (numerals, plus a-z; A-Z); others developed over time to deal with other unique characters and the many symbols of (particularly) the Asiatic languages. Some languages have many character encodings and some encodings, for example Chinese and Japanese, have very complex systems for handling the large number of unique characters. Two different encodings can be incompatible by assigning the same number to two distinct symbols, or vice versa. So-called Unicode set out to consolidate many different encodings, all using separate code plans into a single system that could represent all written languages within the same character encoding. There are a few Unicode techniques and formats, the most common being UTF-8. The Internet was originally developed via efforts in the United States funded by ARPA (later DARPA) and NSF, extending back to the 1960s. At the time of its commercial adoption in the early 1990s via the Word Wide Web protocols, it wa…
topic: Adaptive Information
topic: Deep Web
topic: Information Automation
topic: OSINT (open source intel)
topic: Searching
topic: Semantic Web
links to: BrightPlanet Corp
links to: Click here
links to: DARPA
links to: [1]
links to: [2]
links to: [3]
links to: [4]
links to: MeasuringLinguisticDiversity En.pdf
links to: [5]
links to: [6]
links to: [7]
links to: [8]
links to: [9]
links to: codepages.html
links to: Basis Technolgy
links to: [10]
links to: [11]
links to: [12]
links to: [13]
links to: encoding.doc.html
links to: 01 Mikami.pdf
links to: http://www.ethnologue.com/ethno_docs/distribution.asp
links to: index.php3
links to: refs.php3
links to: index.html
links to: 60.html
links to: character-sets
links to: sorted.html
links to: languages-scripts.html
links to: http://crawler.archive.org/cgi-bin/wiki.pl

Mike Bergman
type: User

Mike Bergman
type: Person

DARPA
label: NSF