AJAX file format allows lazy loading

[dleppik]

In the AJAX file format, instead of including all data, allow links to data and/or names of access functions. DataStores and Fields should include as much relevant metadata as possible (including value names and counts for IndexedFields). Data would be loaded when explicitly requested-- not automatically within a query.

In its most basic form, Field AJAX could include the metadata plus a link to the complete Field file. In a more fancy form, a Field could be divided into many parts, such as one file per value (if indexed), or several files (if unindexed).

In its fanciest form, multiple index files could be included. For example, in the Olympics dataset, the Athlete Field could be divided into several files by row index, (e.g. 0-100, 101-200, etc.) as well as by alphabetical order (e.g. "A-G", "H-J", "K-Z") for autocomplete-based search. If we want to get really fancy, an autocomplete-specific index (e.g. n-gram character index) could be provided.