Sebastien Lelong

Hi guys, Just tried latest sources, uploading a file to Glacier from stdin. I got the following error: Traceback (most recent call last): File "/opt/local/bin/glacier-cmd", line 8, in load_entry_point('glacier==0.2dev', 'console_scripts',...

Hi, consider the following document indexed on ES: ``` {'_id': 'id123', '_index': 'index123', '_source': { 'one_field': {'entries': []}, } } ``` Calling `to_dict(skip_empty=False)` on the corresponding DSL Document created out...

... it should send the notification only when both premerge *and* hot collections are indexed

Wrap this function https://github.com/biothings/myvariant.info/blob/master/src/utils/hgvs.py#L88 as a new "compute" edge (compute a result from input data instead of lookin up data from mongodb)

Using bt.hub.datatransform module, need to define a new "dict" edge which will lookup data from a dictionary instead of a mongo collection

Related to this call: https://github.com/biothings/biothings.api/blob/master/biothings/utils/es.py#L853 where size= should pass (we won't support scroll, hub db isn't supposed that big) That big number could/should match index.max_result_window setting https://www.elastic.co/guide/en/elasticsearch/reference/current/index-modules.html and must not...

when accessing public standalone data (demo data), S3 header x-amz-meta-lastmodified is expected to exist and give information if a file is more recent that what we have locally or not....

With mychem: `upload("ndc") && diff(("src","ndc_ok"),("src","ndc"),mode="purge")` gives syntax error, logs show it: ``` INFO:hub:Run: '_and(partial(upload,"ndc"),partial(diff(("src","ndc_ok"),,"src","ndc"),mode="purge"))' File "", line 1 _and(partial(upload,"ndc"),partial(diff(("src","ndc_ok"),,"src","ndc"),mode="purge")) ^ SyntaxError: invalid syntax ```

Some sanity checks could be done when the graph is loaded (keylookup class init): 1. make sure an index exists for each looked up keys 2. make sure actual looked...

Production data releases are directly taken from what we produce each month to update our own API. For myvariant for instance, an index with 50 shards / 1 replica is...