dynamoid icon indicating copy to clipboard operation
dynamoid copied to clipboard

How can I query to get 100,000 records as quickly as possible?

Open namdv-1375 opened this issue 1 year ago • 1 comments

If I use batchGetItem it asks for the key. However, I cannot know this key in advance, for example the key is the id of the table. So how should I handle this problem? Pls help me, Thank you! cc @andrykonchin <3

namdv-1375 avatar Sep 11 '24 13:09 namdv-1375

Could you please provide more context?

DynamoDB provides two kinds of read operations:

  • when primary key is known (GetItem and BatchGetItem)
  • when it is unknown (Scan and Query)

So if you don't know primary key values in advance (but have some conditions on attributes), then the only option is Scan and Query. They are used by a method where (similar to Rails' ActiveRecord):

u = User.find(1)
addressed = u.addresses.where(city: 'Chicago').all

You can find more examples with where in the Readme and RDoc documentation

andrykonchin avatar Sep 11 '24 21:09 andrykonchin