Thursday, May 21, 2009

First law of computer science fires again - SimpleDB

We like SimpleDB, we could get started with it quickly. What we didn't like were the usage restrictions, putting attributes up one at a time, we have a lot of attributes to fire up there on a continuous basis, but while we were getting to grips with the basics, the first law of computer science "wait long enough and the requirement will go away or someone else will do it" fired and we got batchput (25 records per request) - which is a lot better (but hey what about 1000). This was critical for us, since uploading records is something that needs to happen quickly - there's a timeliness requirement for us.

The next part of the problem was querying. We are limited to 250 records per select. So larger returned data sets which for us can be common given the current limitations of the select expression language, mean multiple requests. So we were very happen when the law fired again and the Amazon Web Services Blog: New SimpleDB Goodies: Enhanced Select raised the limit to 2500 items per request.

So our faith the AWS will keep putting some investment into SimpleDB is well placed!

Now if they can only add some operators to their select language:  distinct,  avg, min, max, sum we would really be cooking.