Let me start by quoting Stefan in the course of the livestream: “Seems having tons of knowledge integrity is pricey”. Yeah, and dealing with tons of knowledge in a trend that is each quick and price efficient is bloody painful. I am reminded of the previous “quick, good and low-cost – decide 2” saying, however there’s much more nuance to it than that, in fact. I imply Desk Storage was all 3 of these, simply as long as we by no means wanted to revive in any respect, not to mention to a degree in time. Or geo-replicate. Or do advert hoc queries and do on and so forth. Thoughts you, I believe that with a mixture of Azure SQL in Hyperscale mode, some higher index optimisation, and a willingness to scale up extra aggressively when processing massive breaches, we’d be capable to discover a completely satisfied steadiness. Actually as I am penning this, we’re upgrading to Hyperscale so hopefully after I do subsequent week’s video from Tokyo, there will be a contented story to inform (or I will be drowning my sorrows in sake).
References
- Sponsored by: Kolide ensures that if a tool is not safe, it may’t entry your apps. It is System Belief for Okta. Watch the demo immediately!
- The German authorities has change into the thirty fifth nationwide gov to be granted entry to all their gov domains in HIBP (and yet another to come back subsequent week)
- WoTLabs acquired very pwned (web site defacement on high of leaked knowledge isn’t a very good look)
- The Онлайн Трейд (On-line Commerce) breach was an oldie, however it’s serving to us tune the import course of as a part of the RDBMS rollover (which is… painful)
- Talking of RDBMS rollover, many of the concepts I had throughout this video have confirmed to be fully ineffective, so we’re now rolling to Hyperscale as nicely (it is really solely very barely costlier)
- We’re nonetheless contributing to the HIBP UX rebuild repo (think about it a “gentle launch” for now, I am going to weblog about it in additional element after I get again from Japan)