Share via

SQL or No SQL ?

  • Article

I have a post on NoSQL but as Azure moves on it’s looking a little long in the tooth so I thought it was time for an update.. 

I am a big fan of Darwin because he was able to question his own beliefs and perceptions by taking a hard look at the evidence around him, and if his survival of the fittest is to be believed then the relational database will be replaced by something better. Mass extinctions generally occur when the environment changes and in the IT landscape the biggest change is the cloud and I can see that this alters the way we interact with data in online transactions.  So if we set aside the pros and cons of a traditional relational database for this work,what is there to replace it, that makes it more evolved  and better?

The recent arguments I have seen seem to advocate column based databases which are superb for querying but less efficient than row based solutions for oltp.  This isn’t really new,  I was using Sybase IQ back in 2004 and it really made Business Object fly so I can understand why SAP have acquired Sybase given they now own Business Objects.  So was it ahead of its time and will it now flourish as the cloud takes off.  Possibly possibly not and I don’t really care because SQL Server is evolving itself to adapt to the demands of the cloud and to handle the many kinds of data we need to keep track of:

  • SQL has always been able to store various forms of unstructured data, and this has got better over  time: SQL Server 2008 filestream and remote binary storage allow massive files to be indexed and retrieved at nearly the speed of native file access using the win32 api.  Denali (SQL Server vNext)  will have file tables which takes this even further and embodies a lot of the principles of the WinFS work of a few years ago.
  • Denali will also have column based storage which gives massive query improvements like I saw in Sybase IQ but without the need to have a replica of the data in another product. So you can use the same SQL language and decide on whether to optimise for OLTP or reporting needs.
  • As hardware evolves and operating systems address these changes then databases will make use of these, be that multiple cores solid state storage or the availability of huge amounts of RAM. 

I can’t speculate how much of this ends up in future iterations of SQL Azure, but here’s a couple of things to bear in mind:

  • 70% plus  of Microsoft development resource is working on cloud services
  • SQL Azure gets updated every 90 days, it has 5x the storage capacity it did a year ago (and sharding allows you to exceed this if you need to) , it now has spatial data types and reporting services is on the way.

So my assertion is that databases like SQL Server have continually adapted and survived over the last 35 years and will probably continue for the foreseeable future,.

Happy as ever to debate this online or over coffee

Comments

  • Anonymous
    December 09, 2010
    Andrew, It may be prudent, when talking about sharding in SQL Azure, to point to Lev Novik's presentation at PDC this year (player.microsoftpdc.com/.../591d586f-3732-4bff-8ee2-857f27d74df4) which shows that built-in sharding support is coming to SQL Azure. I'm really excited about this and I'm surprised it hasn't captured more headlines. Hopefully see you tomorrow at the Open Day -Jamie Thomson

  • Anonymous
    December 10, 2010
    Jamie thanks for this and the link, I will do a separate post for another day

  • Anonymous
    December 13, 2010
    Personally, I'm in favour of Bruce Lipton's view of evolution which he calls Spontaneous Evolution. In Spontaneous Evolution, the transition of organisms from what they were to what they will be is not based on randomness or survival of the fittest but instead his research has proved in cellular biology that evolution happens in response to the perception of the environment in consistent and replicable ways. So in synopsis what we have now is in response to what fits best in to the environment that's been and whenever the system comes out of balance i.e. the environment can no longer support whatever is going on there's a sudden spurt of evolution to bring the system as a whole back into balance.