Posts Tagged ‘WAFL’

RAID Atomicity

March 27th, 2011

As you do, I was reading up on RAID levels while in the bath. The topic of atomicity came up, and it’s something I wanted to share.

Not usually the most reliable source of technical data, but I’ll quote Wikipedia to help explain atomicity to set the stage. Taken fromĀ under the section of “Problems with RAID”…

This is a little understood and rarely mentioned failure mode for redundant storage systems that do not utilize transactional features. Database researcherĀ Jim Gray wrote “Update in Place is a Poison Apple”[28] during the early days of relational database commercialization. However, this warning largely went unheeded and fell by the wayside upon the advent of RAID, which many software engineers mistook as solving all data storage integrity and reliability problems. Many software programs update a storage object “in-place”; that is, they write a new version of the object on to the same disk addresses as the old version of the object. While the software may also log some delta information elsewhere, it expects the storage to present “atomic write semantics,” meaning that the write of the data either occurred in its entirety or did not occur at all.

This has come back into light recently but under a different guise with SSD write failure problems. Many SSD manufacturers and enterprise storage vendors are addressing this with new firmware that writes all data sequentially, never over-writing a data block until all of the disk has been written then starting over-writing blocks from the start (that have obviously been freed up first).

General , , , , , ,


January 18th, 2009

So this is the start. I’m gonna try commit to post fairly regularly, but as with most things, time permitting!

I am a Senior Technical Consultant at a leading UK Storage Reseller. My main focus is with VMware and NetApp (including IBM N-Series), but I touch on most things at some point or another. My posts here will relate to my work and some of the challenges I encounter, hopefully it’ll help others out. I’ll also use this to probably vent some frustrations and voice some of my ideas, as well as just random sprawls that come out of my head.

I don’t consider myself an expert, I haven’t got that much of an ego, but I do like to push the boundaries, and I’m always learning new techniques and technologies. I don’t have a strong pride to damage either, so I’m more than happy to be knocked down with any ideas or criticisms. I have spent a life-time with computers and I’m always learning new stuff, or discovering old stuff that no-one taught me yet!

General , , ,

This site is not affiliated or sponsored in anyway by NetApp or any other company mentioned within.