SDN, OpenFlow and OpenDaylight Updates and Recordings
It’s been a busy few weeks in the SDN debate. I am posting some SDN updates from April along with some recordings from various events. The Open Networking Summit held its event. Only a few of the videos have posted so far. The keynotes and presentations that stuck out to me were, Rose Schooler from Intel, Bruce Davie from Nicira/Vmware, Nick Mckeown, Rob Sherwood from BigSwitch and most importantly the OpenDaylight technical steering committee (TSC) Q&A.
OpenDaylight Q&A Audio Recording
The highlight of ONS and hands down the entire year is the OpenDaylight consortium. The project is open source (OSS) where each vendor has one vote. Value is measured by quality and quantity of code. Measuring a vendors contribution to the OpenDaylight project is quite easy by looking at the ODP project commits. The days of SDN message control and closed circles has served its purpose but will fade in relevance. Hard to compete with OSS without a large tent and community support. OpenStack set the course for networking and incumbents seem to be learning from OpenStack misses. Point in case, Cisco starting OSS consortiums rather then Vmware avoiding OpenStack until post Nicira acquisition.
The audio is from my handheld recorder so quality is what it is. I think its fairly listenable though.
Download OpenDaylight Q&A from ONS 2013 Audio
In my opinion, this is what will take SDN from closed and siloed planning, that focuses on data center and cloud, to a community effort that anyone who wants to contribute now has the opportunity. Some of the members of the TSC have impressive track records of OSS contribution and understand the model well.
While this does presumably reduce the number of controller platforms early, this doesn’t bother me early on. In order to transition from talk and hype, it requires code and working products. To get there, we need a platform that everyone can focus interoperability efforts on. Otherwise the fragmentation would hurt margins and slow adoption. Once standards are truly agreed upon, differentiation will be abundant in the application. Pluggable north and southbound offers vendor opportunity while still allowing the consumer to transition away from vertically integrated products if they so desire. Regardless of the semantics of comparing networking to computing, we are transitioning similarly to those markets. Microsoft is developing office for IOS and Android. That’s a pretty big signal the OS/platform is irrelevant.
While every vendor has their own strategic interests to be involved in ODP, I am impressed and optimistic on success. The transparency is aggressive and it will allow for scrutiny of any company sandbagging or worse aiming for derailment. Vendors will still pursue vertical integration wether through management plane or pre-standards. That is fine with me. If a company’s use case decides the value outweighs the mousetrap. The litmus test is interoperability. OpenFlow is still the key to that component for edge ingestion and classification.
SDN and Consistency Models
I am also posting some recordings from a recent Internet2 meeting in DC. The vendors are Cisco, Juniper and Brocade. The recordings are pretty reflective of current vendor strategies at the moment. One day they are talking about the great things coming and the next is explaining why SDN is too hard and networks will become so fragile they will fail. I would simply counter that by quantifyng how fragile networks are today. We build systems and networks to fail. To say SDN is going to break because of poor software stability, is to have not been on the other side of a TAC call to AsiaPac lately. Waiting on an outsourced developer to compile an engineer drop of firmware to fix one of the hundreds of RFCs required to run thousands of distributed control planes. The consumer happens to be pretty smart these days. No need to warn us of the perils of SW.
Vendors are beginning to beat the consistency model fear drum. In networking we essentially use two components from distributed systems theory; eventual and immediate consistency.
Eventual Consistency in SDN Networks
Eventual consistency – When a change in state occurs all elements will “eventually” become consistent with one another. The Internet operates in this fashion via BGP. Intra-domain updates also occur in this manner.
Eventual Consistency in SDN OpenFlow Networks
Proactive OpenFlow flow policy operates using an eventually consistent model. The forwarding element comes online, attaches to a controller and the controller installs state into the switch via OF flowmods. Once state is pushed into the switch, the switch can be disconnected since the only thing that will remove proactive flow rules with idle and hard timers of zero is a reboot or another flowmod deleting all flows on the element. Proactive is a logical early migration approach since conceptually it is no different from a routing engine receiving updates from a neighboring switch via OSPF, BGP, etc.
Immediate Consistency in Current Generation Networks
Immediate consistency – When updates occur, they are visible to all participants immediately. An example of immediate consistency in today’s networks are wireless controllers and VoIP controller headends. When a phone or an AP boots up and attaches to a controller and has immediate consistency upon attachments. This is because all state resides centrally.
Immediate Consistency in SDN OpenFlow Networks
In Openflow immediate contsistency occours when running the controller with a reactive flow policy. Since no state is stored in the forwarding element, just as in the previous examples, when a switch attaches to an SDN controller, state is immediately consistent.
Both deployment models have pros and cons. Proactive is the logical first step since that is how we operate networks today. The difference being a reduction in control points into a decentralized model rather then a fully distributed model. That allows for graphing into NIBs for forwarding policy abstraction. That is all realistically still pretty far out. Near term is enabling OF on the network edge essentially replicating what is taking place in data centers today. Just as simple services like security are distributed to the DC edge in vSwitches, that same model is fairly easy to setup in the PE or access closet edge switch.
Q. What is the table miss policy in Open vSwitch?
A. OFPP_Normal.
Once your SDN island is established, you can then integrate it into the native network. Some examples of island integration are the following.
- Gateways – Gateways have a bad connotation from data center chokepoints. Gateways could be as simple as a pair of PE or distribution nodes.
- OFPP_Normal. I like normal for the flexibility of both native and OF paths in one box.
- Much more interesting integration comes in the form of RouteFlow cutting RIB->FIB->Flows.
More on reactive and proactive flow policy: OpenFlow: Proactive vs Reactive Flows →
Recordings of the Internet2 session. Warning, lots of FUD. It appears the vendors will captiualte once they see our networks running SDN and OpenFlow. All vendors have an open invatation to swing by my office and I can show them 1,000+ production OpenFlow ports. Not just a seperate physical network either, DNS, E-mail lots of short lived flows all mixed in with the general Facebook, Youtube, NetFlix and general surfing traffic. There are some believing existing gear should be ripped and replaced. They are probably the same that scoff at hybrid networks. Most of these folks haven’t operated networks in 20 years if ever. Not to say they aren’t brilliant, but ideal and realistic are on opposite axis. In my opinion, to say there is not any incremental SDN path short of forklifting kit will slow progress towards adoption. I have heard there are networks outside of Google, Amazon and Facebook believe it or not.
Apologies for poor audio here also. The recording was from a laptop in the audience recording. May cause nerdrage.
Internet2 Vendor SDN Audio Session Part 1
Internet2 Vendor SDN Audio Session Part 2
Intel at the ONS
The Sea Cliff reference switch containing the FM6000 chipset from the Fulcrum acquisition is probably hands down the best OpenFlow capable chipset on the market today. That is the only chip I am aware of that can perform flowmods in the OF pipeline. Other multi-table pipelines can just perform accrued actions once at the end of the pipeline and would require re-circulation to execute a second action-set. The also anounced a partnership with Vmware that would allow for Nicira/Vmware NVP flowmods to the Intel DPDK (datapath dev kit). That could be quite interesting.
There are not many videos posted from the ONS so far, but of the ones up so far, Rose Schooler from Intel is worth watching. They clearly have their eye on owning the entire physical fabric, end to end.
If my future was edge hardware, I would be transitioning to services ASAP. Intel is an organization that has done this before. Application specific datapath hardware will continue to get pushed deeper into the core by companies like Intel and Broadcom.
OpenDaylight Community Input
Links from the community. Thats community that isnt getting paid to be community, but operators that can program, engineer, architect and all around proverbial, masters of complexity.
- OpenDaylight SDN on Windows
- OpenFlow Hybrid. It’s a must, not an option.
- OpenFlow Switching Performance: Not All TCAM Is Created Equal
- Installing OpenDaylight on CentOS
Get involved with ODP. My money is on that. If it wasn’t ODP then what? Let me be clear, if ODP was a closed consortium like the ones we have, made up of vendors, I would fully expect failure. A Linux Foundation OSS project with this level of transparency can and will be policed by the community for delivering. Rob Sherwood said something very poignant in last weeks TSC meeting, “Our only power in the TSC can do is say no, if we do that early we will discourage more developers”. There are clearly some people on the TSC that realize the brevity of what they are doing and there are even more of us in the community that believe in the OSS path. OpenStack is coming to networking, ideally hardware wars don’t ruin it.
Thanks for stopping by.
Interested in being notified of future posts…
Hey Chad, thanks, pop in your email in the right sidebar and Google Feedburner will deliver it a few hours after post.
Thanks,
-Brent
interesting. I kinda agree with your optimism on OpenDaylight. At least the list of names on that project gives hope that vendors are smart enough not to turn this into a race or proprietary products yet again.
What would be nice is to get the customers on the same boat – Facebook, Google, AT&T… Folks that choose to innovate rather than use what vendors hand down.
Hi Kanat, Yeah, SDN merely offers more options on an axis.
-Use SDN as just another tool with early application for specific functions .
-Roll your own control plane like Google and Amazon.
-Do networks how you do it today and don’t change at all. Todays networks may be fine for many, so keep doing it.
The exciting part for me is having the option to explore abstractions on purchased gear.
Thanks for the comment, I agree with your insight.
Cheers,
-Brent
I think you’ve sipped the koolaid. OpenDaylight really smells of Cisco, et al, trying to slow down and redefine the network revolution happening now. Do you really expect them to work with these competing vendors on open source (non OnePK) controllers and protocols at the expense of their business? Nope. Chambers will rightfully fight tooth and nail to protect his business while externally showing a smiling, open face. OpenDaylight is nothing more then an attempt to draw attention from other SDN efforts and confuse the industry.
Hi Pete, thanks for the comments.
So I suppose I would first ask you what path other then OSS should vendors and community go?
It would be pretty hard to reverse course at this point and not lose credibility, but I really would like to hear what a better direction then Linux Foundation OSS. My disappointment is that every other vendor waited around on the incumbent to take the lead rather then taking risk.
The market will sort out the data plane. Its pretty obvious if a vendor is propriterary. If it is and justifies the vendor lock, go for it, I think the DP is for the market to sort out. Intel will drive that iMO.
/*
== So my “kool-aid” optimism is merely sourced from a few things: ==
-The platform is very uninteresting just as the Linux and kernel wars lead us to. E.g. MS is writing MS office for IOS.
-As I mentioned in the post, a fragmented controller market would be a huge problem when it comes to interoperability and hurts margins.
-Do they wait on the ONF to disctate standards and then go build their own controllers? Again, the interop with multiple vendor controllers doesn’t justify the differentiation.
-If this was a standards body or a closed consortium, this would fail. Meritocracy is a good thing. Quality and quantity is your worth. It cuts through the politics and appearing out of touch or as shills for any particular entity that some point to the closed ONF and the standards bodies they reference as being to slow.
– The framework is being built to be modular both north and south. If a vendor wants to try and differentiate with southbound protocols and closed gear, go nuts. It creates a horizontal ecosystem.
*/
Anyways, could go on for a while on open source but hey, most people will remain pessimistic of vendors. I certainly understand that. There is too much common sense coupled with 20 years of stagnant innovation involved for me to bet against fairly rapid change.
Would like to hear your suggestion for a better path. I have thought on it a while, ONF coming out with their own OSS would be too late iMO. More of the same would stifle innovation and change.
Cheers,
-Brent
Hi Brent,
You definitely have a serious of interesting blog posts, I see you have been tracking down SDN since its birth, great work and great posts. I am kinda new here, so right now I am trying to decide on a controller, my aim is configure many scenarios and test as fast as possible, I see openDaylight is still kinda new, but from your post it does look attractive, so if you would recommend someone like me to use a controller, what would be your best option (Programming Language is not a problem).