Application Centric Infrastructure

CCIE Data Center / Service Provider / Security / R&S

yusxu@cisco.com

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1
 Insieme Networks Introduction

ACI Overview

Nexus 9000 Switch Standalone Introduction

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2
 October 9 Internal Launch
October 9-
Internal Launch recording available via Show and Share
October 29:
October 29: Presentation & Sales Materials available on CEC

November 6 External Launch in New York & Virtual

November 7 Partner Launch

Training and Enablement throughout Q2

Updated Date from
IPTV Broadcast
2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3
 Cisco Product Company Acquire Time Price

Catalyst 5000/6500 Crescend 1993 94M

o
MDS 9000 Andiamo 2003 750M
UCS/N5K2K(SAVBU Nuova 2009 658M
)
ACI&Nexus 9000 Insieme 2013/10 1B

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4
 Insieme Networks Introduction

ACI Overview

Nexus 9000 Switch Standalone Introduction

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5
 Web Economy App Economy Any application any where
Velocity and Visibility

On-Prem IT Services Cloud Services Virtual, Physical, Cloud

Common Policy

IT as a Service Applications as a Service Scale with Security

Development vs. Operations DevOps Open, Automation

Box-Centric App/Service Centric Systems Approach

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6
 Control Plane

Network Virtualization Programmability

Data Plane

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7
 Application / Workload Orchestration and Scheduler

Unified Information Model and API

Policy Controller Compute Policy Controller Network Fabric Policy Controller Storage

Endpoint Group (EPG)

Application Graph
(EP, EPG, graph
edges)

Endpoint Group
(EPG)

Application Profile = Compute Service Profile + Network Profile + Storage Service Profile

Designed from Its Foundation to Be Application-Centric

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8
 APIC

Applications fully use clustered and Single Point of Management

Without a Single Point of Failure
replicated controller (N+1, N+2, etc.)

Any node is able to service any user for any

operation

Seamless APIC node adds and deletes

Fully automated APIC software cluster

upgrade with redundancy during upgrade See Whats Inside

Cluster size driven by transaction rate

requirements
APIC Cluster
APIC is not in the data path Distributed, Synchronized, Replicated

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9
 User:
User: pepsi_admin
pepsi_operations
User: admin

Domain:
Domain:pepsi
all universe

Roles: Role:
Role: admin
ep-stats,
infra-admin
ep-events

Netw ork Profile Coke Netw ork Profile Pepsi QoS Policy
Fabric 1 Port Stats
Access Policy
Sw itch1 Sw itch2 Sw itch3
Endpoint
Network
Group
Pepsi-Net Pepsi-DB Named ref: QoS Policy
LC1 LC2

L2 Network L3 Network Port1 PortN-1 PortN

PepsiL2Net PepsiL3Net Endpoints

Tenant Network Profiles, EPGs, and EPs Shared Policies Infrastructure

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10
Northbound API System Automation
Rapid integration with existing Management Tools
management frameworks
OpenStack
Hypervisor Orchestration
Tenant- and application-aware Management Frameworks

Object-Oriented Open Ecosystem Comprehensive

Centralized Automation Programmability and
RESTful XML / JSON Framework System Access

Southbound API
Publish data model
Open source
Enables application portability

*Only straight chains supported at FCS

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11
 Triggered Events Actions:
or Queries No new hosts or VMs
ACI Fabric provides the next generation PetStore Event Evacuate hypervisors
Re-balance clusters
of analytic capabilities

Per application, tenants, and

infrastructure:
Health scores
PetStore Dev PetStore Prod PetStore QA
Latency Leaf 1 and 2 Leaf 2 and 3 Leaf 3 and 4
Spine 1 3 Spine 1 2 Spine 2 3
Atomic counters Atomic counters Atomic counters Atomic counters

Resource consumption

APIC
Integrate with workload placement or
migration
VXLAN Physical and
Per-Hop Visibility Virtual as One

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12
 More than just a VM How do we define the network for the
Interconnected components application?

web app db
internet

application
VM VM VM

VM VM VM

External
Private
Network

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13
 rules of how application
communicates to the a set of network requirements
external private or public specifying how application
Contract
networks components communicate with Access Control
each other QoS
Network Services

web app db

Network Profile

application
VM VM VM
The

Outside application-centric network policy
VM VM VM
network Virtual Patch Panel

a collection of end-points Component

connecting to Tier
the network VMs, physical End Point Group
compute, Or VMware Port Group
2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14
 ACI
ACI

ACI

ACI
Context(VRF)TenantIP

EGPContract
L4-L7

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15
 ACI Only

Extension to Compute &

Vinci Lite Storage
(CPoM, PoAP, Expanding Open Source
XMPP, etc.) and Ecosystem
Federated Policy
OR Nexus 9000
iNX-OS & iFC
(but still targeting New / Greenfield DCs / PODs
N7K / N6K DC Fabric) New Operational Model
N5K / N3K VXLAN encap
Services Insertion / WAN
N2K NO

FabricPath DFA-B
Deployed ?

DFA-A
Adds support to
IP encapsulation
YES N6K: Iluka N7K: Gibraltar 7.0 VXLAN encap.
6.0(2)N3(1) release release (Q2CY14) DCI
N7K / N6K (Q1CY14) Serv ice Orchestration
N5K / N2K
Based on FabricPath encap.
Requires Operational Model change
Commit to BOTH (Enhanced Forwarding)
Operational Workload & Network Automation
Model Change &
HW replacement

Q3CY13 Q4CY13 Q1CY14 Q2CY14 FUTURE

Aug
2013 Cisco and/or its affiliates. All rights reserved.
Dec Mar Apr-Jun Cisco Confidential 16
 Insieme Networks Introduction

ACI Overview

Nexus 9000 Switch Standalone Introduction

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17
 MERCHANT+ ASIC APPROACH
Innovation in Cisco ASICs

PRICE
PERFORMANCE POWER
PORT
PROGRAMMABILITY
DENSITY
EFFICIENCY
COST STRUCTURE
INDUSTRY LEADING PRICE / STATE OF THEAPI
20% HIGHER
JSON/XML ART
LINE
for CARD
1G BANDWITH
to 1/10GT BACKPLANE
Linux FREE
Container
Non-blocking for
Density
and
1.9210G
Tbpstoper
40Gslot DESIGN
customer apps
migration
100G ready 15% greater power
50% less ASICS and cooling efficiency

NEXUS 9500
PRICE PERFORMANCE PORT DENSITY PROGRAMMABILITY POWER EFFICIENCY
2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18
 APPLICATION CENTRIC NX-OS
INFRASTRUCTURE

APIC

PROGRAMABILITY40 GigEPRICE/PERFORMANCE

Existing Network Model

Q2 2014 Q4 2013
2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19
 3, 6 Fabric Card + Common Equipment Bundles North Star
4, 8, 16 Slot chassis
Redundant Power Supplies and Dual Sups

NXOS Only NXOS, Upgradable to iNXOS and ACI

8/12 port 40G QSFP+ GEM

36 port 40G QSFP+ (24 line rate)

36 port 40G QSFP+ (16 slot future) 48 SFP+ + 4 QSFP+

Future: 48 40G QSFP+
T2 48 1/10GT + 4 QSFP+

* 80 Plus Platinum is equivalent to Climate Saver/ Green Grid

Platinum rating
36 port 40G QSFP+ Alpine

Standalone Application Centric Infrastructure (ACI)

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20
8-slot Modular Chassis
Nexus 9508 Front View Nexus 9508 Rear View

8 Line Card Slots

Max 3.84 Tbps/Slot duplex

3 Fan Trays

3 or 6 Fabric Modules
(behind fan trays)

Redundant
Supervisor Engines

Redundant System
Controller Cards

3000W AC Pow er Supplies No Mid-plane for

2+0, 2+1, 2+2 Redundancy LC to FM connectivity
Support up to 8 Pow er supports

All common components are the same across Access, Aggregation and Spine
Designed for Power & Cooling Efficiency
Designed for Reliability
Designed for Future Scale
2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21
Overview
High Port Density
288x 40Gbps/Nexus 9508 or 576x 40Gbps/ Nexus 9516
1152x 10Gbps/Nexus 9508 or 2304x 10Gbps/ Nexus 9516

L2 & L3 Line-Rate Performance on All Ports & All Packet Sizes

Low Latency
Up to 3.5 usec on the 36x 40GE QSFP line card (N9K-X9636PQ)

Power Efficiency
Platinum rated power supplies, 90-94% power efficiency across all workloads
3.5W/ 10Gbps Port
14W/ 40Gbps Port

1st modular chassis without a mid-plane

Unobstructed front-back airflow

VxLAN Bridging/Gateway/Routing *

Highly integrated switch and buffer functionality

Only 2 to 4 ASICs per line card
No buffer bloat
Mix of 28nm Cisco and 40nm Broadcom ASICs

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22


Fix
Bug

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23
 Nexus 9396PQ
Uplink Module
48 port 10G SFP+ & 12 port 40G QSFP+

2 RU

FAN1

100-240V (650W AC) 12 port 40G QSFP+

Additional 40MB buffer
Full VXLAN Bridging & Routing Capability

Nexus 93128TX Nexus 9300 - Common

96 port 1/10G-T & 8 port 40G QSFP+ Redundant FAN (3) and Power Supply (2)
3 RU Front-to-back and Back-to-Front airflow
FAN2 Dual or Quad Core CPU with default 64GB SDD
100-120V (800W AC), 200-240V (1200W AC)

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24
 Nexus 9396PX GEM Module w ith 12 40Gbps QSFP+ ports
2RU height

48 1G SFP/10Gbps SFP+ ports

12 40Gbps-QSFP ports (on GEM module)

1 100/1000baseT management port

Console 48 1Gbps SFP/ 10Gbps SFP+ ports
1 RS232 console port Management Port
USB Ports
2 USB 2.0 ports

Front to back and back to front airflow options

1+1 redundant power supply options.

2+1 redundant fans

No-blocking architecture with line-rate

Pow er supply (2+1) Fan Trays Pow er supply
performance on all ports for all packet sizes

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25
 GEM Module w ith 12 40Gbps QSFP+ ports (8 active
uplinks)
Nexus 93128TX

3RU height

96 1/10GbpsBastT ports
8 40Gbps-QSFP ports (on GEM module)

1 100/1000baseT management port Console

Management Port
96 1GBaseT/ 10GBaseT ports
USB Ports
1 RS232 console port
2 USB 2.0 ports

Front to back and back to front airflow options

1+1 redundant power supply options.

2+1 redundant fans

Pow er supply (2+1) Fan Trays Pow er supply

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26
Problem
40G Optics are significant portion of CAPEX
40G Optics require new cabling

Solution
Re-use existing 10G MMF cabling infrastructure
Re-use patch cables (same LC connector)

Cisco 40G SR-BiDi QSFP

QSFP pluggable, MSA compliant
Dual LC Connector
Support for 100m on OM3 and 125m+ on OM4
TX/RX on 2 wavelength @ 20G each

Available end of CY13 and supported across all Cisco QSFP ports
2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27
 >100m

<100m

(41m)

100m
Presented by Paul Kolesar, CommScope, IEEE 802.3 Next Gen Optics Study Group, Sep 2011

90% of deployed trunks are <100m

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28
 Visibility

Automation and Orchestration Dynamic buffer monitoring

Programmable Enhanced Ethanalyzer

Puppet SMTP email pipe output
Chef Embedded Event Manager (EEM)
NX-API
JSON-RPC OpenStack network plugin Flow monitoring
XML/JSON XMPP support vTracker
Python scripting OpenDaylight integration
Customizable CLIs
BASH access
Broadcom shell access
Linux containers
OpenFlow support
Cisco onePK

SNMP (v1, v2, v3), Syslog, NETCONF, RMON, CLI

2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29
Thank you.