1 Application Dependency Planner OverviewApplication Discovery and Dependency Mapping for blueprinting and virtualization assessment services
2 Application Dependency PlannerA tool derived from VMware vCenter Application Discovery Manager (vADM) for PSO and channel value creation to drive more VMware product licenses & services sale and shorten sale cycle. Replaced an embedded licensed Oracle database with the open source PostgreSQL database Simplifies functionality: Passive Discovery only Use in virtualization assessment services, business critical application (BCA) virtualization services, BC/DR services and blueprinting services for data center consolidation/migration A consulting tool for VMware PSO and Partners, Not for end customer Available to partners through Services Software Solutions and supported by Partner Support Center
3 Application Dependency PlannerVMware Resource Management July 2008 Application Dependency Planner Passively discover virtual and physical infrastructure without agents Hosts & application usage Application services and dependencies Relate virtual machine (VM) infrastructure to the different application components Customize discovery scope and methods to suit user requirements Analyze dependencies Virtual and physical dependencies Business groups N-tier application and application patterns Reports Synchronize external repository/DB for custom reporting ESX server Virtual to Virtual Dependencies ESX to VC Dependencies Virtualized On Relationship Physical to Virtual Dependencies VMs Discover instances of DBs, Application servers, etc Application Dependency Planner - Overview Application Discovery Manager capabilities can be summarized in four categories: Passive discovery of your application infrastructure Discovery analytics to visualize, analyze, and report on the collected data The discovery methodology of ADP intelligently combines passive network observations and discovery analytics to result in discovery that is far less intrusive than competitive solutions. This discovery is completely agentless, so no additional software components need be distributed. Passive Application Dependency Planner passive discovery can identify application infrastructure such as servers and application components, and services like application (e.g., Web Logic) and database (e.g., Oracle) servers, host and application usage based on sampled network activity to those hosts, and component dependencies based on these application connections (e.g., MQSeries, SOAP, CitrixICA, JBoss RMI, DB2, SQL). Analytics Finally, after the passive and active discovery configuration items are stored in Application Discovery Manager’s database, there are several forms of discovery analytics available to slice and dice the data into views, maps, reports, and groups for custom visualization. Customize discovery scope The ability to use profiles that allow you to define and shape the types of active discovery that you are doing. Timing of active discovery Level of details to be discovered (shallow, medium, deep, custom)
4 Application Discovery ApproachVMware Resource Management July 2008 Application Discovery Approach DATA CENTER WAN Application Dependency Planner Virtual Appliance Discovery model Passive, agent-less, non-intrusive Mirror/SPAN port connection Statistical sampling of packets Continuous Discovery Not polling dependent Quick recognition of new apps, new servers, new dependencies & changes Real dependencies based on actual network communications Between application services Between servers Discover unclassified applications running on specific port Discovered data analysis Application grouping N-Tier business application pattern definitions Application Discovery Approach Passive ADP offers passive discovery that is defined as network-based using deep packet inspection—on the market and thus provides both an agentless and continuous capability to track hosts (servers) on the network and their communication with each other. Passive discovery connects to core span/mirror ports on network switches and samples network traffic to identify network hosts/server, their communications and connections, and what services and protocols are being exchanged at what time. Passive network analysis enable activity monitoring which is unique to ADM. Although the data is sampled, it provides the additional value of activity or usage monitoring comparisons among hosts, applications, and connections. While not appropriate for heavy capacity planning, the varying usage levels are extremely useful for consolidation, business continuity, and virtualization comparisons. Analytics Finally, the discovery analytics operate on the database of discovered data to provide various forms of visualization to group servers into application maps, fingerprint n-Tier applications that organize identified application components into customer apps, and reports for history, inventory and change. Discovery analytics consist of: Business groups: Group by hosts, services, J2EE applications, J2EE modules, DB instances, virtual containers, virtual hosts, and multiple CI types. Fingerprints: Automatically identifies common applications and packages out of the box Application Patterns: Discover and group standard and custom n-tier business applications Reports: Reporting for inventory, change, history
5 Powerful Application Pattern DefinitionsVMware Resource Management July 2008 Powerful Application Pattern Definitions Application Pattern Definitions (APDs) are used to discover and map n-tier applications Business applications usually consist of several hosts, running related databases, application-servers, file-servers and other services using connection protocols Application Dependency Planner lets you define your own application patterns in the GUI for n-tier applications Packaged business applications J2EE applications Step 1: specify a grouping of hosts Step 2: specify the types of applications on these hosts Step 3: specify the connections between these applications Result: discover all instances of business applications and related hosts in the environment as defined by you Recognize, group and map entities which form the various instances of these business applications in a data center. Powerful Application Pattern Definitions Application Pattern Definitions (APDs) are used to discover and map n-tier applications Business applications usually consist of several hosts, running related databases, application-servers, file-servers and other services using connection protocols ADM lets you define your own application patterns in the GUI for these n tier applications Packaged business applications J2EE applications Step 1: APDs let you specify a grouping of hosts Step 2: APDs let you specify the types of applications on these hosts Step 3: APDs let you specify the connections between these applications Result: APDs let you discover all instances of business applications and related hosts in the environment as defined by you Recognize, group and map entities which form the various instances of these business applications in a data center.
6 Discovery and Dependency Mapping TaxonomyVMware Resource Management July 2008 Discovery and Dependency Mapping Taxonomy Application Infrastructure Passive Discovery with Application Dependency Planner Active Discovery with Capacity Planner Application CI Dependencies Dependencies, Connections and protocols Time-based relationships, protocols, network services (e.g.,MQSeries, SOAP, Citrix ICA, JBoss RMI, DB2, SQL, HTTP, TCP) Software Dependencies: Documented dependencies, deployed-on, runs-on relationships, virtualized on relationships CI Usage and Details Host and Application Component Usage: Time-based usage, server and application usage Software Configuration Details: Installed path, vendor, version, database instances, configuration files and contents, URLs, changes Application Components CIs Application Components and Services: Including JBoss, Apache, Weblogic App and Web servers, SQL, Oracle, FTP, DNS, DHCP Servers, VirtualCenter Installed Software: Including MySQL server, Tomcat, Ruby, Weblogic, Samba, Python, Checkpoint VPN, Java 2 SDK Application Infrastructure Taxonomy This is how ADP defines application discovery. You need to have all four layers of this taxonomy covered in order to drive CMDB population, change, and compliance use cases. To understand the applications you must first understand the infrastructure that makes up the applications. Phase one of any project should be to build a strong foundation that includes an ongoing discovery of your customer’s: Core application infrastructure The application components that run on that infrastructure The relative activity and usage of those components The relationships among components From this infrastructure model, our discovery analytics can then be used to organize the components and connections that map to the customer’s application views including business grouping, business application fingerprinting, and reporting. Discovery and Dependency Mapping Taxonomy So what does passive discovery collect versus active discovery? Included are some examples of the latest virtual environment discovery and mapping capabilities. This is not an exhaustive list. Note to Presenter: There are no other specific notes for this slide. Just explain the differences between what is discovered with Passive vs. Active. Do not read the slide word for word. Core Application Infrastructure CIs Application Infrastructure and hosts: Servers, IPs, VMs System Infrastructure: Hardware, OS, memory, CPU, ESX servers, VirtualCenter
7 Deployment Options: Standalone vs. DistributedVMware Resource Management July 2008 Deployment Options: Standalone vs. Distributed ADP 5.0 Summer 2006 ADP Stand-Alone ADP Aggregator Virtual Appliance Virtual Appliance Local Deployment or Roving ADP Collector ADP Collector ADP Collector Data Center 1 Data Center 2 ESX Server Deployment Options: Standalone vs. Distributed Application Dependency Planner (ADP) can be deployed in two basic forms: Standalone appliance for single data center deployments or as a roving appliance across data centers (for rapid in-house inventories, internal consolidation projects) 2. Distributed deployments where ADP collectors are installed at various data centers and an ADP aggregator appliance collects the data into a single source of reconciled truth. 7
8 Deployment Example 1 (Standalone)ESX1 vSwitch Physical Switch 1 Switch 2 ADP VM1 Passive Collector Aggregator ADP VM2 Postgres DB Runs on (Virtualization) Logical monitoring port connectivity ADP Connectivity
9 Deployment Example 2 (Distributed)ADP VM1 Aggregator ADP VM2 Postgres DB ADP VM3 Passive Collector ADP VM4 Passive Collector ADP VM5 Passive Collector Physical Switch 2 Physical Switch 1 ESX1 vSwitch ESX2 vSwitch ESX3 vSwitch Runs on (Virtualization) Logical monitoring port connectivity ADP Connectivity
10 Virtual Appliances Requirements & Deployment OptionsDeploy as virtual appliances: Collector, Aggregator & DB virtual appliances Either Standalone or Distributed deployment requires a standalone postgresql DB virtual appliance. Each virtual appliance runs one or more components based on the “Appliance Role” Appliance Role OVF Template Memory (GB) vCPUs (2 GHz) No. of NICs Disk size (GB) Standalone Core 4 80 Aggregator 1 Passive Collector Collector 2 20 vPostgresql DB DB 3
11 Ports & Services used Configure firewall and other network security devices to enable the ports & services that Application Dependency Planner uses
12 Application Dependency Planner: External Reporting DB (ERDB)VMware Resource Management July 2008 Application Dependency Planner: External Reporting DB (ERDB) ADP Virtual Appliance ADP Periodic Automated Export External Reporting Database (Customer Provided) User Access Discovery Reconciliation GUI/application Out-of-the-box reporting Custom SQL queries Third-party reporting tools Extract relevant data Scheme definition Documentation Most discovered data : Hosts, services Connections Group information URL/DB table calls ADP data replicated on external reporting database Easier to use reporting database schema Schedule replication as needed Utilize SQL Queries for custom queries Ready loaders for Oracle 10g/RH ES 4 and Microsoft SQL 2005/Windows 2003 ADP External Reporting DB (ERDB) ADP comes with a predefined external DB loading option External Reporting DB (ERDB) which synchronizes with ADM data The discovered data in external DB will reflect ADM’s data up to the last replication snapshot De-normalized data structure Contains 90% of all available ADP data Well documented schema and data dictionary Simple Process ADP uploads flat files to FTP server crond or task scheduler on the DB Server kicks off Perl scripts Perl scripts grab flat files from FTP server Perl scripts push flat file data into MS-SQL or Oracle database
13 Passive Discovery ConsiderationsPassive collector can be connected to up to 3 monitoring ports (a.k.a. SPAN ports) Monitoring traffic from physical switches The monitoring port needs to be connected to a physical NIC of an ESX server An ADP collector VM must be running on the ESX server The ESX server needs to be configured so that ADP Collector can access the traffic from the physical monitoring port Monitoring traffic of ESX servers In order to monitor traffic of VMs running on the same ESX server, an ADP collector must run on the ESX server. In general, each ESX server in the data- center must run the ADP collector. Each ESX server needs to be configured to span network traffic to the ADP collector.
14 Dependency Mapping w/ ADP in vSphere environmentTitle Month Year Visibility into P –P, V – V, P – V Dependencies ESX to VC Dependencies Virtualized On Relationship ESX server VMs Virtual to Virtual Dependencies With ADP’s ability to discover tiered applications you can gain confidence in your ability to see all layers of a distributed application, continuously monitor them for configuration compliance with best practices, and ensure a smooth restart after a migration or site fail-over. ADP discovers many different types of dependencies – including dependencies between applications residing on the same or different ESX Servers. It can even discover dependencies between VMs that are managed by different vCenter Servers. Discover instances of DBs, Application servers, etc Physical to Virtual Dependencies 14
15 ADP in a Virtual Environment : Application VisibilityTitle Month Year Ensuring you understand dependencies Application Visibility for Virtualization Scenarios In this example, you can see the dependencies between all three tiers of an application and make sure that you put a protection plan in place for all three tiers. Without the visibility provided by ADP, there is a chance that you would miss one of these tiers. 15
16 Application Dependency PlannerDEMO
17 Discovery Dashboard ADP Detailed Discovery DashboardNote to Presenter : Hide if doing a demo The Detailed Discovery Dashboard shows us all the general information regarding our detailed discovery environment. The chart at top left shows us how many hosts we have successfully, partially, and failed to run a policy against. To it’s right, we see a bar chart with a bit more detail, outlining some specifics, especially in regards to the failed attempts. In the middle panes, we see on the left our list of Collectors, and their state as well as uptime. To the right, we have a list of the policies that are active, and at what rate they are performing discovery. The bottom pane shows us our individual policies, and gives us a detailed breakdown regarding their success and failures.
18 (Discovered) InventoryInventory views by Hosts, Services and Devices. ADP Inventory Screen Note to Presenter : Hide if doing a demo The Inventory screen allows us to now see much more detailed information about what hosts have been discovered. It also allows us to filter our view based on Groups (in the Navigation column on the left). Additionally, we can select individual hosts, and perform many actions, such as finding all the dependencies of a particular host, or show a group of hosts in the map. From here we can directly click on a host, and bring that host more into focus as shown in the Detailed Properties on the next slide.
19 Detailed Properties ADP Host Detailed PropertiesNote to Presenter : Hide if doing a demo Here we have a focused view of a single host. In this case, this host is a container for a number of other virtual hosts, as is noted not only in the name (“Virtual Container”), but also because we see that in the tabs list we have a tab labeled “Virtual Machines”. This tab, if selected, will show us all the Virtual Machines hosted here, and allow us to further drill down into them for more detailed information. Similarly, in this screen we can expand the nodes that we see here and view information regarding the host environment and its related elements.
20 Detailed Properties ADP Host Detailed PropertiesNote to Presenter : Hide if doing a demo Here we have a focused view of a single host. In this case, this host is a container for a number of other virtual hosts, as is noted not only in the name (“Virtual Container”), but also because we see that in the tabs list we have a tab labeled “Virtual Machines”. This tab, if selected, will show us all the Virtual Machines hosted here, and allow us to further drill down into them for more detailed information. Similarly, in this screen we can expand the nodes that we see here and view information regarding the host environment and its related elements.
21 Application Dependency MapADP Host Detailed Properties Note to Presenter : Hide if doing a demo Here we have a focused view of a single host. In this case, this host is a container for a number of other virtual hosts, as is noted not only in the name (“Virtual Container”), but also because we see that in the tabs list we have a tab labeled “Virtual Machines”. This tab, if selected, will show us all the Virtual Machines hosted here, and allow us to further drill down into them for more detailed information. Similarly, in this screen we can expand the nodes that we see here and view information regarding the host environment and its related elements.
22 Business Application Mapping (Intra-Dependency Maps)Shows the dependencies between business applications Understand know how the migration (or failure) of one business application might impact a separate business application Dependencies between business applications will affect the order in which they are brought up at a remote data center after a disaster Business applications can have dependencies to hardware that is used by other business applications. You need to know how the migration (or the failure) of one business application might impact a separate business application in order to create accurate move groups. The dependencies between business applications will also affect the order in which they are brought up at a remote data center after a disaster.
23 Pre-defined Application GroupsADP Host Detailed Properties Note to Presenter : Hide if doing a demo Here we have a focused view of a single host. In this case, this host is a container for a number of other virtual hosts, as is noted not only in the name (“Virtual Container”), but also because we see that in the tabs list we have a tab labeled “Virtual Machines”. This tab, if selected, will show us all the Virtual Machines hosted here, and allow us to further drill down into them for more detailed information. Similarly, in this screen we can expand the nodes that we see here and view information regarding the host environment and its related elements.
24 Defining A New Application GroupADP Host Detailed Properties Note to Presenter : Hide if doing a demo Here we have a focused view of a single host. In this case, this host is a container for a number of other virtual hosts, as is noted not only in the name (“Virtual Container”), but also because we see that in the tabs list we have a tab labeled “Virtual Machines”. This tab, if selected, will show us all the Virtual Machines hosted here, and allow us to further drill down into them for more detailed information. Similarly, in this screen we can expand the nodes that we see here and view information regarding the host environment and its related elements.
25 Defining A New Application FingerprintADP Host Detailed Properties Note to Presenter : Hide if doing a demo Here we have a focused view of a single host. In this case, this host is a container for a number of other virtual hosts, as is noted not only in the name (“Virtual Container”), but also because we see that in the tabs list we have a tab labeled “Virtual Machines”. This tab, if selected, will show us all the Virtual Machines hosted here, and allow us to further drill down into them for more detailed information. Similarly, in this screen we can expand the nodes that we see here and view information regarding the host environment and its related elements.
26 Setting up a connector to sync w/ external DBADP Host Detailed Properties Note to Presenter : Hide if doing a demo Here we have a focused view of a single host. In this case, this host is a container for a number of other virtual hosts, as is noted not only in the name (“Virtual Container”), but also because we see that in the tabs list we have a tab labeled “Virtual Machines”. This tab, if selected, will show us all the Virtual Machines hosted here, and allow us to further drill down into them for more detailed information. Similarly, in this screen we can expand the nodes that we see here and view information regarding the host environment and its related elements.
27 Backup slides Populating CMDBsNote to Presenter: This section of slides can be hidden if the customer is not interested in DMDB population. Note to Presenter: vCenter CMDB and the Adapter from ADPvCenter CMDB is discussed in greater detail in the vCenter Service Management deck.
28 Export to Visio
29 Discovering Application Pattern DefinitionsAn application pattern is a topology defined by a set of entities (hosts, services, databases, etc.) and the relations (i.e. connections) between them. Application pattern example: “Jboss Server is connected to Oracle DB using JDBC connection In this example 4 application pattern instances were discovered, answering the same application pattern definition. The IP addresses of the hosts on which the application resides are chosen as anchors for each application pattern instance -What is an Application Pattern? An application pattern is a topology defined by a set of components (hosts, services, databases, etc.) and the relations (connections) connecting them to one another.
30 Revamped flexible and granular grouping definitionsUsers can define groups based on other types of objects Define groups with great flexibility Based on combinations of: hosts (i.e. host, ESX server, virtual machine) services (Apache, IIS, Oracle, etc.), J2EE applications J2EE modules DB instances Flexibility User may mix and match any rule type(s) while defining a group User may define multiple rules based groups User may define include / exclude rule(s) Out of the Box group definitions For common infrastructures and application services Databases, application servers, hardware, web servers
31 ADP Control Depth of DiscoveryProvides user control with discovery plans Improves Discovery performance Discover / Don’t Discover Hosts with only outbound connections Empty hosts (hosts with no services) Certain service names/categories Certain protocol names, transport protocols, ports and/or port ranges Demand / Usage Activity Include / Exclude CI categories Default Shallow, Medium and Deep discovery plans Services can be specified individually using advanced settings
32 ADP in a Virtual Environment : Use CasesAdhere to Best Practices VMware-enabled Data Centers such as: Viewing application dependencies to enhance configuration planning Improving resource utilization by identifying VM’s no longer in use Identifying “rogue” VMware ESX Servers not managed by vCenter Understanding application dependencies and usage to optimally configure ESX servers Identify where virtualization offers better client experience, failover etc and factor application criticality Use pre VMware deployment & post VMware deployment application dependency analysis Manage Application migrations and consolidations of in mixed physical and virtual VMware environments Build data protection plans for VMware environments Utilize applications visibility when building these plans Populate CMDBs to Leverage and Maintain VMware and Physical Infrastructure Information The solution enables IT organizations to: Comply with Best Practices for Planning and Optimizing VMware-enabled Data Centers such as: Viewing application dependencies to enhance configuration planning Improving resource utilization by automatically identifying VM’s no longer in use Identifying “rogue” VMware ESX Servers that are not currently managed by VirtualCenter Applying policies that check VMotion activity for optimal configurations Understanding application dependencies and usage to optimally configure ESX servers Build data protection plans for VMware environments, including VMware Site Recovery Manager and VMware Consolidate Backup (VCB) Populate CMDBs to Leverage and Maintain VMware and Physical Infrastructure Information