Weave Load Test Plan

Weave 1.3 Load Test Plan

Objective

The objective of Weave 1.3 load test is to ensure that the production configuration of the weave data services can support various levels of sustained simulated and real user weave client activity over a period of time. During the load generation tests, monitoring of key performance metrics on the both client and server will be recorded to ensure generated load levels are accurate and the system response to servicing the requests under high load conditions are within acceptable ranges.

Scope

What is being tested

• The Weave 1.3 load testing plan will ensure the following services are performing adequately and without noticeable performance issues under high but sustainable server load conditions.
  • the weave data synchronization service
  • Weave client behavior and characteristics

What is not being tested

• Due to logistics and tool limitations, The synthetic load generation clients will not use secure socket layer (SSL) communication protocol to communicate to the server. The risk exposure is contained to a degree as SSL communication is handled by the Zeus web front end server.

• Load generation will only be generated by synthetic clients. Live users will perform basic weave operations under heavy load conditions to determine if these operations are adversely affected in any measurable way.

Load Test Approach

For Weave 1.3 there are limited means available for generating realistic loads of user and client requests. Michael Hanson has written the weave load test tool based on the http protocol library libcurl. The weave load test tool will be the primary means of generating user account creation and weave sync traffic.

In addition, during periods of peak synthetic load generation we will use live weave users performing various weave synchronization test scenarios. The live testers will be reporting weave performance assessments during the load test. The performance report will be based on weave client logs and subjective performance assessment.

Load Tests to perform

Requirements

1. Hardware
   1. Production System
      1. All production hardware must be installed and configured.
   2. Load Generation
      1. Sufficient machines to run the load generation tools to reach maximum sustainable load conditions on the production system.
      2. Client load tool must be proven to create enough sustainable load to exhaust memory cache

1. Software
   1. Load Generation
      1. Weave load test tool
         1. load tool must be proven to create enough sustainable load to exhaust production system resources.
   2. Performance Metric measurement
      1. Need to determine what metrics are to be recorded for both client and server
      2. client sync response time
         1. Measure the full sync response time using the selection: Tools->Weave->Perference->Reset Sync->Replace all data on this computer with your Weave data. The response time for this trans action will be log data via the Weave Activity Log.

Schedule

Load Test Deliverables

1. Load test deliverables
   1. client response time graph
   2. server response time graphs of key metrics
   3. live weave user test reports
   4. bugs reported during test

Reference Documents

Reference Bugs

• • bug 562100 - need enhanced activity logging to measure sync performance from client

Release Checklist

Client Requirements

Server Requirements

Test Requirements

Issues and Questions