Load Testing Plan Development

Objective

Build a test suite that will be used to performance test the current core CFA solution under simulated production load.  Based on current production metrics, the system will generate a mean load of 1000 concurrent devices and generating DLPS:

85 devices performing counts

130 devices creating orders

1000 devices logging in and accessing the Splash page

100 devices settling cashiers

400 devices finalizing the day

140 devices performing change fund activities

80 devices creating deposits

20 devices reconciling paid ins/paid outs

45 devices creating transfers

and a max load of 2000 concurrent devices with the ability to increase the number of devices as needed with a goal of ascertaining a breaking point.

 

-------------------------------------------------------------------------------------------------------------

Framework Setup and Performance Testing Runs

Install all tools necessary to run performance test and create and configure the framework to allow the scripted scenarios to run under load. Run all the scripts scripted under DV02 multiple times and gather metrics:

Metrics

Response Metrics

Average Response Time

Peak Response Time  

Error Rate    

Volume Metrics  

Concurrent Users  

Requests per Second  

Throughput    

System Utilization Metrics  

CPU Usage on Web Servers

CPU Usage on the SQL database

CPU Usage on the Database server

Memory Usage on the Web Servers

Memory Usage on the SQL Database

Memory Usage on the Database Server

Disk I/O on the Database Server

Disk I/O on the SQL Database

Query to identify Database table locks

SentryOne Report for longest running queries

Detailed Description of Features that need to be Load Tested

Scripting of main features of the InFORM application so that they can be run within the framework to get the system under load.

Custom scripts written to test:

• MxC Orders
• Create an order with 100 items
• Generate a Purchase Order XML file that could be sent to the vendor, to be sent to a folder
• Generate a Suggested Order export for each order

• MxC Transfers
• Create a transfer with 5 items

• MxC Counts
• Create a monthly count and count 300 Items
• Generate one Count Export for each count
• Trigger the UPT Factor calculation for each count

• MxC Change Fund
• Perform an opening change fund
• Perform a change fund received
• Assign a variance
• Authorize a closing change fund

• MxC Cashier Settlement
• Settle 20 cashiers
• Select Cashier
• Release & Modify Cashier
• Expand Cashier Details
• Expand Cashier Key Indicators
• Authorize Cashier

• MxC Deposits
• Create 1 deposit
• Record a deposit amount and compare to amount system has calculated as required

• MxC Paid In/Paid Out
• Add Two New Records (requires a Cashier Shift)
• Apply Update
• Edit Record
• Delete Record

• MxC Finalize Day
• Close out the day with typical activities such as authorizing the day and associating an impacting event with the day

• DLPS
• Display one route for 2000 concurrent users

• Splash and Login Pages for both MxConnect and MMS
• Login and access the MMS (existing) and MxConnect Splash Pages (R4)

• Tax Exempt Sales Report
• Run the report with a month date range for each restaurant

Technical and User Documentation

Documentation that explains how the tools are architected, scripts are written and written as well as user facing documentation on how to run the performance tests.  This also includes hand off to the CFA Dedicated Team for future support