Remove Zeros - Load Test Forecast Import

As a Product Owner I want my development team to perform load testing on the forecast import so that we can be confident in the processes that we have in place

Notes

• This issue is to track the work necessary to enhance the current forecast import pipeline to support importing forecasts for the whole chain each night. Current measures extrapolated put us at ~12 hour to import forecasts for the whole chain, and also doesn't leave much room for emergency re-imports as needed. Still need to narrow down exactly what this enhancement will be, but the current recommendation is to explore removing the "zero" forecasts to significantly (up to 80%) reduce the amount of data sent to InFORM for a single forecast.
• Add Second Service Type to Forecast Import Files
• Remove all intervals that are all zeros
• Load Test
• Document

Load Tests to perform and document

• Run current forecast import load test for 2,200 stores
  • 117 mins, 2409 stores
• Run load test, for 2,200 stores, with second Service type added to the forecast import files
  • With Outside sales: 318 mins, 2409 stores, 1 avg per min across all queues
• Run load test, for 2,200 stores, with second service type, and zero intervals removed
• Simple windows app that we can run against the file to delete the zero records, in a reproducible manner

Acceptance Criteria

1. Confirm that the current forecast import load test is performed
2. Confirm that the results of the initial load test are documented
3. Confirm that a set of files with two service types (inside/outside sales) can be generated
4. Confirm that load tests are performed with files that contain two service types for all intervals
5. Confirm that the results of the two service type load tests are documented
6. Confirm that a set of files can be generated, with all zero intervals removed, and two service types present can be generated
7. Confirm that load tests are performed with files that have zero intervals removed, and contain two service types for all intervals
8. Confirm that the results of removing zero intervals are documented (https://fourthlimited.atlassian.net/wiki/spaces/RBCD/pages/1658447988/CFA+Sandbox+Load+Testing)