Validation Testing

Test Case Skeletons

A. Core Communication and Emergency Functions

Test Case ID Req ID(s) Test Objective Test Steps/Actions (Skeleton)
VTC-101 FR-1, NFR-2 Verify Push-to-Talk (PTT) initiation and connection speed.
  1. Log in as a Field Unit user.
  2. Select a pre-configured talk group (TG-Alpha).
  3. Press and hold the PTT button for 5 seconds.
  4. Release the PTT button.
  5. Repeat steps 3-4 5 times, measuring the time from button press to connection established.
VTC-102 FR-4 Verify Emergency Alert prioritization and delivery.
  1. Log in as a Field Unit user.
  2. Initiate an Emergency Alert via the dedicated button/menu.
  3. Send a brief voice message on the emergency channel.
  4. Verify that the message is instantly received and displayed with priority at the Command Center Console.
VTC-103 FR-3, NFR-8 Verify Automatic Network Switching robustness and voice interruption time.
  1. Establish a voice connection (PTT call) using the Wi-Fi network.
  2. Move the Field Unit device into an area where Wi-Fi signal degrades (simulated).
  3. Confirm that the system automatically switches to the next best network (e.g., 5G/LTE).
  4. Measure the voice interruption duration during the switch.

B. Administrative and Monitoring Functions

Test Case ID Req ID(s) Test Objective Test Steps/Actions (Skeleton)
VTC-201 FR-2 Verify Talk Group Management functionality.
  1. Log in as an Administrator/Commander.
  2. Create a new talk group (TG-Beta), assigning a specific channel.
  3. Add three specific users to TG-Beta.
  4. Modify TG-Beta by removing one user and changing the assigned channel.
  5. Delete TG-Beta.
VTC-202 FR-5 Verify Real-Time Monitoring display accuracy.
  1. Log in as a Dispatcher.
  2. Activate real-time monitoring for three different Field Units, one Talk Group, and two Relay Towers.
  3. Cause one Field Unit to go offline, one Talk Group to become active, and one Relay Tower's signal to degrade (using simulators).
  4. Verify that the Dispatch Console accurately and immediately updates the status for all monitored items.
VTC-203 FR-9, NFR-6 Verify Call Record Storage and Retrieval.
  1. Complete a standard PTT call (VTC-101).
  2. Complete an Emergency Alert event (VTC-102).
  3. Log in as an Administrator/Investigator.
  4. Search the historical records database for the events from steps 1 and 2.
  5. Verify the retrieved records include the time, channel, participating units/users, and connection status.

C. Security, Reliability, and Performance

Test Case ID Req ID(s) Test Objective Test Steps/Actions (Skeleton)
VTC-301 FR-7 Verify Strict Identity Authentication and prevent unauthorized access.
  1. Attempt to log in with an invalid username/password 3 times.
  2. Attempt to log in successfully with valid credentials.
  3. Using a hacking simulator tool, attempt to inject a session token from an unauthorized client to impersonate a Field Unit.
  4. Verify the system rejects the unauthorized session.
VTC-302 FR-8, NFR-5 Verify Abnormal Condition Reporting and Backup Path Switching.
  1. Initiate a stable, high-volume call session (e.g., 5 units).
  2. Force a critical network controller or relay path to fail (simulated partial failure).
  3. Confirm that the system automatically switches to the backup path.
  4. Verify an "Abnormal Condition" report is generated.
  5. Measure service interruption time (should be < 10 s to not count as downtime).
VTC-303 NFR-3, NFR-4 Verify High Load Capacity (≥ 150 connections) and Latency (≤ 200 ms) under load.
  1. Using load testing tools, simulate the establishment of **150 simultaneous voice connections** across multiple talk groups.
  2. While the 150 connections are active, initiate a new, 151st PTT call.
  3. Monitor the average communication delay (latency) during the entire test.
VTC-304 NFR-1 Verify Connection Success Rate in adverse conditions.
  1. Simulate an environment with intentionally low signal strength (e.g., 1 out of 5 bars) and high background network interference.
  2. Attempt to initiate **100 PTT calls** from various Field Units across different networks.
  3. Tally the number of successful connections.
VTC-305 FR-6, NFR-7 Verify Cross-Platform Interoperability and Multi-Agency Sharing.
  1. Create a joint communication group (e.g., Fire/Police/EMS).
  2. Have a user on a **Radio**, a user on **iOS**, and a user on **Windows** join this group.
  3. Initiate a PTT call from one platform and verify real-time message exchange and clear voice quality across all three platforms.

2.2 Validation Traceability Matrix

This matrix maps every project requirement to its corresponding validation test case skeleton, ensuring that every functional and non-functional requirement is covered.

Req ID Requirement Description (Brief) Type Priority Test Case ID(s) Test Case Description (Brief)
FR-1 Support Push-to-Talk (PTT) function. Functional High VTC-101 Verify PTT initiation and talk group request.
FR-2 Allow commanders to create, modify, and delete talk groups. Functional High VTC-201 Verify Talk Group Management by Administrator.
FR-3 Automatically switch between available networks for uninterrupted communication. Functional High VTC-103 Verify auto-switching under signal degradation.
FR-4 Support Emergency Alert function with message prioritization. Functional High VTC-102 Verify Emergency Alert prioritization and delivery.
FR-5 Support real-time monitoring of units, groups, and towers. Functional High VTC-202 Verify real-time status display accuracy.
FR-6 Support sharing information between multiple units/departments. Functional High VTC-305 Verify multi-agency, cross-platform communication.
FR-7 Provide strict identity authentication. Functional High VTC-301 Verify successful login and unauthorized session rejection.
FR-8 Report abnormal conditions and switch to a backup path. Functional High VTC-302 Verify failure detection and backup path switching.
FR-9 Record call/alert time, channel, and participants. Functional High VTC-203 Verify event record creation and retrieval.
NFR-1 ≥ 90% connection success rate in weak signals. Non-Functional Medium VTC-304 Verify connection success rate under adverse signal conditions.
NFR-2 Voice connection within ≤ 50 ms after PTT. Non-Functional High VTC-101 Measure PTT connection establishment time.
NFR-3 Handle ≥ 150 simultaneous voice connections. Non-Functional High VTC-303 Verify system stability and capacity under high load.
NFR-4 Average communication delay < 200 ms under high load. Non-Functional High VTC-303 Measure communication latency during high load test.
NFR-5 99.99% availability; ≤ 5 minutes annual downtime. Non-Functional High VTC-302 Measure auto-recovery time during controlled failure.
NFR-6 Store communication records for ≥ 1 year. Non-Functional Medium VTC-203 Verify record storage format (metadata included).
NFR-7 Consistent functionality across multiple platforms. Non-Functional High VTC-305 Verify consistent PTT functionality across all platforms.
NFR-8 Voice interruption ≤ 1.5 s during network switch. Non-Functional High VTC-103 Measure voice interruption time during auto-switching.
Previous: Phase Three Next: Full Text