'Power BI UAT and Regression Testing approach

I am trying to come up with the right strategy on BI Testing (UAT/Regression). Below are the details. Appreciate if you could share you point of view please?

Testing architecture: enter image description here

Definitions:

  • Correctness: The data at hand is correct and is the same as the data source
  • Accuracy: The verified business logic (DAX Formulas) is applied rightly on the correct data to generate the visuals.

UAT Validation Objective

  • Option 1: Semi-Manual
  1. Validate the data correctness at the raw level (without formulas applied such as total sales in a given year, number of rows for a given generic query, etc.) to verify if the data at PBI is same as the data at the source (Apple to Apple) – Define source data query and Define PBI query and run to compare the results in DAX studio – This step can be automated (Example: https://p3adaptive.com/2018/09/automated-testing-using-dax-for-power-bi/)
  2. Validate the data accuracy (If DAX formulas applied rightly based on verified business logic) – This is manual validation
  • Option 2: ?

Regression Testing Objective Rerun the tests based on the same test data and same dashboard baseline

  • Option 1: Snapshot comparison (Tool automation)
  1. Take a dashboard snapshot as baseline
  2. Compare dashboards after each new release on the same data set to get discrepancy report.
  • Option 2: ?


Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source