Jaa

FinOps toolkit changelog

  • Artikkeli

This article summarizes the features and enhancements in each release of the FinOps toolkit.


Unreleased

The following section lists features and enhancements that are currently in development.

FinOps hubs

  • Autobackfill – Backfill historical data from Microsoft Cost Management.
  • Retention – Configure how long you want to keep Cost Management exports and normalized data in storage.

Power BI reports

  • Populate missing prices.

Bicep Registry modules

  • Cost Management export modules for subscriptions and resource groups.


v0.7

Released December 1, 2024

FinOps guide v0.7

Power BI reports v0.7

  • Added
    • Added partial support for OneLake URLs.
      • Support for OneLake URLs was added based on feedback and wasn't fully tested. More changes may be needed to fully support Microsoft Fabric.
    • Fix EffectiveCost for savings plan purchases to work around a bug in exported data.
    • Added KQL-based version of the Cost summary, Data ingestion, and Rate optimization reports that connect to FinOps hubs with Azure Data Explorer.
  • Changed
    • Consolidated the Hub Storage URL and Export Storage URL parameters into a single Storage URL.
      • All datasets must be either raw exports outside of FinOps hubs or be processed through hubs. This release no longer supports some data from hubs and some from raw exports.
      • If you have existing exports that aren't running through hubs data pipelines, change the exports to point to the hub msexports container.
      • This change was made to simplify the setup process and avoid errors in Power BI service configuration (for example, incremental refresh).
    • Renamed the following columns:
      • The x_DatasetChanges column is now x_SourceChanges.
      • The x_DatasetType column is now x_SourceType.
      • The x_DatasetVersion column is now x_SourceVersion.
      • The x_AccountType column is now x_BillingAccountAgreement.
    • Updated supported spend estimates in the Power BI documentation.

FinOps hubs v0.7

Breaking change

  • Added
    • Option to ingest data into an Azure Data Explorer cluster.
    • Set missing reservation list and contracted prices/cost columns for EA and MCA accounts (Data Explorer only).
      • Requires the price sheet export to be configured.
    • Support for FOCUS 1.0r2 exports.
      • The 1.0r2 dataset only differs in date formatting. There are no functional differences compared to 1.0.
      • For example, dates in 1.0 are formatted as 2024-01-01T00:00Z while dates in 1.0r2 are formatted as 2024-01-01T00:00:00Z. Note the last :00 for seconds.
      • The 1.0r2 dataset is only needed if you experience date parsing errors with the 1.0 dataset.
    • Support for private endpoints via an optional template parameter.
      • Added private endpoints for storage account, Azure Data Explorer & Keyvault.
      • Added managed virtual network & storage endpoint for Azure Data Factory Runtime.
      • All data processing now happens within a virtual network.
      • Added param to disable external access to Azure Data Lake and Azure Data Explorer.
      • Added param to specify subnet range of virtual network - minimum size = /26
    • Support for storage account infrastructure encryption.
    • Published a schema file for the hub settings.json file.
  • Changed
    • Changed dataset names in the ingestion container to facilitate Azure Data Explorer ingestion.

      Important

      This change requires removing previously ingested data for the current month to avoid data duplication. You do not need to re-export historical data for storage-based Power BI reports; however, historical data DOES need to be re-exported to ingest into Azure Data Explorer.

      • For FOCUS cost data, use Costs.
      • For price sheet data, use Prices.
      • For reservation details, use CommitmentDiscountUsage.
      • For reservation recommendations, use Recommendations.
      • For reservation transactions, use Transactions.
    • Renamed the msexports_FileAdded trigger to msexports_ManifestAdded.
  • Fixed
    • Fix EffectiveCost for savings plan purchases to work around a bug in exported data (Data Explorer only).

FinOps workbooks v0.7

Optimization workbook v0.7

  • Added
    • On the Storage tab, included the RSVaultBackup tag in the list of nonidle disks.
  • Fixed
    • On the Azure reservations tab, fixed an error some users experienced with rows being limited.
    • On the Compute tab, fixed incorrect virtual machine processor in processors query.
  • Removed
    • On the Database tab, removed the idle SQL databases query.
      • This query will be reevaluated and added again in a future release.

Optimization engine v0.7

  • Fixed
    • Exports ingestion issues in cases where exports come with empty lines (#998)
    • Missing columns in EA savings plans exports (#1026)

Open data v0.7

Resource types v0.7

  • Added
    • Added 50 new Microsoft.AWSConnector resource types.
    • Added eight new Microsoft.Compute resource types.
    • Added three new Microsoft.ContainerInstance resource types.
    • Added three new Microsoft.DatabaseFleetManager resource types.
    • Added four new Microsoft.Fabric resource types.
    • Added five new Microsoft.OpenLogisticsPlatform resource types.
    • Added three new Microsoft.Sovereign resource types.
    • Added 10 other new Microsoft resource types:
      • microsoft.azurestackhci/edgedevices/jobs
      • microsoft.clouddeviceplatform/delegatedidentities
      • microsoft.compute/capacityreservationgroupscomputehub
      • microsoft.compute/galleries/imagescomputehub
      • microsoft.compute/hostgroupscomputehub
      • microsoft.hybridcompute/machinessoftwareassurance
      • microsoft.machinelearning/workspaces
      • microsoft.resources/deletedresources
      • microsoft.security/defenderforstoragesettings/malwarescans
      • microsoft.weightsandbiases/instances
    • Added four other new third-party resource types:
      • arizeai.observabilityeval/organizations
      • lambdatest.hyperexecute/organizations
      • neon.postgres/organizations
      • pinecone.vectordb/organizations
  • Changed
    • Updated 17 new Microsoft.ComputeHub resource types.
    • Updated nine other resource type:
      • microsoft.appsecurity/policies
      • microsoft.compute/virtualmachines/providers/guestconfigurationassignments
      • microsoft.dbforpostgresql/flexibleservers
      • microsoft.deviceregistry/billingcontainers
      • microsoft.durabletask/namespaces
      • microsoft.durabletask/namespaces/taskhubs
      • microsoft.edge/configurations
      • microsoft.hybridcompute/machines/providers/guestconfigurationassignments
      • microsoft.securitycopilot/capacities

Services v0.7

  • Added
    • Added three resource types to existing services:
      • microsoft.hardwaresecuritymodules/cloudhsmclusters
      • microsoft.healthdataaiservices/deidservices
      • microsoft.insights/datacollectionrules

v0.6 Update 1

Released October 5, 2024

This release is a minor patch to update documentation and fix Rate optimization and Data ingestion Power BI files. These files were updated in the existing 0.6 release. We're documenting this release as a new patch release for transparency. If you downloaded these files between October 2-4, 2024, update to the latest version.

Power BI reports v0.6 update 1

  • Added
    • Documented the need to configure both Hub Storage URL and Export Storage URL when publishing reports to the Power BI service (#1033).
  • Fixed
    • Updated the Data ingestion report to account for storage path changes (#1043).
    • Updated the Rate optimization report to remove the sensitivity level (#1041).

FinOps hubs v0.6 update 1

  • Added
    • Added compatibility guide to identify when changes are compatible with older Power BI reports.
  • Changed
    • Updated the upgrade guide to account for changes in 0.5 and 0.6.
  • Fixed
    • Fixed the reservation details mapping file.

v0.6

Released October 2, 2024

FinOps guide v0.6

  • Added
    • Started a FinOps best practices library using Azure Resource Graph (ARG) queries from the Cost optimization workbook.

Power BI reports v0.6

General Power BI updates v0.6

Governance report v0.6

  • Added
    • Added Policy compliance.
    • Added Virtual machines and managed disks.
    • Added SQL databases.
    • Added Network security groups.

Workload optimization report v0.6

  • Added
    • Added Azure Advisor cost recommendations.
    • Added Unattached disks.

FinOps hubs v0.6

  • Added
    • Support for Cost Management parquet and Gzip CSV exports.
    • Support for ingesting price, reservation recommendation, reservation detail, and reservation transaction datasets via Cost Management exports.
    • Compatibility guide to explain what versions of hubs and Power BI reports work together.
    • New UnsupportedExportFileType error when the exported file type isn't supported.
  • Changed
    • Renamed the following pipelines to be clearer about their intent:
      • config_BackfillData to config_StartBackfillProcess.
      • config_ExportData to config_StartExportProcess.
      • config_RunBackfill to config_RunBackfillJob.
      • config_RunExports to config_RunExportJobs.
    • Changed the storage ingestion path from "{scope}/{yyyyMM}/{dataset}" to "{dataset}/{yyyy}/{MM}/{dataset}"
  • Fixed
    • Updated the config_RunBackfillJob and config_StartExportProcess pipelines to handle when there's a single scope defined in config instead of an array.
    • Corrected the reservation details version in the schema file name in storage.
  • Removed
    • Removed the temporary Event Grid resource from the template.

FinOps workbooks v0.6

Optimization engine v0.6

  • Added
  • Changed
    • Replaced storage account key-based authentication with Microsoft Entra ID authentication for improved security.
  • Fixed
    • Added expiring savings plans and reservations to usage workbooks (#1014).
  • Deprecated
    • With the deprecation of the legacy Log Analytics agent in August 31, the Setup-LogAnalyticsWorkspaces script is no longer being maintained and will be removed in a future update.

PowerShell module v0.6

Open data v0.6

Resource types v0.6

  • Added
    • Added 13 new Microsoft.Billing resource types.
    • Added 17 new Microsoft.ComputeHub resource types.
    • Added two new Microsoft.DeviceOnboarding resource types.
    • Added eight new Microsoft.Edge resource types.
    • Added eight other new resource types:
      • microsoft.agricultureplatform/agriservices
      • microsoft.azurefleet/fleetscomputehub
      • microsoft.cloudtest/buildcaches
      • microsoft.contoso/employees/desks
      • microsoft.databasefleetmanager/fleets
      • microsoft.resources/databoundaries
      • microsoft.subscription/changetenantrequest
      • microsoft.sustainabilityservices/calculations
  • Changed
    • Updated two Microsoft.DurableTask resource types.
    • Updated four Microsoft.SignalRService resource types.
    • Updated four Microsoft.TimeSeriesInsights resource types.
    • Updated four other resource types:
      • microsoft.network/dnsresolvers
      • microsoft.search/searchservices
      • microsoft.storagepool/diskpools/iscsitargets
      • oracle.database/oraclesubscriptions

Services v0.6

  • Added
    • Added a new ServiceSubcategory column to support FOCUS 1.1 ServiceSubcategory mapping.
    • Added the following resource types to existing services:
      • microsoft.apimanagement/gateways
      • microsoft.sql/longtermretentionmanagedinstances
      • microsoft.sql/longtermretentionservers
      • microsoft.verifiedid/authorities

Download v0.6   Full changelog


v0.5 Update 1

Released September 7, 2024

This release is a minor patch to Power BI files. These files were updated in the existing 0.5 release. We're documenting the release as a new patch release for transparency.

Power BI reports v0.5 update 1

  • Fixed
    • Corrected a bug where Azure Data Lake Storage (ADLS) data sources couldn't be refreshed from the Power BI service (#964).

      This updated all PBIX/PBIT files downloaded between September 1-6, 2024. If you are using one of these files and plan to publish it to the Power BI service, please update to the latest version of the PBIX or PBIT files.


v0.5

Released September 1, 2024

FinOps guide v0.5

Power BI reports v0.5

General Power BI updates v0.5

  • Changed
    • Updated ListCost, ListUnitPrice, ContractedCost, and ContractedUnitPrice when not provided in Cost Management exports.
      • Contracted cost/price are set to effective cost/price when not available.
      • List cost/price are set to contracted cost/price when not available.
      • This means savings can be calculated, but aren't complete.
      • Refer to the Data quality page for details about missing or updated data.
    • Added support for pointing Power BI reports directly to Cost Management exports (without FinOps hubs).
    • Added new tables for Prices, ReservationDetails, ReservationRecommendations, and ReservationTransactions (works with exports only; doesn't work with hubs).
  • Fixed
    • Fixed a bug in Cost Management exports where committed usage is showing as "Standard" pricing category.

Cost summary report v0.5

  • Changed
    • Added a table to the Data quality page to identify rows for which a unique ID can't be identified.
    • Added a table to the Data quality page to identify rows where billing currency and pricing currency are different.

Rate optimization report v0.5

  • Changed
    • Commitment savings no longer filters out rows with missing list/contracted cost.
      • Since ListCost and ContractedCost are set to a fallback value when not included in Cost Management data, we can now calculate partial savings.
      • The calculated savings function is still incomplete since we don't have accurate list/contracted cost values.
    • Merged shared and single reservation recommendations into a single Reservation recommendations page.

FinOps hubs v0.5

  • Added
    • Added an optional skipEventGridRegistration template parameter to support skipping Event Grid resource provider registration.
    • Added an Event Grid section to the hubs create form.
  • Changed
    • Changed the Event Grid location selection logic to only identify fallback regions rather than supported regions.
    • Expanded cost estimate documentation to call out Power BI pricing and include a link to the Pricing Calculator.
  • Fixed
    • Updated the config_ConfigureExports pipeline to handle when scopes in the settings.json file aren't an object.
    • Fixed a bug where scopes added via the Add-FinOpsHubScope command aren't added correctly due to missing brackets.

FinOps workbooks v0.5

Optimization workbook v0.5

  • Added
    • New compute query to identify VMs per processor architecture type
    • New database query to identify SQL Pool instances with zero databases
    • New storage query to identify Powered Off VMs with Premium Disks
  • Changed
    • Redesign of the Rate Optimization tab for easier identification of the break-even point for reservations
    • Fixed the Hybrid Benefit Virtual Machine Scale Set query to count the total cores consumed per the entire scale set
    • Improved storage idle disks query to ignore disks used by Azure Kubernetes Service pods
    • Updated Storage not v2 query to exclude blockBlobStorage accounts from the list
    • Added export option for the list of idle backups to streamline data extraction

Governance workbook v0.5

  • Changed
    • Removed the management group filter to simplify filtering by subscription.

Optimization engine v0.5

  • Added
    • Register-MultitenantAutomationSchedules PowerShell script helper to add a different Azure tenant to the scope of AOE.
    • Zone-redundant storage (ZRS) disks included in the scope of the Premium SSD disk has been underutilized recommendation (besides locally redundant storage (LRS)).
    • Option to scope consumption exports to MCA Billing Profile.
  • Changed
    • Improved SQL Database security, replacing SQL authentication by Microsoft Entra ID authentication-only.
  • Fixed
    • Premium SSD disk has been underutilized recommendation wasn't showing results due to a meter name change in Cost Management (#831).
    • Consumption exports for pay-as-you-go MCA subscriptions were missing cost data (#828)

PowerShell module v0.5

  • Added
  • Changed
    • Update Get-AzAccessToken calls to use -AsSecureString (#946).
  • Fixed
    • Fixed New-FinOpsCostExport to address breaking change in Cost Management when storage paths start with /.
    • Fixed a bug where scopes added via the Add-FinOpsHubScope command aren't added correctly due to missing brackets.

Open data v0.5

Pricing units v0.5

  • Added
    • Added handling for the following new UnitOfMeasure values: 1 /Minute, 10 PiB/Hour, 100000 /Month, Text.
  • Changed
    • Changed DistinctUnits for the 10000s UnitOfMeasure from Units to Transactions.

Regions v0.5

  • Added
    • Added the following new region values:
      • asiapacific
      • australia
      • azure stack
      • eastsu2
      • gbs
      • germany west central
      • japan
      • sweden central
      • unitedstates
      • us do
      • central
      • us dod east
      • us gov iowa
      • us gov virginia
      • us2
      • usa
      • usv

Resource types v0.5

  • Added
    • Added the following new resource types:
      • microsoft.app/logicapps
      • microsoft.app/logicapps/workflows
      • microsoft.azurebusinesscontinuity/deletedunifiedprotecteditems
      • microsoft.azurebusinesscontinuity/unifiedprotecteditems
      • microsoft.azurecis/publishconfigvalues
      • microsoft.compositesolutions/compositesolutiondefinitions
      • microsoft.compositesolutions/compositesolutions
      • microsoft.compute/capacityreservationgroups/capacityreservations
      • microsoft.compute/virtualmachinescalesets/virtualmachines
      • microsoft.datareplication/replicationvaults/alertsettings
      • microsoft.datareplication/replicationvaults/events
      • microsoft.datareplication/replicationvaults/jobs
      • microsoft.datareplication/replicationvaults/jobs/operations
      • microsoft.datareplication/replicationvaults/operations
      • microsoft.datareplication/replicationvaults/protecteditems
      • microsoft.datareplication/replicationvaults/protecteditems/operations
      • microsoft.datareplication/replicationvaults/protecteditems/recoverypoints
      • microsoft.datareplication/replicationvaults/replicationextensions
      • microsoft.datareplication/replicationvaults/replicationextensions/operations
      • microsoft.datareplication/replicationvaults/replicationpolicies
      • microsoft.datareplication/replicationvaults/replicationpolicies/operations
      • microsoft.deviceregistry/billingcontainers
      • microsoft.deviceregistry/discoveredassetendpointprofiles
      • microsoft.deviceregistry/discoveredassets
      • microsoft.deviceregistry/schemaregistries
      • microsoft.deviceregistry/schemaregistries/schemas
      • microsoft.deviceregistry/schemaregistries/schemas/schemaversions
      • microsoft.eventgrid/systemtopics/eventsubscriptions
      • microsoft.hardware/orders
      • microsoft.hybridcompute/machines/microsoft.awsconnector/ec2instances
      • microsoft.hybridonboarding/extensionmanagers
      • microsoft.iotoperations/instances
      • microsoft.iotoperations/instances/brokers
      • microsoft.iotoperations/instances/brokers/authentications
      • microsoft.iotoperations/instances/brokers/authorizations
      • microsoft.iotoperations/instances/brokers/listeners
      • microsoft.iotoperations/instances/dataflowendpoints
      • microsoft.iotoperations/instances/dataflowprofiles
      • microsoft.iotoperations/instances/dataflowprofiles/dataflows
      • microsoft.messagingconnectors/connectors
      • microsoft.mobilepacketcore/networkfunctions
      • microsoft.saashub/cloudservices/hidden
      • microsoft.secretsynccontroller/azurekeyvaultsecretproviderclasses
      • microsoft.secretsynccontroller/secretsyncs
      • microsoft.storagepool/diskpools/iscsitargets
      • microsoft.usagebilling/accounts/dataexports
      • microsoft.usagebilling/accounts/metricexports
      • microsoft.windowsesu/multipleactivationkeys
  • Changed
    • Updated the following resource types:
      • microsoft.apimanagement/gateways
      • microsoft.azurearcdata/sqlserveresulicenses
      • microsoft.azurestackhci/edgenodepools
      • microsoft.azurestackhci/galleryimages
      • microsoft.azurestackhci/logicalnetworks
      • microsoft.azurestackhci/marketplacegalleryimages
      • microsoft.azurestackhci/networkinterfaces
      • microsoft.azurestackhci/storagecontainers
      • microsoft.cache/redisenterprise
      • microsoft.cache/redisenterprise/databases
      • microsoft.databricks/accessconnectors
      • microsoft.datareplication/replicationvaults
      • microsoft.devhub/iacprofiles
      • microsoft.edge/sites
      • microsoft.eventhub/namespaces
      • microsoft.hybridcompute/gateways
      • microsoft.impact/connectors
      • microsoft.iotoperationsorchestrator/instances
      • microsoft.iotoperationsorchestrator/solutions
      • microsoft.iotoperationsorchestrator/targets
      • microsoft.kubernetesruntime/loadbalancers
      • microsoft.manufacturingplatform/manufacturingdataservices
      • microsoft.network/dnsforwardingrulesets
      • microsoft.network/dnsresolvers
      • microsoft.network/dnszones
      • microsoft.powerbidedicated/capacities
      • microsoft.programmableconnectivity/gateways
      • microsoft.programmableconnectivity/operatorapiconnections
      • microsoft.programmableconnectivity/operatorapiplans
      • microsoft.resources/subscriptions/resourcegroups
      • microsoft.security/pricings
      • microsoft.sovereign/transparencylogs
      • microsoft.storagepool/diskpools
    • Updated multiple resource types for the following resource providers: microsoft.awsconnector.
    • Changed the following resource providers to be GA: microsoft.modsimworkbench.
  • Removed
    • Removed internal "microsoft.cognitiveservices/browse*" resource types

Services v0.5

  • Added
    • Added the following consumed services:
      • API Center
      • API Management
      • Bastion Scale Units
      • Microsoft.Community
      • Microsoft.DataReplication.Admin
      • Microsoft.DevOpsInfrastructure
      • Microsoft.Dynamics365FraudProtection
      • Microsoft.HybridContainerService
      • Microsoft.NetworkFunction
      • Microsoft.RecommendationsService
      • Microsoft.ServiceNetworking
      • Virtual Network
    • Added the following resource types to existing services:
      • Microsoft.AgFoodPlatform/farmBeats
      • Microsoft.App/sessionPools
      • Microsoft.AzureActiveDirectory/ciamDirectories
      • Microsoft.AzureArcData/sqlServerEsuLicenses
      • Microsoft.Graph/accounts
      • Microsoft.MachineLearningServices/registries
      • Microsoft.Orbital/groundStations
      • PlayFabBillingService/partyVoice
  • Changed
    • Moved Microsoft Genomics from the AI and Machine Learning service category to Analytics.
    • Changed Microsoft Genomics from the SaaS service model to PaaS.
    • Replace Azure Active Directory service name references with Microsoft Entra.
    • Move Azure Cache for Redis from the Storage service category to Databases.
    • Move Event Hubs from the Integration service category to Analytics.
    • Rename the Microsoft.HybridCompute consumed service name from Azure Resource Manager to Azure Arc.
    • Move Microsoft Defender for Endpoint from the Multicloud service category to Security.
    • Move StorSimple from the Multicloud service category to Storage.

Download v0.5   Full changelog


v0.4

Released July 12, 2024

FinOps guide v0.4

FinOps hubs v0.4

  • Added
    • Ingest FOCUS 1.0 data in FinOps hubs.
    • Grant access to FinOps hubs to create and manage exports for you.
    • Connect to a hub instance in another Microsoft Entra ID tenant.
    • Step-by-step troubleshooting guide and expanded set of common errors for validating FinOps hubs and Power BI setup.
  • Fixed
    • Fixed an issue where some dates are showing as off by 1 based on local time zone.
      • If you see dates that are off, upgrade to 0.4 and re-export those months. The fix is in ingestion.
      • You can re-export data in FOCUS 1.0 or FOCUS 1.0 preview. We recommend FOCUS 1.0 for slightly faster refresh times in Power BI.

Power BI reports v0.4

General Power BI updates v0.4

  • Added
    • x_IncrementalRefreshDate column to facilitate configuring incremental refresh in Power BI.
    • Step-by-step troubleshooting guide and expanded set of common errors for validating Power BI setup.
  • Changed
    • Changed the Tags column to default to {} when empty to facilitate tag expansion (#691).
    • Simplified formatting for the BillingPeriod and ChargePeriod measures in Power BI.
    • Improved error handling for derived savings columns in the CostDetails query.
    • Simplified queries and improved error handling in the START HERE query for report setup steps.
    • Changed internal storage for reports to use Tabular Model Definition Language (TMDL).
      • This change makes it easier to review changes to the data model in Power BI.
      • Reports continue to get released as Power BI report (.pbix) files, so this change shouldn't affect end users.
      • Visualizations aren't being switched to Power BI Enhanced Report (PBIR) format yet due to functional limitations that would affect end users (as of June 2024).
  • Fixed
    • Improved parsing for the x_ResourceParentName and x_ResourceParentType columns (#691).

Cost summary report v0.4

Data ingestion report v0.4

  • Added
  • Changed
    • Optimized queries to reduce memory footprint and load faster.
  • Fixed
    • Fixed error in queries.

Rate optimization report v0.4

  • Changed
    • Renamed the "Commitment discounts" report to "Rate optimization" to align to the FinOps Framework 2024 updates.
  • Fixed

FinOps workbooks v0.4

Optimization workbook v0.4

  • Added
    • Added reservation recommendations with the break-even point to identify when savings would be achieved.
    • Identify idle ExpressRoute circuits to streamline costs.
    • Gain insights into the routing preferences for public IP addresses to optimize network performance.
    • Explore commitment discount savings to get a clear overview of rate optimization opportunities.
    • Quickly view public IP addresses with DDoS protection enabled and compare if it would be cheaper to enable DDoS to the virtual network instead.
    • Identify Azure Hybrid Benefit usage for SQL Database elastic pools to maximize cost efficiency.
  • Changed
    • Redesigned the Sustainability tab to clarify recommendations.
    • Provide more accurate results by ignoring dynamic IPs in the public IP addresses list.
    • Ignore free tier web apps to provide a clearer picture of your top services.

Governance workbook v0.4

  • Added
    • Added managed disk usage monitoring.
  • Changed
    • Overview was revised to align with the latest governance principles of the cloud adoption framework.

Optimization engine v0.4

  • Added
    • Added Azure Optimization Engine (AOE), an extensible solution for custom optimization recommendations.

PowerShell module v0.4

  • Added
  • Changed
  • Removed
    • Removed support for Windows PowerShell.

      We discovered errors with Windows PowerShell due to incompatibilities in Windows PowerShell and PowerShell 7. Due to our limited capacity, we decided to only support PowerShell 7 going forward.

    • Removed ConvertTo-FinOpsSchema and Invoke-FinOpsSchemaTransform commands which were deprecated in 0.2 (January 2024).

Open data v0.4

Download v0.4   Full changelog


v0.3

Released March 28, 2024

FinOps guide v0.3

  • Added
    • Moved Azure FinOps documentation about how to implement and adopt FinOps into the toolkit repository.
  • Changed
    • Rearranged documentation site to better organize content.

FinOps hubs v0.3

  • Added
    • Started archiving template versions so they can be referenced easily via URL microsoft.github.io/finops-toolkit/deploy/finops-hub-{version}.json.
  • Fixed
    • Fixed "missing period" error Data Factory Studio.
    • Fixed bug where msexports_FileAdded trigger wasn't getting started.
    • Fixed deploy to Azure buttons to point to the latest release.
  • Changed
    • Return a single boolean value from the Remove-FinOpsHub command.

Power BI reports v0.3

General Power BI updates v0.3

  • Added
    • Added ResourceParentId, ResourceParentName, and ResourceParentType columns to support the usage of the user-defined cm-resource-parent tag.
    • Added ToolkitVersion and ToolkitTool columns to help quantify the cost of FinOps toolkit solutions.
    • Added a Data quality page to the Commitment discounts report for data quality validations. This page can be useful in identifying data gaps in Cost Management.
    • Added x_NegotiatedUnitPriceSavings column to show the price reduction from negotiated discounts compared to the public, list price.
    • Added x_IsFree column to indicate when a row represents a free charge (based on Cost Management data). It gets used in data quality checks.
    • Added Tags and TagsAsJson columns to both the Usage details and Usage details amortized tables in the CostManagementTemplateApp report (#625).
  • Changed
    • Changed "Other" ChargeSubcategory for usage to "On-Demand" to be consistent with Cost Management exports
    • Renamed savings columns for consistency:
      • x_OnDemandUnitPriceSavings is now x_CommitmentUnitPriceSavings. It shows the commitment discount price reduction compared to the negotiated prices for the account.
      • x_ListUnitPriceSavings is now x_DiscountUnitPriceSavings. It shows the price reduction from all discounts compared to the public, list price.
      • x_NegotiatedSavings is now x_NegotiatedCostSavings. It shows the cost savings from negotiated discounts only (excluding commitment discounts).
      • x_CommitmentSavings is now x_CommitmentCostSavings. It shows the cost savings from commitment discounts compared to on-demand prices for the account (including negotiated discounts).
      • x_DiscountSavings is now x_DiscountCostSavings. It shows the cost savings from all negotiated and commitment discounts.
    • Changed the PricingQuantity and UsageQuantity columns to use three decimal places.
    • Changed all cost columns to use two decimal places.
    • Changed all unit price columns to not summarize by default and use three decimal places.
    • Changed the x_PricingBlockSize column to a whole number and not summarize by default.
  • Fixed
    • Fixed data issue where Cost Management uses 1Year, 3Years, and 5Years for the x_SkuTerm. Values should be 12, 36, and 60 (#594).
    • Changed the data type for the x_Month column to be a date.
    • Changed x_SkuTerm to be a whole number and to not summarize by default.
    • Changed x_BillingExchangeRate to not summarize by default.
    • Corrected the datatype for the x_Month column.

Commitment discounts report v0.3

  • Changed
    • Renamed the Coverage pages to Recommendations.
  • Fixed
    • Fixed incorrect filter (#585).

Cost Management connector report v0.3

  • Fixed
    • Fixed numerous errors causing the report to not load for MCA accounts.
    • Corrected references to x_InvoiceIssuerId and InvoiceIssuerName columns (#639).

PowerShell module v0.3

  • Added
    • Get-FinOpsService includes new -Environment and -ServiceModel filters and properties in the response (#585).
  • Changed
    • Start-FinOpsCostExport includes a new -Backfill option to backfill multiple months.
    • Start-FinOpsCostExport includes a new -StartDate and -EndDate options to run the export for a given date range. It can include multiple months.
  • Fixed
    • Fixed ParameterBindingException error in New-FinOpsCostExport.
    • Updated the FOCUS dataset version that was changed in Cost Management exports in New-FinOpsCostExport.
    • Changed the default -EndDate in New-FinOpsCostExport to be the end of the month due to a breaking change in Cost Management exports.
    • Fixed internal command used in Deploy-FinOpsHub that might cause failure for some versions of the Az PowerShell module.

Open data v0.3

Download v0.3   Full changelog


v0.2

Released January 22, 2024

FinOps hubs v0.2

Breaking change

  • Fixed
    • Fixed error in some China regions where deployment scripts weren't supported (#259).
  • Changed
    • Switch from amortized cost exports to FOCUS cost exports.

      Note

      This change requires re-ingesting historical data and isn't backwards compatible. The unified schema used in this release is aligned with the future plans for Microsoft Cost Management exports. A later release updates the schema to align to the FinOps Open Cost and Usage Specification (FOCUS).

    • Updated ingestion container month folders from yyyyMMdd-yyyyMMdd to yyyyMM.
    • Renamed msexports_extract pipeline to msexports_ExecuteETL.
    • Renamed msexports_transform pipeline to msexports_ETL_ingestion.

Power BI reports v0.2

General Power BI updates v0.2

  • Changed
    • Updated reports to FOCUS 1.0 preview.
    • Updated reports to only use FinOps hubs.
    • Removed unused custom visualizations.
    • Organized set up instructions in Cost summary to match other reports.
    • Updated troubleshooting documentation.
  • Fixed
    • Removed sensitivity labels.
    • Fixed dynamic data source error when the Power BI service refreshes data.
      • Error message: You can't schedule refresh for this semantic model because the following data sources currently don't support refresh...
    • Fixed error in ChargeId column when ResourceId is empty.
    • Removed the ChargeId column due to it bloating the data size.
      • The field is commented out. If interested, you can enable uncomment in the ftk_NormalizeSchema function. It can duplicate many columns to ensure uniqueness which bloats the data size significantly.
    • Fixed null error when Billing Account ID is empty (#473).
    • Added missing commitment discount refunds to the actual cost data (#447).

Cost Management connector report v0.2

  • Added
    • Added new report to support the Cost Management connector.

FinOps workbooks v0.2

Optimization workbook v0.2

  • Added
    • Storage: Identify Idle Backups: Review protected items' backup activity to spot items not backed up in the last 90 days.
    • Storage: Review Replication Settings: Evaluate and improve your backup strategy by identifying resources with default geo-redundant storage (GRS) replication.
    • Networking: Azure Firewall Premium Features: Identify Azure Firewalls with Premium SKU and ensure associated policies use premium-only features.
    • Networking: Firewall Optimization: Streamline Azure Firewall usage by centralizing instances in the hub virtual network or Virtual WAN secure hub.
  • Changed
    • Top 10 services: Improved Monitoring tabs: Enhance your monitoring experience with updated Azure Advisor recommendations for Log Analytics.
  • Fixed
    • Azure Hybrid Benefit: Fixed support for Windows 10/Windows 11.

PowerShell module v0.2

  • Added
  • Changed
    • Updated the default API version for export commands to 2023-07-01-preview to use new datasets and features.
      • Specify 2023-08-01 explicitly for the previous API version.
  • Fixed
  • Deprecated
    • ConvertTo-FinOpsSchema and Invoke-FinOpsSchemaTransform are no longer being maintained and will be removed in a future update.
      • With native support for FOCUS 1.0 preview in Cost Management, we're deprecating both commands, which only support FOCUS 0.5.
      • If you would like to see the PowerShell commands updated to 1.0 preview, let us know in discussions or via a GitHub issue.

Open data v0.2

  • Added

FinOps guide v0.2

Download v0.2   Full changelog


v0.1.1

Released October 26, 2023

PowerShell module v0.1.1

  • Added
    • New PowerShell commands to convert data to FOCUS 0.5:
      • ConvertTo-FinOpsSchema
      • Invoke-FinOpsSchemaTransform
    • New PowerShell commands to get and delete Cost Management exports:

Open data v0.1.1

FinOps hubs v0.1.1

Download v0.1.1   Full changelog


v0.1

Released October 22, 2023

PowerShell module v0.1

FinOps hubs v0.1

  • Added
    • Deploy-FinOpsHub to deploy or update a hub instance.
    • Get-FinOpsHub to get details about a hub instance.
    • Support for Microsoft Customer Agreement (MCA) accounts and Cloud Solution Provider (CSP) subscriptions in Power BI reports.
  • Fixed
    • Storage redundancy dropdown default not set correctly in the creation form.
    • Tags specified in the creation form were causing the deployment to fail (#331).

Power BI reports v0.1

FinOps workbooks v0.1

Open data v0.1

  • Added
    • Pricing units to map all pricing units (UnitOfMeasure values) to distinct units with a scaling factor.
    • Regions to map historical resource location values in Microsoft Cost Management to standard Azure regions.
    • Services to map all resource types to FOCUS service names and categories.

Download v0.1   Full changelog


v0.0.1

Released May 27, 2023

FinOps hubs v0.0.1

Bicep Registry modules v0.0.1

FinOps workbooks v0.0.1

Download v0.0.1   Full changelog


Related content

Related products:

Related solutions: