PandasDataLoadLimitToMonth Class

Defines a pandas data load limit to the last month.

You can use PandasDataLoadLimitToMonth to control how many parquets of months will be loaded.

Initialize pandas data load limit to the last month.

Inheritance
PandasDataLoadLimitToMonth

Constructor

PandasDataLoadLimitToMonth(start_date, end_date, path_pattern='/year=%d/month=%d/', limit=-1)

Parameters

Name Description
start_date
Required

The start date you'd like to query inclusively.

end_date
Required

The end date you'd like to query inclusively.

path_pattern
str

A blob path pattern.

Default value: /year=%d/month=%d/
limit
int

The limit of the max number of paths that can be returned.

Default value: -1

Methods

get_target_blob_paths

Get target blob paths based on its own filters.

get_target_blob_paths

Get target blob paths based on its own filters.

get_target_blob_paths(blob_service: BlobServiceClient, blob_container_name: str, blob_relative_path: str)

Parameters

Name Description
blob_service
Required

The block blob service.

blob_container_name
Required
str

The blob container name.

blob_relative_path
Required
str

The blob relative path.

Returns

Type Description

A list of target blob paths within filter range.