PandasDataLoadLimitToDay Class

Defines a pandas data load limit to the last day.

You can use PandasDataLoadLimitToDay to control how many parquets of days will be loaded.

Initialize pandas data load limit to the last day.

Inheritance
PandasDataLoadLimitToDay

Constructor

PandasDataLoadLimitToDay(start_date, end_date, path_pattern='/year=%d/month=%d/day=%d/', limit=-1)

Parameters

Name Description
start_date
Required

The start date you'd like to query inclusively.

end_date
Required

The end date you'd like to query inclusively.

path_pattern
str

A blob path pattern.

Default value: /year=%d/month=%d/day=%d/
limit
int

The limit of the max number of paths that can be returned.

Default value: -1

Methods

get_target_blob_paths

Get target blob paths based on its own filters.

get_target_blob_paths

Get target blob paths based on its own filters.

get_target_blob_paths(blob_service: BlobServiceClient, blob_container_name: str, blob_relative_path: str)

Parameters

Name Description
blob_service
Required

The block blob service.

blob_container_name
Required
str

The blob container name.

blob_relative_path
Required
str

The blob relative path.

Returns

Type Description

A list of target blob paths within filter range.