PandasDataLoadLimitToDay Class
Defines a pandas data load limit to the last day.
You can use PandasDataLoadLimitToDay to control how many parquets of days will be loaded.
Initialize pandas data load limit to the last day.
- Inheritance
-
PandasDataLoadLimitToDay
Constructor
PandasDataLoadLimitToDay(start_date, end_date, path_pattern='/year=%d/month=%d/day=%d/', limit=-1)
Parameters
Name | Description |
---|---|
start_date
Required
|
The start date you'd like to query inclusively. |
end_date
Required
|
The end date you'd like to query inclusively. |
path_pattern
|
A blob path pattern. Default value: /year=%d/month=%d/day=%d/
|
limit
|
The limit of the max number of paths that can be returned. Default value: -1
|
Methods
get_target_blob_paths |
Get target blob paths based on its own filters. |
get_target_blob_paths
Get target blob paths based on its own filters.
get_target_blob_paths(blob_service: BlobServiceClient, blob_container_name: str, blob_relative_path: str)
Parameters
Name | Description |
---|---|
blob_service
Required
|
The block blob service. |
blob_container_name
Required
|
The blob container name. |
blob_relative_path
Required
|
The blob relative path. |
Returns
Type | Description |
---|---|
A list of target blob paths within filter range. |