Azure Open Datasets
An Azure service that provides curated open data for machine learning workflows.
27 questions
1 answer
One of the answers was accepted by the question author.
finetuning using azure openai studio for 3000mb training file is showing 1 yr as estimation time for completion
Screenshot 2024-10-17 at 8.43.12 AM.png finetuning using azure openai studio for 3000mb training file is showing 1 yr as estimation time for completion. Its been 16 hours and still no checkpoint is created. The same dataset was used for fine-tuning…
asked 2024-10-17T05:19:38.0733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 82%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDG%3C/text%3E%3C/svg%3E)
Divyank Garg
20
Reputation points
edited a comment 2024-10-22T04:37:23.26+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 22%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESC%3C/text%3E%3C/svg%3E)
SriLakshmi C
505
Reputation points Microsoft Vendor
1 answer
Azure public data set
Are these data available in Azure public Dataset Performance Metrics Experimental data Resource Allocation Data , in regards to Azure cloud i so please provide me with the link
asked 2024-01-25T20:52:39.3266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 47%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBA%3C/text%3E%3C/svg%3E)
Baltazar Ayalew
5
Reputation points
edited the question 2024-09-17T18:55:22.56+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 76%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
VarunTha
9,270
Reputation points Microsoft Vendor
0 answers
How to access data in a data set from notebook
Hi I'm trying to get image with and height that is stored in a dataset with Image.open(image_path) as img: width, height = img.size The URI is something like…
asked 2024-08-28T13:19:36.4833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(316.8, 26%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EOK%3C/text%3E%3C/svg%3E)
Oren Koler
0
Reputation points
commented 2024-08-29T10:26:54.1366667+00:00
Oren Koler
0
Reputation points
1 answer
One of the answers was accepted by the question author.
How to make a registered pipeline can be executed when a model update on AzureML is triggered.
Hello, I am currently exploring how to update a model and how this update can trigger a registered pipeline to execute as a result of this model update. But I don't know how to implement, any idea for doing this?
asked 2024-05-30T01:57:06+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 33%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENN%3C/text%3E%3C/svg%3E)
Nguyễn Thanh Tú
170
Reputation points
accepted 2024-06-25T11:23:13.97+00:00
Nguyễn Thanh Tú
170
Reputation points
asked 2024-03-24T01:07:04.7566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 69%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAZ%3C/text%3E%3C/svg%3E)
Alan Zhang
0
Reputation points
commented 2024-03-26T07:14:24.87+00:00
romungi-MSFT
46,831
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
I am interested in a Geospacial Dataset - It can be static
I am not interested in making an app for public use. I am interested in the data itself for internal use on a project dedicated to understanding the different types of Convenience stores based on store attributes. I have Address and Lat/Long lookups for…
asked 2024-02-05T15:53:35.81+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 83%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECS%3C/text%3E%3C/svg%3E)
Capranica, Stephen (NAZ-V)
20
Reputation points
accepted 2024-02-05T17:16:56.22+00:00
Capranica, Stephen (NAZ-V)
20
Reputation points
0 answers
azure openai api calling issue
I am working with azure talking avatar. I have trained the azure openai with my own data. After giving all the credentials, I am trying to ask questions. I am getting the below…
asked 2024-01-05T13:46:07.8533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 54%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECT%3C/text%3E%3C/svg%3E)
Cloud Technicalhub
20
Reputation points
commented 2024-01-17T17:09:36.67+00:00
Pramod Valavala
20,636
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Dynamic relative URL for dataset in ADF
I am creating a pipeline for Rest API. At 1st task, I am getting a Bearer token (TOKEN CREATE), and next getting a "queryId"(SUBMIT JOB). Then I created a REST API dataset, and use my "queryID" from SUBMIT JOB activity so I can…
asked 2023-03-27T14:28:29.59+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 49%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Max Muhammad
20
Reputation points
commented 2023-11-15T12:40:57.08+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 31%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBI%3C/text%3E%3C/svg%3E)
Benjamin Isa
0
Reputation points
1 answer
Issue with Manually Specifying Data Types During Data Import in Azure
Hi, I'm facing a problem while trying to manually set data types during data import in Azure MLops(Submit an Automated ML job). Specifically, in the step(Task type & data) I'm working with CSV files and attempting to prevent certain columns(0,1) from…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 87%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 11%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERM%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Underwriter assess and score risks from insurance contract documents using Azure Open AI
I work for insurance client request where to use upload contract documents in the Azure BLOB Storage and extraction is done through Azure Document Intelligence for pre processing tasks. My task is to summarize the contract documents. How to summarize the…
asked 2023-09-21T06:07:22.17+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 60%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJS%3C/text%3E%3C/svg%3E)
Janarthanan S
700
Reputation points
accepted 2023-09-22T07:23:13.4166667+00:00
Janarthanan S
700
Reputation points
2 answers
One of the answers was accepted by the question author.
Using Azure OpenAI to retrieve SQL data
Is it preferred to provide the full schema (lets say into a .sql file) to GPT model? or instead give it instructions to search for it directly in the database which is quick to produce better results.
asked 2023-09-13T13:35:16.8166667+00:00
Janarthanan S
700
Reputation points
answered 2023-09-14T02:25:25.6066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 80%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
DieTine
0
Reputation points
1 answer
Cannot connect to dataset in ADF data flow
I am tring to set a data flow in ADF. The input sink from a dataset, there is a parameter in the dataset, it is defining the filename. When I do not use parameter to test connection, it is success. But if I set a parameter, it failed and throw below…
asked 2021-04-25T13:27:37.963+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 51%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJX%3C/text%3E%3C/svg%3E)
Junjian Xia (PACTERA TECHNOLOGIES INC)
22
Reputation points Microsoft Vendor
commented 2023-07-19T09:49:55.32+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 5%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYP%3C/text%3E%3C/svg%3E)
Yogesh Prasad
0
Reputation points
0 answers
Azure Cognitive services - Spatial analysis. Can we have data set for spatial analysis of people shopping in the shop?
Azure Cognitive services - Spatial analysis. Can we have data set for spatial analysis of people shopping in the shop? Need data for multiple person shopping in different sections of shop with time-stamp spent in different section of shop . For eg - A…
asked 2023-05-18T15:43:51.1266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 17%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPA%3C/text%3E%3C/svg%3E)
Pelapkar, Amruta (Cognizant)
0
Reputation points
commented 2023-07-06T19:59:34.3566667+00:00
Azar
22,870
Reputation points MVP
0 answers
Microsoft Learn Explore regression with Azure Machine Learning Designer - Inference Pipeline
I am following the Microsoft Learning lab https://microsoftlearning.github.io/AI-900-AIFundamentals/instructions/02a-create-regression-model.html and am getting an error I think the lab is several versions as Azure old and something is missing
asked 2023-05-11T00:35:47.1833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 23%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBA%3C/text%3E%3C/svg%3E)
brandon adleman
0
Reputation points
commented 2023-05-22T07:25:52.9366667+00:00
romungi-MSFT
46,831
Reputation points Microsoft Employee
1 answer
Outdated Data Catalog on Planetary Computer (ERA5)?
Hi, I am trying to access ERA5 dataset from Planetary Computer Data Catalog using Python. https://planetarycomputer.microsoft.com/dataset/era5-pds On the page, it says that the temporal extent for this dataset is 01/01/1979 – Present, but if I follow the…
Azure Open Datasets
Azure Open Datasets
An Azure service that provides curated open data for machine learning workflows.
27 questions
Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,028 questions
asked 2023-04-03T16:21:38.5333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 80%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIT%3C/text%3E%3C/svg%3E)
iury T Simoes-Sousa
0
Reputation points
edited an answer 2023-04-03T23:27:31.8333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 1%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYM%3C/text%3E%3C/svg%3E)
YutongTie-MSFT
52,866
Reputation points
1 answer
Not able to upload file /create dataset using Azure SDK.
Workspace, storage account and datastore is successfully created. code snippet - from azureml.core import Workspace, Datastore, Dataset ws = Workspace.from_config(path="./config") az_store = Datastore.get(ws,…
asked 2022-12-23T19:30:59.573+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 10%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Abhi
1
Reputation point
commented 2022-12-27T11:35:28.19+00:00
romungi-MSFT
46,831
Reputation points Microsoft Employee
2 answers
Can parameters from a pipeline to be used in the REST Relative URL?
Hi guys, I am new to Azure Data Factory, and recently our client provides a REST API with a signature as an access token. The signature is changing every 15 minutes and combined with key and value and it needed to be hashed to MD5, which I can do as a…
asked 2021-10-14T10:36:43.867+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 28.000000000000004%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKW%3C/text%3E%3C/svg%3E)
Klay Wang
1
Reputation point
answered 2022-12-08T08:08:03.957+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 71%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHS%3C/text%3E%3C/svg%3E)
Himanshu Singh (INFOSYS LIMITED)
1
Reputation point
1 answer
One of the answers was accepted by the question author.
How to mount the azure dataset in jupyter notebook ?
I have created dataset which points to two datastores. I have registered it as well. But when I mount the dataset, it is showing some error.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 84%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVJ%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Connect to azureopendatastorage from synapse pipeline
Is it possible to connect to the azureopendatastorage datasets from linked services in Synapse pipelines or ADF ? I keep on getting "This request is not authorized to perform this operation using this permission" for any connection option I try…
asked 2022-08-19T21:27:27.283+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 56.00000000000001%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVG%3C/text%3E%3C/svg%3E)
Varun Goel
21
Reputation points Microsoft Employee
accepted 2022-08-22T12:40:58.607+00:00
Varun Goel
21
Reputation points Microsoft Employee
1 answer
How can I connect to Azure open data besides python?
I am trying to connect to azureopendatastorage account. More precisely: container nyc_tlc_green From the python source I can see that the account key is just r"", but it doesn't work. Also Azure cli tells me: Storage account…
asked 2022-07-20T17:02:21.047+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 88%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EET%3C/text%3E%3C/svg%3E)
Eneli Toodu
1
Reputation point
answered 2022-07-25T06:58:10.417+00:00
romungi-MSFT
46,831
Reputation points Microsoft Employee