DataStreamReader Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
DataStreamReader provides functionality to load a streaming DataFrame from external storage systems (e.g. file systems, key-value stores, etc).
public sealed class DataStreamReadertype DataStreamReader = classPublic NotInheritable Class DataStreamReader- Inheritance
-
DataStreamReader
Methods
| Csv(String) |
Loads a CSV file stream and returns the result as a DataFrame. |
| Format(String) |
Specifies the input data source format. |
| Json(String) |
Loads a JSON file stream and returns the results as a DataFrame. |
| Load() |
Loads input data stream in as a DataFrame, for data streams that don't require a path (e.g.external key-value stores). |
| Load(String) |
Loads input in as a DataFrame, for data streams that read from some path. |
| Option(String, Boolean) |
Adds an input option for the underlying data source. |
| Option(String, Double) |
Adds an input option for the underlying data source. |
| Option(String, Int64) |
Adds an input option for the underlying data source. |
| Option(String, String) |
Adds an input option for the underlying data source. |
| Options(Dictionary<String,String>) |
Adds input options for the underlying data source. |
| Orc(String) |
Loads a ORC file stream and returns the result as a DataFrame. |
| Parquet(String) |
Loads a Parquet file stream and returns the result as a DataFrame. |
| Schema(String) |
Specifies the schema by using the given DDL-formatted string. |
| Schema(StructType) |
Specifies the schema by using StructType. |
| Text(String) |
Loads text files and returns a DataFrame whose schema starts with a string column named "value", and followed by partitioned columns if there are any. |