Databricks Runtime 6.4 (EoS)
注意
針對此 Databricks Runtime 版本的支援已結束。 如需了解終止支援日期,請參閱終止支援歷程記錄。 如需所有支援的 Databricks Runtime 版本,請參閱 Databricks Runtime 版本資訊版本和相容性 (機器翻譯)。
Databricks 於 2020 年 2 月發行此版本。
注意
Databricks Runtime 6.4 的支援已於 2021 年 4 月 1 日結束,因為其基礎 Ubuntu 操作系統支持終止。 Databricks 建議升級至 Databricks Runtime 7.x 或 8.x,以取得 Apache Spark 3.x 的優點,以及這些較新運行時間內建的許多新功能和改進功能。
您可以選擇移轉至 Databricks Runtime 6.4 擴充支援,這與 Databricks Runtime 6.4 相同,與操作系統版本、JDK 和少數 R 和 Python 連結庫相同。 請參閱 Databricks Runtime 6.4 擴充支援 (EoS) 。
下列版本資訊提供由 Apache Spark 提供之 Databricks Runtime 6.4 的相關信息。
新功能
使用自動載入器以累加方式處理新的資料檔 (公開預覽)
自動載入器可讓您在 ETL 期間抵達雲端 Blob 存放區時,以更有效率的方式以累加方式處理新的資料檔。 這是檔案型結構化串流的改善,可重複列出雲端目錄並追蹤已看見的檔案,而且在目錄成長時可能非常沒有效率。 自動載入器也比以檔案通知為基礎的結構化串流更方便且有效,這需要您在雲端手動設定檔案通知服務,而且不會讓您回填現有的檔案。 如需詳細資訊,請參閱 什麼是自動載入器?。
使用等冪重試將資料載入 Delta Lake (公開預覽)
COPY INTO
SQL 命令可讓您使用等冪重試將數據載入 Delta Lake。 若要將數據載入 Delta Lake,您必須使用 Apache Spark DataFrame API。 如果在載入期間發生失敗,您必須有效地處理它們。 新的 COPY INTO
命令提供熟悉的宣告式介面,供 SQL 使用者載入數據。 此命令會追蹤先前載入的檔案,並在發生失敗時安全地重新執行。
Delta 資料表上所有寫入、更新和刪除的作業計量現在會顯示在數據表歷程記錄中
您現在可以查看資料表歷程記錄中 Delta 資料表上所有寫入、更新和刪除的作業計量(例如,檔案和數據列數目已變更)。 預設會停用這些計量的產生。 若要啟用計量產生,請將 Spark 組態spark.databricks.delta.history.metricsEnabled
設定為 true
。
Azure Databricks 筆記本中預設會啟用內嵌 Matplotlib 數位 (公開預覽)
現在預設會啟用顯示 Matplotlib 圖形,而不需要將圖形傳遞至 display
方法。 如需詳細資訊,請參閱 Matplotlib。
改善
已修正 Parquet StartsWith
篩選錯誤
NullPointerException
已修正下推篩選StartWith
至 Parquet 所造成的 。 當 Parquet 檔案中的數據行大小寫與外部數據表中定義的數據行大小寫不同時,就會發生此問題。
Apache Spark
Databricks Runtime 6.4 包含 Apache Spark 2.4.5。 此版本包含 Databricks Runtime 6.3 (EoS) 中包含的所有 Spark 修正和改善,以及下列對 Spark 所做的其他錯誤修正和改進:
- [SPARK-30657][SPARK-30658][SS]已修正串流限制 [6.x] 中的兩個 Bug
- [SPARK-30433][SQL]優化收集衝突計劃
- [SPARK-30633][SQL]當類型為 LongType 時,將 L 附加至種子
- [SPARK-29777][[SPARKR] 移除不再有效的遞歸呼叫測試
- [SPARK-30645][[SPARKR] 將 Unicode 測試數據移至外部檔案
- [SPARK-30630][ML] 在 2.4.5 中取代 GBT 中的 numTrees
- [SPARK-30082][SQL]建置取代查詢時,相依於 Scala 類型強制
- [SPARK-30556][SQL]將sparkContext.localproperties 複製到SubqueryExec.executionContext中的子線程
- [SPARK-30433][SQL]在 ResolveReferences 中讓衝突屬性解析更具延展性
- [SPARK-29708][SQL]當群組集重複時,更正匯總值
- [SPARK-29450][SS]使用附加模式測量串流匯總的輸出數據列數目
- [SPARK-30312][SQL]新增來重新命名 conf
.enabled
- [SPARK-30325][CORE] markPartitionCompleted 導致工作狀態不一致
- [SPARK-30246][CORE]OneForOneStreamManager 可能會在 connectionTerminated 中流失記憶體
- [SPARK-28152][SQL] 新增舊版 MsSqlServerDialect 數值對應的舊版組態
- [SPARK-30458][WEBUI]修正錯誤執行程式在階段頁面的時間行中計算時間
- [SPARK-30312][SQL]截斷數據表時保留路徑許可權和 acl
- [SPARK-30447][SQL] 常數傳播可 NULL 性的問題
- [SPARK-30410][SQL]計算具有大量數據分割的數據表大小會造成洪水記錄
- [SPARK-30225][CORE]在 NioBufferedFileInputStream 中更正 EOF 的 read() 行為
- [SPARK-30285][CORE]修正 LiveListenerBus#stop 與 AsyncEventQueue#removeListenerOnError 之間的死結
- [SPARK-26560][SQL]不論目前的線程內容類別載入器為何,Spark 都應該能夠使用 jar 執行 Hive UDF
- [SPARK-30339][SQL]避免在函式查閱中失敗兩次
- [SPARK-30269][SQL]應該使用舊的分割區統計數據來決定是否在分析數據分割時更新統計數據
- [SPARK-30318][CORE]將 jetty 升級至 9.3.27.v20190418
- [SPARK-17398][SQL]修正查詢分割 JSON 數據表時的 ClassCastException
維護更新
請參閱 Databricks Runtime 6.4 維護更新。
系統環境
- 操作系統:Ubuntu 16.04.6 LTS
- Java:1.8.0_252
- Scala:2.11.12
- Python:3.7.3
- R:R 3.6.2 版 (2019-12-12)
- Delta Lake:0.5.0
注意
雖然 Scala 2.12 是以 Apache Spark 2.4 中的實驗功能的形式提供,但 Databricks Runtime 6.4 不支援此功能。
本節內容:
已安裝的 Python 程式庫
程式庫 | 版本 | 程式庫 | 版本 | 程式庫 | 版本 |
---|---|---|---|---|---|
asn1crypto | 0.24.0 | backcall | 0.1.0 | boto | 2.49.0 |
boto3 | 1.9.162 | botocore | 1.12.163 | certifi | 2019.3.9 |
cffi | 1.12.2 | chardet | 3.0.4 | 密碼編譯 | 2.6.1 |
cycler | 0.10.0 | Cython | 0.29.6 | decorator | 4.4.0 |
docutils | 0.14 | idna | 2.8 | ipykernel | 5.1.0 |
ipython | 7.4.0 | ipython-genutils | 0.2.0 | jedi | 0.13.3 |
jmespath | 0.9.4 | jupyter-client | 5.2.4 | jupyter-core | 4.4.0 |
kiwisolver | 1.1.0 | matplotlib | 3.0.3 | numpy | 1.16.2 |
pandas | 0.24.2 | parso | 0.3.4 | patsy | 0.5.1 |
pexpect | 4.6.0 | pickleshare | 0.7.5 | pip | 19.0.3 |
prompt-toolkit | 2.0.9 | psycopg2 | 2.7.6.1 | ptyprocess | 0.6.0 |
pyarrow | 0.13.0 | pycparser | 2.19 | pycurl | 7.43.0 |
Pygments | 2.3.1 | PyGObject | 3.20.0 | pyOpenSSL | 19.0.0 |
pyparsing | 2.4.6 | PySocks | 1.6.8 | python-apt | 1.1.0.b1+ubuntu0.16.04.8 |
python-dateutil | 2.8.0 | pytz | 2018.9 | pyzmq | 18.0.0 |
requests | 2.21.0 | s3transfer | 0.2.1 | scikit-learn | 0.20.3 |
scipy | 1.2.1 | seaborn | 0.9.0 | setuptools | 40.8.0 |
六次 | 1.12.0 | ssh-import-id | 5.5 | statsmodels | 0.9.0 |
tornado | 6.0.2 | traitlets | 4.3.2 | unattended-upgrades | 0.1 |
urllib3 | 1.24.1 | virtualenv | 16.4.1 | wcwidth | 0.1.7 |
wheel | 0.33.1 |
已安裝的 R 程式庫
程式庫 | 版本 | 程式庫 | 版本 | 程式庫 | 版本 |
---|---|---|---|---|---|
abind | 1.4-5 | askpass | 1.1 | assertthat | 0.2.1 |
backports | 1.1.5 | base | 3.6.2 | base64enc | 0.1-3 |
BH | 1.69.0-1 | bit | 1.1-14 | bit64 | 0.9-7 |
bitops | 1.0-6 | blob | 1.2.0 | boot | 1.3-23 |
brew | 1.0-6 | callr | 3.3.2 | 汽車 | 3.0-4 |
carData | 3.0-2 | caret | 6.0-84 | cellranger | 1.1.0 |
chron | 2.3-54 | class | 7.3-15 | cli | 1.1.0 |
clipr | 0.7.0 | clisymbols | 1.2.0 | 叢集 | 2.1.0 |
codetools | 0.2-16 | colorspace | 1.4-1 | commonmark | 1.7 |
compiler | 3.6.2 | config | 0.3 | covr | 3.3.2 |
crayon | 1.3.4 | crosstalk | 1.0.0 | curl | 4.2 |
data.table | 1.12.6 | datasets | 3.6.2 | DBI | 1.0.0 |
dbplyr | 1.4.2 | 遞減 | 1.2.0 | devtools | 2.2.1 |
digest | 0.6.22 | doMC | 1.3.6 | dplyr | 0.8.3 |
DT | 0.9 | 省略符號 | 0.3.0 | evaluate | 0.14 |
fansi | 0.4.0 | fastmap | 1.0.1 | forcats | 0.4.0 |
foreach | 1.4.7 | foreign | 0.8-75 | forge | 0.2.0 |
fs | 1.3.1 | gbm | 2.1.5 | 泛型 | 0.0.2 |
ggplot2 | 3.2.1 | gh | 1.0.1 | git2r | 0.26.1 |
glmnet | 2.0-18 | glue | 1.3.1 | gower | 0.2.1 |
graphics | 3.6.2 | grDevices | 3.6.2 | grid | 3.6.2 |
gridExtra | 2.3 | gsubfn | 0.7 | gtable | 0.3.0 |
h2o | 3.26.0.2 | haven | 2.1.1 | hms | 0.5.1 |
htmltools | 0.4.0 | htmlwidgets | 1.5.1 | httpuv | 1.5.2 |
httr | 1.4.1 | hwriter | 1.3.2 | hwriterPlus | 1.0-3 |
ini | 0.3.1 | ipred | 0.9-9 | iterators | 1.0.12 |
jsonlite | 1.6 | KernSmooth | 2.23-16 | labeling | 0.3 |
later | 1.0.0 | lattice | 0.20-38 | Lava | 1.6.6 |
lazyeval | 0.2.2 | 生命週期 | 0.1.0 | littler | 0.3.9 |
lme4 | 1.1-21 | lubridate | 1.7.4 | magrittr | 1.5 |
mapproj | 1.2.6 | maps | 3.3.0 | maptools | 0.9-8 |
MASS | 7.3-51.5 | 矩陣 | 1.2-18 | MatrixModels | 0.4-1 |
memoise | 1.1.0 | 方法 | 3.6.2 | mgcv | 1.8-31 |
mime | 0.7 | minqa | 1.2.4 | ModelMetrics | 1.2.2 |
munsell | 0.5.0 | mvtnorm | 1.0-11 | nlme | 3.1-144 |
nloptr | 1.2.1 | nnet | 7.3-12 | numDeriv | 2016.8-1.1 |
openssl | 1.4.1 | openxlsx | 4.1.2 | parallel | 3.6.2 |
pbkrtest | 0.4-7 | pillar | 1.4.2 | pkgbuild | 1.0.6 |
pkgconfig | 2.0.3 | pkgKitten | 0.1.5 | pkgload | 1.0.2 |
plogr | 0.2.0 | plyr | 1.8.4 | praise | 1.0.0 |
prettyunits | 1.0.2 | pROC | 1.15.3 | processx | 3.4.1 |
prodlim | 2018.04.18 | 進度 | 1.2.2 | promises | 1.1.0 |
proto | 1.0.0 | ps | 1.3.0 | purrr | 0.3.3 |
quantreg | 5.51 | R.methodsS3 | 1.7.1 | R.oo | 1.22.0 |
R.utils | 2.9.0 | r2d3 | 0.2.3 | R6 | 2.4.0 |
randomForest | 4.6-14 | rappdirs | 0.3.1 | rcmdcheck | 1.3.3 |
RColorBrewer | 1.1-2 | Rcpp | 1.0.2 | RcppEigen | 0.3.3.5.0 |
RCurl | 1.95-4.12 | readr | 1.3.1 | readxl | 1.3.1 |
recipes | 0.1.7 | rematch | 1.0.1 | remotes | 2.1.0 |
reshape2 | 1.4.3 | rex | 1.1.2 | 力拓 | 0.5.16 |
rlang | 0.4.1 | RODBC | 1.3-16 | roxygen2 | 6.1.1 |
rpart | 4.1-15 | rprojroot | 1.3-2 | Rserve | 1.8-6 |
RSQLite | 2.1.2 | rstudioapi | 0.10 | rversions | 2.0.0 |
scales | 1.0.0 | sessioninfo | 1.1.1 | shiny | 1.4.0 |
sourcetools | 0.1.7 | sp | 1.3-1 | sparklyr | 1.0.4 |
SparkR | 2.4.5 | SparseM | 1.77 | spatial | 7.3-11 |
splines | 3.6.2 | sqldf | 0.4-11 | SQUAREM | 2017.10-1 |
statmod | 1.4.32 | stats | 3.6.2 | stats4 | 3.6.2 |
stringi | 1.4.3 | stringr | 1.4.0 | survival | 2.44-1.1 |
sys | 3.3 | tcltk | 3.6.2 | TeachingDemos | 2.10 |
testthat | 2.2.1 | tibble | 2.1.3 | tidyr | 1.0.0 |
tidyselect | 0.2.5 | timeDate | 3043.102 | tools | 3.6.2 |
usethis | 1.5.1 | utf8 | 1.1.4 | utils | 3.6.2 |
vctrs | 0.2.0 | viridisLite | 0.3.0 | whisker | 0.4 |
withr | 2.1.2 | xml2 | 1.2.2 | xopen | 1.0.0 |
xtable | 1.8-4 | yaml | 2.2.0 | zeallot | 0.1.0 |
zip | 2.0.4 |
已安裝的 Java 和 Scala 連結庫 (Scala 2.11 叢集版本)
群組識別碼 | 成品識別碼 | 版本 |
---|---|---|
ANTLR | ANTLR | 2.7.7 |
com.amazonaws | amazon-kinesis-client | 1.8.10 |
com.amazonaws | aws-java-sdk-autoscaling | 1.11.595 |
com.amazonaws | aws-java-sdk-cloudformation | 1.11.595 |
com.amazonaws | aws-java-sdk-cloudfront | 1.11.595 |
com.amazonaws | aws-java-sdk-cloudhsm | 1.11.595 |
com.amazonaws | aws-java-sdk-cloudsearch | 1.11.595 |
com.amazonaws | aws-java-sdk-cloudtrail | 1.11.595 |
com.amazonaws | aws-java-sdk-cloudwatch | 1.11.595 |
com.amazonaws | aws-java-sdk-cloudwatchmetrics | 1.11.595 |
com.amazonaws | aws-java-sdk-codedeploy | 1.11.595 |
com.amazonaws | aws-java-sdk-cognitoidentity | 1.11.595 |
com.amazonaws | aws-java-sdk-cognitosync | 1.11.595 |
com.amazonaws | aws-java-sdk-config | 1.11.595 |
com.amazonaws | aws-java-sdk-core | 1.11.595 |
com.amazonaws | aws-java-sdk-datapipeline | 1.11.595 |
com.amazonaws | aws-java-sdk-directconnect | 1.11.595 |
com.amazonaws | aws-java-sdk-directory | 1.11.595 |
com.amazonaws | aws-java-sdk-dynamodb | 1.11.595 |
com.amazonaws | aws-java-sdk-ec2 | 1.11.595 |
com.amazonaws | aws-java-sdk-ecs | 1.11.595 |
com.amazonaws | aws-java-sdk-efs | 1.11.595 |
com.amazonaws | aws-java-sdk-elasticache | 1.11.595 |
com.amazonaws | aws-java-sdk-elasticbeanstalk | 1.11.595 |
com.amazonaws | aws-java-sdk-elasticloadbalancing | 1.11.595 |
com.amazonaws | aws-java-sdk-elastictranscoder | 1.11.595 |
com.amazonaws | aws-java-sdk-emr | 1.11.595 |
com.amazonaws | aws-java-sdk-glacier | 1.11.595 |
com.amazonaws | aws-java-sdk-glue | 1.11.595 |
com.amazonaws | aws-java-sdk-iam | 1.11.595 |
com.amazonaws | aws-java-sdk-importexport | 1.11.595 |
com.amazonaws | aws-java-sdk-kinesis | 1.11.595 |
com.amazonaws | aws-java-sdk-kms | 1.11.595 |
com.amazonaws | aws-java-sdk-lambda | 1.11.595 |
com.amazonaws | aws-java-sdk-logs | 1.11.595 |
com.amazonaws | aws-java-sdk-machinelearning | 1.11.595 |
com.amazonaws | aws-java-sdk-opsworks | 1.11.595 |
com.amazonaws | aws-java-sdk-rds | 1.11.595 |
com.amazonaws | aws-java-sdk-redshift | 1.11.595 |
com.amazonaws | aws-java-sdk-route53 | 1.11.595 |
com.amazonaws | aws-java-sdk-s3 | 1.11.595 |
com.amazonaws | aws-java-sdk-ses | 1.11.595 |
com.amazonaws | aws-java-sdk-simpledb | 1.11.595 |
com.amazonaws | aws-java-sdk-simpleworkflow | 1.11.595 |
com.amazonaws | aws-java-sdk-sns | 1.11.595 |
com.amazonaws | aws-java-sdk-sqs | 1.11.595 |
com.amazonaws | aws-java-sdk-ssm | 1.11.595 |
com.amazonaws | aws-java-sdk-storagegateway | 1.11.595 |
com.amazonaws | aws-java-sdk-sts | 1.11.595 |
com.amazonaws | aws-java-sdk-support | 1.11.595 |
com.amazonaws | aws-java-sdk-js-libraries | 1.11.22 |
com.amazonaws | aws-java-sdk-workspaces | 1.11.595 |
com.amazonaws | jmespath-java | 1.11.595 |
com.carrotsearch | hppc | 0.7.2 |
com.chuusai | shapeless_2.11 | 2.3.2 |
com.clearspring.analytics | stream | 2.7.0 |
com.databricks | Rserve | 1.8-3 |
com.databricks | dbml-local_2.11 | 0.5.0-db8-spark2.4 |
com.databricks | dbml-local_2.11-tests | 0.5.0-db8-spark2.4 |
com.databricks | jets3t | 0.7.1-0 |
com.databricks.scalapb | compilerplugin_2.11 | 0.4.15-9 |
com.databricks.scalapb | scalapb-runtime_2.11 | 0.4.15-9 |
com.esotericsoftware | kryo-shaded | 4.0.2 |
com.esotericsoftware | minlog | 1.3.0 |
com.fasterxml | classmate | 1.0.0 |
com.fasterxml.jackson.core | jackson-annotations | 2.6.7 |
com.fasterxml.jackson.core | jackson-core | 2.6.7 |
com.fasterxml.jackson.core | jackson-databind | 2.6.7.1 |
com.fasterxml.jackson.dataformat | jackson-dataformat-cbor | 2.6.7 |
com.fasterxml.jackson.datatype | jackson-datatype-joda | 2.6.7 |
com.fasterxml.jackson.module | jackson-module-paranamer | 2.6.7 |
com.fasterxml.jackson.module | jackson-module-scala_2.11 | 2.6.7.1 |
com.github.fommil | jniloader | 1.1 |
com.github.fommil.netlib | 核心 | 1.1.2 |
com.github.fommil.netlib | native_ref-java | 1.1 |
com.github.fommil.netlib | native_ref-java-natives | 1.1 |
com.github.fommil.netlib | native_system java | 1.1 |
com.github.fommil.netlib | native_system-java-natives | 1.1 |
com.github.fommil.netlib | netlib-native_ref-linux-x86_64-natives | 1.1 |
com.github.fommil.netlib | netlib-native_system-linux-x86_64-natives | 1.1 |
com.github.luben | zstd-jni | 1.3.2-2 |
com.github.rwl | jtransforms | 2.4.0 |
com.google.code.findbugs | jsr305 | 2.0.1 |
com.google.code.gson | gson | 2.2.4 |
com.google.guava | guava | 15.0 |
com.google.protobuf | protobuf-java | 2.6.1 |
com.googlecode.javaewah | JavaEWAH | 0.3.2 |
com.h2database | h2 | 1.3.174 |
com.jcraft | jsch | 0.1.50 |
com.jolbox | bonecp | 0.8.0.版 |
com.microsoft.azure | azure-data-lake-store-sdk | 2.2.8 |
com.microsoft.azure | azure-storage | 7.0.0 |
com.microsoft.sqlserver | mssql-jdbc | 6.2.2.jre8 |
com.ning | compress-lzf | 1.0.3 |
com.sun.mail | javax.mail | 1.5.2 |
com.thoughtworks.paranamer | paranamer | 2.8 |
com.trueaccord.lenses | lenses_2.11 | 0.3 |
com.twitter | chill-java | 0.9.3 |
com.twitter | chill_2.11 | 0.9.3 |
com.twitter | parquet-hadoop-bundle | 1.6.0 |
com.twitter | util-app_2.11 | 6.23.0 |
com.twitter | util-core_2.11 | 6.23.0 |
com.twitter | util-jvm_2.11 | 6.23.0 |
com.typesafe | config | 1.2.1 |
com.typesafe.scala-logging | scala-logging-api_2.11 | 2.1.2 |
com.typesafe.scala-logging | scala-logging-slf4j_2.11 | 2.1.2 |
com.univocity | univocity-parsers | 2.7.3 |
com.vlkan | flatbuffers | 1.2.0-3f79e055 |
com.zaxxer | HikariCP | 3.1.0 |
commons-beanutils | commons-beanutils | 1.9.4 |
commons-cli | commons-cli | 1.2 |
commons-codec | commons-codec | 1.10 |
commons-collections | commons-collections | 3.2.2 |
commons-configuration | commons-configuration | 1.6 |
commons-dbcp | commons-dbcp | 1.4 |
commons-digester | commons-digester | 1.8 |
commons-httpclient | commons-httpclient | 3.1 |
commons-io | commons-io | 2.4 |
commons-lang | commons-lang | 2.6 |
commons-logging | commons-logging | 1.1.3 |
commons-net | commons-net | 3.1 |
commons-pool | commons-pool | 1.5.4 |
info.ganglia.gmetric4j | gmetric4j | 1.0.7 |
io.airlift | aircompressor | 0.10 |
io.dropwizard.metrics | metrics-core | 3.1.5 |
io.dropwizard.metrics | metrics-ganglia | 3.1.5 |
io.dropwizard.metrics | metrics-graphite | 3.1.5 |
io.dropwizard.metrics | metrics-healthchecks | 3.1.5 |
io.dropwizard.metrics | metrics-jetty9 | 3.1.5 |
io.dropwizard.metrics | metrics-json | 3.1.5 |
io.dropwizard.metrics | metrics-jvm | 3.1.5 |
io.dropwizard.metrics | metrics-log4j | 3.1.5 |
io.dropwizard.metrics | metrics-servlet | 3.1.5 |
io.netty | netty | 3.9.9.Final |
io.netty | netty-all | 4.1.42.Final |
javax.activation | 啟用 | 1.1.1 |
javax.annotation | javax.annotation-api | 1.2 |
javax.el | javax.el-api | 2.2.4 |
javax.jdo | jdo-api | 3.0.1 |
javax.servlet | javax.servlet-api | 3.1.0 |
javax.servlet.jsp | jsp-api | 2.1 |
javax.transaction | jta | 1.1 |
javax.validation | validation-api | 1.1.0.Final |
javax.ws.rs | javax.ws.rs-api | 2.0.1 |
javax.xml.bind | jaxb-api | 2.2.2 |
javax.xml.stream | stax-api | 1.0-2 |
javolution | javolution | 5.5.1 |
jline | jline | 2.14.6 |
joda-time | joda-time | 2.9.3 |
junit | junit | 4.12 |
log4j | apache-log4j-extras | 1.2.17 |
log4j | log4j | 1.2.17 |
net.hydromatic | eigenbase-properties | 1.1.5 |
net.razorvine | pyolite | 4.13 |
net.sf.jpam | jpam | 1.1 |
net.sf.opencsv | opencsv | 2.3 |
net.sf.supercsv | super-csv | 2.2.0 |
net.snowflake | snowflake-ingest-sdk | 0.9.6 |
net.snowflake | snowflake-jdbc | 3.12.0 |
net.snowflake | spark-snowflake_2.11 | 2.5.9-spark_2.4 |
net.sourceforge.f2j | arpack_combined_all | 0.1 |
org.acplt | oncrpc | 1.0.7 |
org.antlr | ST4 | 4.0.4 |
org.antlr | antlr-runtime | 3.4 |
org.antlr | antlr4-runtime | 4.7 |
org.antlr | stringtemplate | 3.2.1 |
org.apache.ant | ant | 1.9.2 |
org.apache.ant | ant-jsch | 1.9.2 |
org.apache.ant | ant-launcher | 1.9.2 |
org.apache.arrow | arrow-format | 0.10.0 |
org.apache.arrow | arrow-memory | 0.10.0 |
org.apache.arrow | arrow-vector | 0.10.0 |
org.apache.avro | Avro | 1.8.2 |
org.apache.avro | avro-ipc | 1.8.2 |
org.apache.avro | avro-mapred-hadoop2 | 1.8.2 |
org.apache.calcite | calcite-avatica | 1.2.0-incubating |
org.apache.calcite | calcite-core | 1.2.0-incubating |
org.apache.calcite | calcite-linq4j | 1.2.0-incubating |
org.apache.commons | commons-compress | 1.8.1 |
org.apache.commons | commons-crypto | 1.0.0 |
org.apache.commons | commons-lang3 | 3.5 |
org.apache.commons | commons-math3 | 3.4.1 |
org.apache.curator | curator-client | 2.7.1 |
org.apache.curator | curator-framework | 2.7.1 |
org.apache.curator | curator-recipes | 2.7.1 |
org.apache.derby | Derby | 10.12.1.1 |
org.apache.directory.api | api-asn1-api | 1.0.0-M20 |
org.apache.directory.api | api-util | 1.0.0-M20 |
org.apache.directory.server | apacheds-i18n | 2.0.0-M15 |
org.apache.directory.server | apacheds-kerberos-codec | 2.0.0-M15 |
org.apache.hadoop | hadoop-annotations | 2.7.3 |
org.apache.hadoop | hadoop-auth | 2.7.3 |
org.apache.hadoop | hadoop-client | 2.7.3 |
org.apache.hadoop | hadoop-common | 2.7.3 |
org.apache.hadoop | hadoop-hdfs | 2.7.3 |
org.apache.hadoop | hadoop-mapreduce-client-app | 2.7.3 |
org.apache.hadoop | hadoop-mapreduce-client-common | 2.7.3 |
org.apache.hadoop | hadoop-mapreduce-client-core | 2.7.3 |
org.apache.hadoop | hadoop-mapreduce-client-jobclient | 2.7.3 |
org.apache.hadoop | hadoop-mapreduce-client-shuffle | 2.7.3 |
org.apache.hadoop | hadoop-yarn-api | 2.7.3 |
org.apache.hadoop | hadoop-yarn-client | 2.7.3 |
org.apache.hadoop | hadoop-yarn-common | 2.7.3 |
org.apache.hadoop | hadoop-yarn-server-common | 2.7.3 |
org.apache.htrace | htrace-core | 3.1.0-incubating |
org.apache.httpcomponents | HttpClient | 4.5.6 |
org.apache.httpcomponents | httpcore | 4.4.10 |
org.apache.ivy | ivy | 2.4.0 |
org.apache.orc | orc-core-nohive | 1.5.5 |
org.apache.orc | orc-mapreduce-nohive | 1.5.5 |
org.apache.orc | orc-shims | 1.5.5 |
org.apache.parquet | parquet-column | 1.10.1.2-databricks4 |
org.apache.parquet | parquet-common | 1.10.1.2-databricks4 |
org.apache.parquet | parquet-encoding | 1.10.1.2-databricks4 |
org.apache.parquet | parquet-format | 2.4.0 |
org.apache.parquet | parquet-hadoop | 1.10.1.2-databricks4 |
org.apache.parquet | parquet-jackson | 1.10.1.2-databricks4 |
org.apache.thrift | libfb303 | 0.9.3 |
org.apache.thrift | libthrift | 0.9.3 |
org.apache.xbean | xbean-asm6-shaded | 4.8 |
org.apache.zookeeper | ZooKeeper | 3.4.6 |
org.codehaus.jackson | jackson-core-asl | 1.9.13 |
org.codehaus.jackson | jackson-jaxrs | 1.9.13 |
org.codehaus.jackson | jackson-mapper-asl | 1.9.13 |
org.codehaus.jackson | jackson-xc | 1.9.13 |
org.codehaus.janino | commons-compiler | 3.0.10 |
org.codehaus.janino | janino | 3.0.10 |
org.datanucleus | datanucleus-api-jdo | 3.2.6 |
org.datanucleus | datanucleus-core | 3.2.10 |
org.datanucleus | datanucleus-rdbms | 3.2.9 |
org.eclipse.jetty | jetty-client | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-continuation | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-http | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-io | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-jndi | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-plus | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-proxy | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-security | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-server | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-servlet | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-servlets | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-util | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-webapp | 9.3.27.v20190418 |
org.eclipse.jetty | jetty-xml | 9.3.27.v20190418 |
org.fusesource.leveldbjni | leveldbjni-all | 1.8 |
org.glassfish.hk2 | hk2-api | 2.4.0-b34 |
org.glassfish.hk2 | hk2-locator | 2.4.0-b34 |
org.glassfish.hk2 | hk2-utils | 2.4.0-b34 |
org.glassfish.hk2 | osgi-resource-locator | 1.0.1 |
org.glassfish.hk2.external | aopalliance-repackaged | 2.4.0-b34 |
org.glassfish.hk2.external | javax.inject | 2.4.0-b34 |
org.glassfish.jersey.bundles.repackaged | 澤西-瓜瓦 | 2.22.2 |
org.glassfish.jersey.containers | jersey-container-servlet | 2.22.2 |
org.glassfish.jersey.containers | jersey-container-servlet-core | 2.22.2 |
org.glassfish.jersey.core | jersey-client | 2.22.2 |
org.glassfish.jersey.core | jersey-common | 2.22.2 |
org.glassfish.jersey.core | jersey-server | 2.22.2 |
org.glassfish.jersey.media | jersey-media-jaxb | 2.22.2 |
org.hamcrest | hamcrest-core | 1.3 |
org.hamcrest | hamcrest-library | 1.3 |
org.hibernate | hibernate-validator | 5.1.1.Final |
org.iq80.snappy | snappy | 0.2 |
org.javassist | javassist | 3.18.1-GA |
org.jboss.logging | jboss-logging | 3.1.3.GA |
org.jdbi | jdbi | 2.63.1 |
org.joda | joda-convert | 1.7 |
org.jodd | jodd-core | 3.5.2 |
org.json4s | json4s-ast_2.11 | 3.5.3 |
org.json4s | json4s-core_2.11 | 3.5.3 |
org.json4s | json4s-jackson_2.11 | 3.5.3 |
org.json4s | json4s-scalap_2.11 | 3.5.3 |
org.lz4 | lz4-java | 1.4.0 |
org.mariadb.jdbc | mariadb-java-client | 2.1.2 |
org.mockito | mockito-core | 1.10.19 |
org.objenesis | objenesis | 2.5.1 |
org.postgresql | postgresql | 42.1.4 |
org.roaringbitmap | RoaringBitmap | 0.7.45 |
org.roaringbitmap | 墊片 | 0.7.45 |
org.rocksdb | rocksdbjni | 6.2.2 |
org.rosuda.REngine | REngine | 2.1.0 |
org.scala-lang | scala-compiler_2.11 | 2.11.12 |
org.scala-lang | scala-library_2.11 | 2.11.12 |
org.scala-lang | scala-reflect_2.11 | 2.11.12 |
org.scala-lang.modules | scala-parser-combinators_2.11 | 1.1.0 |
org.scala-lang.modules | scala-xml_2.11 | 1.0.5 |
org.scala-sbt | test-interface | 1.0 |
org.scalacheck | scalacheck_2.11 | 1.12.5 |
org.scalactic | scalactic_2.11 | 3.0.3 |
org.scalanlp | breeze-macros_2.11 | 0.13.2 |
org.scalanlp | breeze_2.11 | 0.13.2 |
org.scalatest | scalatest_2.11 | 3.0.3 |
org.slf4j | jcl-over-slf4j | 1.7.16 |
org.slf4j | jul-to-slf4j | 1.7.16 |
org.slf4j | slf4j-api | 1.7.16 |
org.slf4j | slf4j-log4j12 | 1.7.16 |
org.spark-project.hive | hive-beeline | 1.2.1.spark2 |
org.spark-project.hive | hive-cli | 1.2.1.spark2 |
org.spark-project.hive | hive-jdbc | 1.2.1.spark2 |
org.spark-project.hive | hive-metastore | 1.2.1.spark2 |
org.spark-project.spark | 未使用的 | 1.0.0 |
org.spire-math | spire-macros_2.11 | 0.13.0 |
org.spire-math | spire_2.11 | 0.13.0 |
org.springframework | spring-core | 4.1.4.RELEASE |
org.springframework | spring-test | 4.1.4.RELEASE |
org.tukaani | xz | 1.5 |
org.typelevel | machinist_2.11 | 0.6.1 |
org.typelevel | macro-compat_2.11 | 1.1.1 |
org.xerial | sqlite-jdbc | 3.8.11.2 |
org.xerial.snappy | snappy-java | 1.1.7.3 |
org.yaml | snakeyaml | 1.16 |
oro | oro | 2.0.8 |
software.amazon.ion | ion-java | 1.0.2 |
stax | stax-api | 1.0.1 |
xmlenc | xmlenc | 0.52 |