Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Jul 25, 2018

• [SPARK-19018][SQL] Add support for custom encoding on csv writer

  Show description for 78e0a72
  

  crafty-coder

  authored and

  HyukjinKwon

  committed
  78e0a72

  Copy full SHA for 78e0a72

Commits on Jul 21, 2018

• [PYSPARK][TEST][MINOR] Fix UDFInitializationTests

  Show description for 96f3120
  

  PenguinToast

  authored and

  gatorsmile

  committed
  96f3120

  Copy full SHA for 96f3120

Commits on Jul 20, 2018

• [SPARK-23451][ML] Deprecate KMeans.computeCost

  Show description for cc4d64b
  

  mgaido91

  authored and

  holdenk

  committed
  cc4d64b

  Copy full SHA for cc4d64b

• [SPARK-24868][PYTHON] add sequence function in Python

  Show description for 0ab07b3
  

  huaxingao

  authored and

  HyukjinKwon

  committed
  0ab07b3

  Copy full SHA for 0ab07b3

Commits on Jul 15, 2018

• [SPARK-24807][CORE] Adding files/jars twice: output a warning and add a note

  Show description for 6999321
  

  MaxGekk

  authored and

  gatorsmile

  committed
  6999321

  Copy full SHA for 6999321

Commits on Jul 14, 2018

• [SPARK-24754][ML] Minhash integer overflow

  Show description for 8aceb96
  srowen

  committed
  8aceb96

  Copy full SHA for 8aceb96

Commits on Jul 12, 2018

• [SPARK-24208][SQL][FOLLOWUP] Move test cases to proper locations

  Show description for 1138489
  

  mgaido91

  authored and

  gatorsmile

  committed
  1138489

  Copy full SHA for 1138489

• [SPARK-23914][SQL] Add array_union function

  Show description for 301bff7
  

  kiszk

  authored and

  ueshin

  committed
  301bff7

  Copy full SHA for 301bff7

• [SPARK-24761][SQL] Adding of isModifiable() to RuntimeConfig

  Show description for 3ab48f9
  

  MaxGekk

  authored and

  gatorsmile

  committed
  3ab48f9

  Copy full SHA for 3ab48f9

Commits on Jul 11, 2018

• [SPARK-24208][SQL] Fix attribute deduplication for FlatMapGroupsInPandas

  Show description for ebf4bfb
  

  mgaido91

  authored and

  gatorsmile

  committed
  ebf4bfb

  Copy full SHA for ebf4bfb

• [SPARK-24530][PYTHON] Add a control to force Python version in Sphinx via environment variable, SPHINXPYTHON

  Show description for 1f94bf4
  HyukjinKwon

  committed
  1f94bf4

  Copy full SHA for 1f94bf4

Commits on Jul 9, 2018

• [SPARK-23936][SQL] Implement map_concat

  Show description for 034913b
  

  bersprockets

  authored and

  ueshin

  committed
  034913b

  Copy full SHA for 034913b

Commits on Jul 7, 2018

• [SPARK-24740][PYTHON][ML] Make PySpark's tests compatible with NumPy 1.14+

  Show description for 044b33b
  HyukjinKwon

  committed
  044b33b

  Copy full SHA for 044b33b

• [SPARK-24739][PYTHON] Make PySpark compatible with Python 3.7

  Show description for 74f6a92
  HyukjinKwon

  committed
  74f6a92

  Copy full SHA for 74f6a92

Commits on Jul 6, 2018

• [SPARK-24673][SQL][PYTHON][FOLLOWUP] Support Column arguments in timezone of from_utc_timestamp/to_utc_timestamp

  Show description for a381bce
  

  maropu

  authored and

  HyukjinKwon

  committed
  a381bce

  Copy full SHA for a381bce

Commits on Jul 5, 2018

• [SPARK-24698][PYTHON] Fixed typo in pyspark.ml's Identifiable class.

  Show description for f997be0
  

  mcteo

  authored and

  HyukjinKwon

  committed
  f997be0

  Copy full SHA for f997be0

Commits on Jul 4, 2018

• [SPARK-24709][SQL] schema_of_json() - schema inference from an example

  Show description for 776f299
  

  MaxGekk

  authored and

  HyukjinKwon

  committed
  776f299

  Copy full SHA for 776f299

Commits on Jul 2, 2018

• [SPARK-24665][PYSPARK] Use SQLConf in PySpark to manage all sql configs

  Show description for 8f91c69
  

  xuanyuanking

  authored and

  HyukjinKwon

  committed
  8f91c69

  Copy full SHA for 8f91c69

Commits on Jun 28, 2018

• [SPARK-24439][ML][PYTHON] Add distanceMeasure to BisectingKMeans in PySpark

  Show description for 2224861
  

  huaxingao

  authored and

  BryanCutler

  committed
  2224861

  Copy full SHA for 2224861

• [SPARK-23120][PYSPARK][ML] Add basic PMML export support to PySpark

  Show description for a95a4af
  holdenk

  committed
  a95a4af

  Copy full SHA for a95a4af

• [SPARK-14712][ML] LogisticRegressionModel.toString should summarize model

  Show description for 524827f
  

  jiayue-zhang

  authored and

  holdenk

  committed
  524827f

  Copy full SHA for 524827f

Commits on Jun 27, 2018

• [SPARK-24215][PYSPARK][FOLLOW UP] Implement eager evaluation for DataFrame APIs in PySpark

  Show description for 6a0b77a
  

  xuanyuanking

  authored and

  gatorsmile

  committed
  6a0b77a

  Copy full SHA for 6a0b77a

Commits on Jun 24, 2018

• [SPARK-24324][PYTHON] Pandas Grouped Map UDF should assign result columns by name

  Show description for a5849ad
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  a5849ad

  Copy full SHA for a5849ad

Commits on Jun 22, 2018

• [SPARK-23934][SQL] Adding map_from_entries function

  Show description for 92c2f00
  

  mn-mikke

  authored and

  ueshin

  committed
  92c2f00

  Copy full SHA for 92c2f00

Commits on Jun 21, 2018

• [SPARK-24614][PYSPARK] Fix for SyntaxWarning on tests.py

  Show description for c0cad59
  

  rekhajoshm

  authored and

  HyukjinKwon

  committed
  c0cad59

  Copy full SHA for c0cad59

• [SPARK-23912][SQL] add array_distinct

  Show description for 9de11d3
  

  huaxingao

  authored and

  ueshin

  committed
  9de11d3

  Copy full SHA for 9de11d3

Commits on Jun 19, 2018

• [SPARK-24565][SS] Add API for in Structured Streaming for exposing output rows of each microbatch as a DataFrame

  Show description for 2cb9763
  

  tdas

  authored and

  zsxwing

  committed
  2cb9763

  Copy full SHA for 2cb9763

Commits on Jun 18, 2018

• [SPARK-23772][SQL] Provide an option to ignore column of all null values or empty array during JSON schema inference

  Show description for e219e69
  

  maropu

  authored and

  HyukjinKwon

  committed
  e219e69

  Copy full SHA for e219e69

Commits on Jun 15, 2018

• [SPARK-24396][SS][PYSPARK] Add Structured Streaming ForeachWriter for python

  Show description for b5ccf0d
  tdas

  committed
  b5ccf0d

  Copy full SHA for b5ccf0d

• [PYTHON] Fix typo in serializer exception

  Show description for 6567fc4
  

  rberenguel

  authored and

  HyukjinKwon

  committed
  6567fc4

  Copy full SHA for 6567fc4

Commits on Jun 14, 2018

• [SPARK-24543][SQL] Support any type as DDL string for from_json's schema

  Show description for b8f27ae
  

  MaxGekk

  authored and

  cloud-fan

  committed
  b8f27ae

  Copy full SHA for b8f27ae

• [SPARK-24563][PYTHON] Catch TypeError when testing existence of HiveConf when creating pysp…

  Show description for d3eed8f
  

  icexelloss

  authored and

  Marcelo Vanzin

  committed
  d3eed8f

  Copy full SHA for d3eed8f

Commits on Jun 13, 2018

• [SPARK-22239][SQL][PYTHON] Enable grouped aggregate pandas UDFs as window functions with unbounded window frames

  Show description for 9786ce6
  

  icexelloss

  authored and

  HyukjinKwon

  committed
  9786ce6

  Copy full SHA for 9786ce6

Commits on Jun 12, 2018

• [SPARK-23933][SQL] Add map_from_arrays function

  Show description for ada28f2
  

  kiszk

  authored and

  ueshin

  committed
  ada28f2

  Copy full SHA for ada28f2

• [SPARK-23931][SQL] Adds arrays_zip function to sparksql

  Show description for f0ef1b3
  

  DylanGuedes

  authored and

  ueshin

  committed
  f0ef1b3

  Copy full SHA for f0ef1b3