Apache Spark

Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Here are 5,235 public repositories matching this topic...
-
Updated
Oct 1, 2020 - Python
-
Updated
Nov 15, 2020 - Go
-
Updated
Dec 5, 2020 - JavaScript
-
Updated
Dec 4, 2020 - Python
Is your feature request related to a problem? Please describe.
It is idiomatic for JWTs to be accepted using a header format of Authorization: Bearer <JWT>
(see jwt.io introduction.) In general, in history, the RFCs surrounding the authorization header have taken care to specify the mode of Authorization as the first part of the header value (e.g. Basic, Di
-
Updated
Nov 11, 2020 - Java
-
Updated
Oct 31, 2019
-
Updated
Dec 5, 2020 - Java
-
Updated
Nov 30, 2020 - Java
-
Updated
Jun 20, 2020 - Python
-
Updated
Dec 6, 2020 - Jupyter Notebook
-
Updated
Dec 6, 2020 - Java
-
Updated
Apr 24, 2020 - Jsonnet
-
Updated
Dec 3, 2020 - Scala
-
Updated
Jul 27, 2020 - Python
-
Updated
May 26, 2019 - Scala
-
Updated
Jun 2, 2020 - JavaScript
Hi, if my spark app is using 2 storage type, both S3 and Azure Data Lake Store Gen2, could I put spark.delta.logStore.class=org.apache.spark.sql.delta.storage.AzureLogStore, org.apache.spark.sql.delta.storage.S3SingleDriverLogStore
Thanks in advance
Used Spark version
2.4.3
Used Spark Job Server version
(Released version, git branch or docker image version)
0.9.0-SNAPSHOT
Deployed mode
(client/cluster on Spark Standalone/YARN/Mesos/EMR or default)
client spark standalone
Actual (wrong) behavior
curl -d "input.string = a b c a b see hello world ssdsds " 'localhost:8090/jobs?appName=test&classPath=spark.jobserver.WordCo
-
Updated
Nov 21, 2020 - Jupyter Notebook
I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?
-
Updated
Dec 5, 2020 - Java
Created by Matei Zaharia
Released May 26, 2014
- Repository
- apache/spark
- Website
- spark.apache.org
- Wikipedia
- Wikipedia
At this moment relu_layer op doesn't allow threshold configuration, and legacy RELU op allows that.
We should add configuration option to relu_layer.